-- Logs begin at Tue 2022-05-03 13:25:43 UTC, end at Tue 2022-05-03 14:35:01 UTC. -- May 03 13:58:24.934164 dv-cinder-839793-5-iscsi systemd[1]: Starting Devstack devstack@keystone.service... May 03 13:58:24.943304 dv-cinder-839793-5-iscsi devstack@keystone.service[79998]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini May 03 13:58:24.945360 dv-cinder-839793-5-iscsi devstack@keystone.service[79998]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue May 3 13:58:24 2022] *** May 03 13:58:24.945360 dv-cinder-839793-5-iscsi devstack@keystone.service[79998]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 03 13:58:24.945360 dv-cinder-839793-5-iscsi devstack@keystone.service[79998]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 03 13:58:24.945360 dv-cinder-839793-5-iscsi devstack@keystone.service[79998]: nodename: dv-cinder-839793-5-iscsi May 03 13:58:24.945360 dv-cinder-839793-5-iscsi devstack@keystone.service[79998]: machine: x86_64 May 03 13:58:24.945360 dv-cinder-839793-5-iscsi devstack@keystone.service[79998]: clock source: unix May 03 13:58:24.945360 dv-cinder-839793-5-iscsi devstack@keystone.service[79998]: pcre jit disabled May 03 13:58:24.945360 dv-cinder-839793-5-iscsi devstack@keystone.service[79998]: detected number of CPU cores: 4 May 03 13:58:24.945360 dv-cinder-839793-5-iscsi devstack@keystone.service[79998]: current working directory: / May 03 13:58:24.945360 dv-cinder-839793-5-iscsi devstack@keystone.service[79998]: detected binary path: /usr/bin/uwsgi-core May 03 13:58:24.945950 dv-cinder-839793-5-iscsi devstack@keystone.service[79998]: your processes number limit is 47680 May 03 13:58:24.945950 dv-cinder-839793-5-iscsi devstack@keystone.service[79998]: your memory page size is 4096 bytes May 03 13:58:24.945950 dv-cinder-839793-5-iscsi devstack@keystone.service[79998]: detected max file descriptor number: 2048 May 03 13:58:24.945950 dv-cinder-839793-5-iscsi devstack@keystone.service[79998]: lock engine: pthread robust mutexes May 03 13:58:24.945950 dv-cinder-839793-5-iscsi devstack@keystone.service[79998]: thunder lock: enabled May 03 13:58:24.945950 dv-cinder-839793-5-iscsi devstack@keystone.service[79998]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 May 03 13:58:24.945950 dv-cinder-839793-5-iscsi devstack@keystone.service[79998]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 03 13:58:24.990649 dv-cinder-839793-5-iscsi devstack@keystone.service[79998]: Python main interpreter initialized at 0x562aa69989c0 May 03 13:58:24.990649 dv-cinder-839793-5-iscsi devstack@keystone.service[79998]: python threads support enabled May 03 13:58:24.990649 dv-cinder-839793-5-iscsi devstack@keystone.service[79998]: your server socket listen backlog is limited to 100 connections May 03 13:58:24.990649 dv-cinder-839793-5-iscsi devstack@keystone.service[79998]: your mercy for graceful operations on workers is 90 seconds May 03 13:58:24.991043 dv-cinder-839793-5-iscsi devstack@keystone.service[79998]: mapped 403077 bytes (393 KB) for 2 cores May 03 13:58:24.991119 dv-cinder-839793-5-iscsi devstack@keystone.service[79998]: *** Operational MODE: preforking *** May 03 13:58:24.991360 dv-cinder-839793-5-iscsi devstack@keystone.service[79998]: *** uWSGI is running in multiple interpreter mode *** May 03 13:58:24.991360 dv-cinder-839793-5-iscsi devstack@keystone.service[79998]: spawned uWSGI master process (pid: 79998) May 03 13:58:24.991569 dv-cinder-839793-5-iscsi systemd[1]: Started Devstack devstack@keystone.service. May 03 13:58:24.997324 dv-cinder-839793-5-iscsi devstack@keystone.service[79998]: spawned uWSGI worker 1 (pid: 80012, cores: 1) May 03 13:58:24.997324 dv-cinder-839793-5-iscsi devstack@keystone.service[79998]: spawned uWSGI worker 2 (pid: 80013, cores: 1) May 03 13:58:24.997324 dv-cinder-839793-5-iscsi devstack@keystone.service[79998]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 03 13:58:30.624730 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 03 13:58:30.624730 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: from cryptography.utils import int_from_bytes May 03 13:58:30.625621 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 03 13:58:30.625621 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: from cryptography.utils import int_from_bytes May 03 13:58:30.625734 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 03 13:58:30.625734 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: from cryptography.utils import int_from_bytes May 03 13:58:30.625734 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 03 13:58:30.625734 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: from cryptography.utils import int_from_bytes May 03 13:58:30.674541 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 03 13:58:30.674740 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 03 13:58:30.674814 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 03 13:58:30.674890 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] command line args: [] {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 03 13:58:30.675124 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 03 13:58:30.675220 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 03 13:58:30.675288 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] command line args: [] {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 03 13:58:30.675352 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] ================================================================================ {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 03 13:58:30.675506 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 03 13:58:30.675591 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] admin_token = **** {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 13:58:30.675653 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] ================================================================================ {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 03 13:58:30.675719 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] config_dir = [] {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 13:58:30.675888 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] admin_token = **** {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 13:58:30.675972 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 13:58:30.676099 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] config_source = [] {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 13:58:30.676181 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] config_dir = [] {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 13:58:30.676249 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] debug = True {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 13:58:30.676316 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 13:58:30.676458 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] config_source = [] {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 13:58:30.676533 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 13:58:30.678838 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] debug = True {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 13:58:30.678929 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 13:58:30.678999 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 13:58:30.679085 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 13:58:30.679151 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 13:58:30.679151 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 13:58:30.679271 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 13:58:30.679271 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 13:58:30.679382 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 13:58:30.679441 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] list_limit = None {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 13:58:30.679504 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 13:58:30.679563 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] log_config_append = None {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 13:58:30.679627 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] list_limit = None {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 13:58:30.679686 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 13:58:30.679749 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] log_config_append = None {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 13:58:30.679812 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] log_dir = None {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 13:58:30.679872 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 13:58:30.679935 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] log_file = None {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 13:58:30.680003 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] log_dir = None {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 13:58:30.680068 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 13:58:30.680132 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] log_file = None {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 13:58:30.680196 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 13:58:30.680255 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 13:58:30.680313 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 13:58:30.680381 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 13:58:30.680441 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 13:58:30.680509 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 13:58:30.680568 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 13:58:30.680627 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 13:58:30.680686 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 13:58:30.680754 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 13:58:30.680824 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 13:58:30.680892 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 13:58:30.680958 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 13:58:30.681034 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 13:58:30.681101 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 13:58:30.681161 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 13:58:30.681225 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 13:58:30.681836 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 13:58:30.682044 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 13:58:30.682217 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 13:58:30.682441 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 13:58:30.682608 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 13:58:30.682801 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 13:58:30.682989 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 13:58:30.683208 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 13:58:30.683369 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 13:58:30.683369 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 13:58:30.683733 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 13:58:30.683918 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 13:58:30.684105 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.36/identity {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 13:58:30.684105 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] publish_errors = False {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 13:58:30.684474 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.36/identity {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 13:58:30.684676 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 13:58:30.684868 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] publish_errors = False {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 13:58:30.685091 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 13:58:30.685257 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 13:58:30.685453 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 13:58:30.685637 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 13:58:30.685828 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 13:58:30.686013 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 13:58:30.686325 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 13:58:30.686496 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 13:58:30.686659 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] standard_threads = False {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 13:58:30.686818 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 13:58:30.686972 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 13:58:30.687109 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] standard_threads = False {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 13:58:30.687252 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 13:58:30.687417 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 13:58:30.687546 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 13:58:30.687793 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 13:58:30.687964 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] use_journal = False {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 13:58:30.688210 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 13:58:30.688414 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] use_json = False {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 13:58:30.688549 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] use_journal = False {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 13:58:30.688698 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] use_stderr = False {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 13:58:30.688875 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] use_json = False {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 13:58:30.689040 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] use_syslog = False {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 13:58:30.689208 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] use_stderr = False {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 13:58:30.689479 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 13:58:30.689654 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] use_syslog = False {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 13:58:30.689654 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 13:58:30.689896 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.690020 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.690155 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.690291 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.690417 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.690417 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.690649 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.690649 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.690895 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.691019 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.691143 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.691266 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.691402 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.691607 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.691736 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.691861 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.691991 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.692116 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.692242 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.692375 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.692500 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.692500 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.692734 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.692857 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.692986 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.693139 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.693266 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.693266 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.693576 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.693702 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.693829 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.693963 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.694095 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.694226 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.694367 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.694498 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.694632 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.694764 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.694906 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.695032 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.695161 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.695287 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.695410 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.695542 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.695675 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.695800 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.695931 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.696056 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.696185 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.696318 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.696444 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.696576 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.696714 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.696839 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.696969 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.697106 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.697232 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.697385 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.697512 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.697636 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.697761 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.697962 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.698090 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.698215 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.698344 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.698480 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.698604 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.698737 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.698862 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.698986 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.699110 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.699233 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.699369 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.699494 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.699618 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.699741 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.699865 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.699989 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.700401 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.700550 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.700681 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.700806 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.700935 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.701058 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.701190 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.701344 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.701475 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.701599 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.701733 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.701866 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.701999 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.702124 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.702249 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.703490 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.703685 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.703873 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.704095 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.704257 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.704447 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.704633 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.704820 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.705012 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.705207 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.705397 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.705654 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.705854 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.706029 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.706216 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.706475 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.706637 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.706824 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.707016 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.707204 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.707390 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.707584 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.707771 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.707964 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.708157 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.708344 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.708514 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.708654 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.708824 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.708951 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.709115 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.709254 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.709435 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.709573 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.709701 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.709870 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.710001 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.710127 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.710253 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.710379 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.710517 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.710659 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.710787 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.710913 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.711044 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.711198 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.711330 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.711467 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.711595 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.711721 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.711848 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.711979 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.712106 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.712249 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.712386 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.712513 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.712639 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.712764 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.712890 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.713028 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.713156 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.713331 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.713465 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.713465 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.713702 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.713968 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.713968 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.714551 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.714680 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.714806 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.714939 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.715066 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.715192 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.715316 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.715443 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.715568 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.715701 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.715827 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.715953 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.716078 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.716213 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.716339 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.716473 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.716606 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.716732 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.716863 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.716996 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.717128 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.717262 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.717429 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.717570 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.717696 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.717821 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.717952 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.718090 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.718224 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.718360 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.718486 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.718612 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.718737 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.718900 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.719032 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.719166 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.719293 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.719419 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.719544 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.719712 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.719948 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.719948 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.720251 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.720378 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.720504 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.720504 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.720749 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.720886 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] auth.external = None {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.721020 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.721146 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.721271 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] auth.external = None {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.721271 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.721543 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.721543 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.721841 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.721979 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] auth.password = None {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.722105 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.722231 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] auth.token = None {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.722363 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] auth.password = None {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.722363 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] auth.token = None {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.722611 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.722739 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.722866 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.722991 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.723117 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.723242 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.723377 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.723505 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.723642 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.723769 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.723896 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.723896 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.724196 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.724324 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] credential.caching = True {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.724450 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.724450 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] credential.caching = True {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.724737 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.724870 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.725006 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.725134 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.725260 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.725260 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.725566 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.725566 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.725815 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.725943 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.726069 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.726194 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.726320 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.726453 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.726588 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.726784 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.726927 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.727057 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.727184 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.727320 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.727456 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.727590 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.727718 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.727843 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.727969 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.728096 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.728231 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.728357 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.728483 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.728609 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.728735 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] federation.caching = True {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.728860 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] federation.caching = True {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.728995 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.729133 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.729274 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.729423 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.729551 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.729691 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.729894 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.730025 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.730152 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.730279 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.730407 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.730533 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.730667 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.730795 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.730933 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.731060 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.731188 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.731314 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.731448 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.731448 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.731687 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.731812 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] identity.caching = True {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.731938 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.732063 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.732199 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] identity.caching = True {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.732331 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.732457 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.732583 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.732722 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.732849 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.732988 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.733116 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.733242 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.733398 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.733526 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.733663 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.733790 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.733916 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.734042 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.734167 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.734294 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.734439 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.734575 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.734708 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.734834 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.734960 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.735086 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.735228 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.735358 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.735489 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.735621 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.735748 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.735874 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.736008 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.736135 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.736271 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.736400 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.736527 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.736652 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.736787 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.736914 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.737039 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.737164 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.737338 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.737473 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.737610 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.737737 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.737863 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.738000 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.738126 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.738251 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.738385 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.738515 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.738641 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.738766 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.738892 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.739018 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.739152 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.739278 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.739404 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.739530 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.739656 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.739791 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.739926 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.740052 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.740178 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.740303 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.740428 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.740554 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.740690 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.740816 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.740942 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.741074 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.741306 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.741455 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.741610 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.741741 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.741873 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.742000 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.742126 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.742252 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.742386 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.742513 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.742639 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.742766 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.742892 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.743018 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.743156 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.743284 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.743421 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.743547 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.743674 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.743801 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.743936 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.744063 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.744188 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.744314 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.744440 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.744574 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.744710 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.744838 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.744964 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.745090 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.745226 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] ldap.user = None {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.745406 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.745546 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.745676 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] ldap.user = None {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.745802 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.745929 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.746055 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.746181 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.746315 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.746442 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.746568 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.746694 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.746821 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.746966 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.747094 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.747220 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.747347 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.747472 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.747598 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.747732 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.747860 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.747988 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.748114 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.748240 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.748365 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.748499 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.748627 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.748764 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.748890 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.749017 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.749143 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.749277 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.749443 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.749570 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.749696 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.749821 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.749821 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.750113 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.750254 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.750381 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.750506 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.750650 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.750777 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.750777 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.751026 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.751153 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.751279 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.751404 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.751530 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.751663 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.751790 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.751915 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.752041 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.752168 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.752305 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.752440 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.752568 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.752693 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.752819 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.752944 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.753070 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.753206 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.753352 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.753483 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.753609 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.753734 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.753860 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.753997 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.754135 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.754265 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.754390 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.754521 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.754650 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.754850 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.754980 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.755106 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] resource.caching = True {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.755232 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] resource.caching = True {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.755359 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.755485 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.755621 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.755749 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.755875 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.756012 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.756138 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.756264 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.756399 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.756526 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.756652 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.756778 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.756904 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.757030 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.757164 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.757320 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.757455 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.757581 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.757706 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] role.caching = True {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.757842 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] role.caching = True {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.757980 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] role.driver = sql {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.758108 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] role.driver = sql {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.758234 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.758360 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.758486 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.758613 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.758746 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.758881 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.759008 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.759134 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.759260 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.759386 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.759532 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.759660 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.759787 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.759913 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.760037 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.760169 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.760304 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.760431 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.760559 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.760684 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.760809 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.760944 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.761071 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.761209 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.761354 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.761486 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.761615 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.761752 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.761880 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.762006 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.762132 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.762258 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.762383 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.762524 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.762655 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.762781 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.762917 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.763044 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.763176 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.763312 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.763440 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.763567 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.763695 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.763822 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.763947 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.764082 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.764210 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.764337 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.764468 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.764612 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.764742 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.764877 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.765008 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.765134 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.765261 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.765438 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.765566 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.765726 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.765862 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.766024 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.766152 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.766278 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.766404 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.766548 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.766676 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.766804 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.766930 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] token.caching = True {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.767056 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] token.caching = True {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.767190 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.767317 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.767444 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.767444 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.767775 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.767936 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.768075 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.768203 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.768330 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.768466 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.768592 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.768719 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.768853 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.768982 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.769109 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.769235 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.769384 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.769512 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.769650 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.769777 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.769904 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.770052 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.770195 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.770322 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.770456 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.770583 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.770709 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.770835 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.770961 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.771087 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.771222 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.771350 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.771497 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.771628 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] database.connection = **** {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.771764 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.771899 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.772038 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] database.connection = **** {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.772175 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.772311 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.772445 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.772573 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.772699 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.772826 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.772951 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.773077 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.773212 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.773415 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.773545 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.773672 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.773799 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.773935 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.774073 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.774202 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.774328 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.774468 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.774598 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.774725 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.774859 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.774987 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.775113 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.775241 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.775368 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.775494 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.775695 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.775835 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.775962 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.776089 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.776224 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.776353 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.776488 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.776488 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 03 13:58:30.776732 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.776732 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 13:58:30.776732 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80013) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 03 13:58:30.789628 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80012) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 13:58:30.789843 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80012) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 13:58:30.789989 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80013) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 13:58:30.790121 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80012) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 13:58:30.790254 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80013) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 13:58:30.790384 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80013) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 13:58:30.798825 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80012) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 13:58:30.799079 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80013) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 13:58:30.827188 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80012) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 13:58:30.827422 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80012) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 13:58:30.827556 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80013) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 13:58:30.827706 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80013) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 13:58:30.880859 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80013) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 13:58:30.881120 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80012) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 13:58:30.931646 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80012) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 13:58:30.931941 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80012) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 13:58:30.932313 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80013) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 13:58:30.932514 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80013) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 13:58:30.997687 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80012) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 13:58:30.997995 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80012) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 13:58:30.998140 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80013) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 13:58:30.998277 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80012) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 13:58:30.998429 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80013) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 13:58:30.998578 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80012) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 13:58:30.998708 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80013) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 13:58:30.998837 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80012) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 13:58:30.998966 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80013) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 13:58:30.999104 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80012) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 13:58:30.999234 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80013) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 13:58:30.999234 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80013) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 13:58:31.022026 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80013) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 13:58:31.022300 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80013) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 13:58:31.022475 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80013) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 13:58:31.022634 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80012) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 13:58:31.022723 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80013) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 13:58:31.022860 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80012) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 13:58:31.022943 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80013) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 13:58:31.023075 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80012) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 13:58:31.023168 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80013) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 13:58:31.023302 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80013) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 13:58:31.023382 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80012) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 13:58:31.023512 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80012) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 13:58:31.023703 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80012) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 13:58:31.023919 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80012) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 13:58:31.035398 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80012) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 13:58:31.035506 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80013) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 13:58:31.050696 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80012) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 13:58:31.051020 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80012) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 13:58:31.051157 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80012) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 13:58:31.051354 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80012) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 13:58:31.051574 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80012) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 13:58:31.051729 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80013) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 13:58:31.051817 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80012) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 13:58:31.052001 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80013) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 13:58:31.052084 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80012) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 13:58:31.052149 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80013) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 13:58:31.052358 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80013) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 13:58:31.052560 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80013) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 13:58:31.052770 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80013) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 13:58:31.052978 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80013) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 13:58:31.069731 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80012) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 13:58:31.069950 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80012) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 03 13:58:31.070272 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80012) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 13:58:31.070412 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80013) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 13:58:31.070487 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80012) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 03 13:58:31.070723 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80013) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 03 13:58:31.070810 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80012) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 13:58:31.070974 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80013) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 13:58:31.071054 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80012) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 13:58:31.071129 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80013) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 03 13:58:31.071193 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80012) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 13:58:31.071429 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80013) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 13:58:31.071509 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80012) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 13:58:31.071667 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80013) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 13:58:31.071852 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80013) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 13:58:31.072127 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80013) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 13:58:31.082590 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80012) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 13:58:31.082833 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80012) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 13:58:31.082995 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80013) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 13:58:31.083081 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80012) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 13:58:31.083271 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80013) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 13:58:31.083354 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80012) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 13:58:31.083518 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80013) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 13:58:31.083816 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80013) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 13:58:31.091724 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80012) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 13:58:31.092119 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80013) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 13:58:31.095210 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80012) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 13:58:31.095437 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80013) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 13:58:31.095528 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80012) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 13:58:31.095699 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80013) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 13:58:31.095797 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80012) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 13:58:31.095963 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80013) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 13:58:31.096104 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80012) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 13:58:31.096337 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80013) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 13:58:31.096455 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80012) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 13:58:31.096653 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80013) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 13:58:31.096753 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80012) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 13:58:31.096821 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80013) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 13:58:31.096890 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80012) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 13:58:31.097144 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80013) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 13:58:31.097226 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80012) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 13:58:31.097434 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80013) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 13:58:31.097517 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80012) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 13:58:31.097682 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80013) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 13:58:31.097762 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80012) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 13:58:31.097922 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80013) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 13:58:31.098016 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80012) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 13:58:31.098182 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80013) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 13:58:31.124385 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80012) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 13:58:31.124832 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80013) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 13:58:31.126082 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80012) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 13:58:31.126358 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80012) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 13:58:31.126730 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80013) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 13:58:31.127008 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80013) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 13:58:31.131702 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80012) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 13:58:31.131922 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80012) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 13:58:31.132162 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80013) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 13:58:31.132253 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80012) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 13:58:31.132437 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80013) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 13:58:31.132711 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80013) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 13:58:31.139508 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80012) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 13:58:31.139954 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80012) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 13:58:31.140059 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80013) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 13:58:31.140244 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80013) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 13:58:31.144487 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80012) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 13:58:31.144772 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80012) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 13:58:31.144872 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80013) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 13:58:31.145046 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80012) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 13:58:31.145142 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80013) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 13:58:31.145343 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80012) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 13:58:31.145430 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80013) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 13:58:31.145607 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80012) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 13:58:31.145694 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80013) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 13:58:31.145875 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80012) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 13:58:31.145962 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80013) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 13:58:31.146140 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80012) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 13:58:31.146226 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80013) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 13:58:31.146398 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80012) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 13:58:31.146491 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80013) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 13:58:31.146693 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80013) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 13:58:31.165003 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80012) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 13:58:31.165102 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80013) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 13:58:31.165325 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80012) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 13:58:31.165414 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80013) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 13:58:31.169755 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80013) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 13:58:31.169846 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80012) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 13:58:31.173401 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80012) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 13:58:31.173498 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80013) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 13:58:31.173691 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80012) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 13:58:31.173791 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80013) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 13:58:31.178614 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80012) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 13:58:31.178703 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80013) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 13:58:31.182170 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80013) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 13:58:31.182289 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80012) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 13:58:31.185876 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80013) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 13:58:31.185998 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80012) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 13:58:31.186201 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80013) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 13:58:31.186290 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80012) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 13:58:31.186458 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80013) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 13:58:31.186629 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80012) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 13:58:31.186699 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80013) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 13:58:31.186762 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80012) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 13:58:31.187005 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80013) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 13:58:31.187090 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80012) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 13:58:31.187266 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80012) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 13:58:31.187347 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80013) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 13:58:31.206185 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80012) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 13:58:31.206553 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80013) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 13:58:31.206674 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80012) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 13:58:31.206766 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80012) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 13:58:31.206998 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80013) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 13:58:31.207085 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80012) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 13:58:31.207151 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80013) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 13:58:31.207390 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80013) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 13:58:31.215178 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80012) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 13:58:31.215513 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80013) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 13:58:31.216873 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80012) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 13:58:31.217150 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80012) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 13:58:31.217269 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80013) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 13:58:31.217475 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80013) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 13:58:31.220198 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80012) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 13:58:31.220483 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80012) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 13:58:31.220602 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80013) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 13:58:31.220811 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80012) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 13:58:31.220902 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80013) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 13:58:31.221069 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80013) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 13:58:31.221165 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80012) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 13:58:31.221361 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80012) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 13:58:31.221431 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80013) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 13:58:31.221640 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80013) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 13:58:31.234647 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80012) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 13:58:31.234916 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80013) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 13:58:31.235119 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80012) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 13:58:31.235268 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80013) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 13:58:31.235419 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80012) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 13:58:31.235572 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80013) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 13:58:31.235715 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80012) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 13:58:31.235856 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80013) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 13:58:31.235996 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80012) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 13:58:31.236135 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80013) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 13:58:31.236284 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80012) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 13:58:31.236426 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80013) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 13:58:31.236566 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80012) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 13:58:31.236716 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80013) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 13:58:31.254223 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80012) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 13:58:31.254468 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80013) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 13:58:31.257475 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80012) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 13:58:31.257685 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80013) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 13:58:31.260772 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80012) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 13:58:31.260979 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80013) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 13:58:31.262371 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80013) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 13:58:31.262593 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80012) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 13:58:31.263955 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80013) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 13:58:31.264162 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80012) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 13:58:31.264331 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80013) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 13:58:31.264476 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80012) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 13:58:31.264630 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80013) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 13:58:31.264773 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80012) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 13:58:31.271854 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80013) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 13:58:31.272064 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80012) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 13:58:31.273461 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80013) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 13:58:31.273686 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80012) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 13:58:31.276623 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80013) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 13:58:31.276829 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80012) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 13:58:31.276981 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80013) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 13:58:31.277138 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80012) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 13:58:31.277280 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80013) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 13:58:31.277475 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80012) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 13:58:31.277618 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80013) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 13:58:31.277757 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80012) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 13:58:31.286683 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80013) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 13:58:31.286911 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80012) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 13:58:31.287086 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80013) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 13:58:31.287232 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80012) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 13:58:31.287379 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80013) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 13:58:31.287542 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80012) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 13:58:31.295092 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80013) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 13:58:31.295317 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80013) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 13:58:31.295469 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80012) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 13:58:31.295613 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80013) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 13:58:31.295752 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80012) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 13:58:31.295890 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80013) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 13:58:31.296028 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80012) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 13:58:31.296176 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80013) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 13:58:31.296317 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80012) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 13:58:31.296456 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80013) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 13:58:31.296595 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80012) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 13:58:31.296742 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80013) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 13:58:31.296888 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80012) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 13:58:31.297109 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80013) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 13:58:31.297250 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80012) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 13:58:31.297609 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80013) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 13:58:31.297817 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80012) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 13:58:31.297960 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80013) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 13:58:31.298100 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80012) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 13:58:31.298247 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80013) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 13:58:31.298386 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80012) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 13:58:31.298557 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80013) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 13:58:31.298705 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80012) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 13:58:31.298844 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80013) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 13:58:31.298981 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80012) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 13:58:31.299119 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80013) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 13:58:31.299256 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80012) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 13:58:31.299256 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80012) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 13:58:31.337314 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x562aa69989c0 pid: 80013 (default app) May 03 13:58:31.337571 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x562aa69989c0 pid: 80012 (default app) May 03 13:58:31.341049 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d9e9a2-3db9-4a45-8239-cbc845dcf801 None None] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:58:31.341335 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d9e9a2-3db9-4a45-8239-cbc845dcf801 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:58:31.341613 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d9e9a2-3db9-4a45-8239-cbc845dcf801 None None] PATH_INFO: `/v3` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:58:31.345897 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1/1] 10.222.0.36 () {50 vars in 791 bytes} [Tue May 3 13:58:31 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 13:58:39.284270 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b435636-85cf-47ac-a3c3-4c869ad0acb5 None None] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:58:39.284857 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b435636-85cf-47ac-a3c3-4c869ad0acb5 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:58:39.284857 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b435636-85cf-47ac-a3c3-4c869ad0acb5 None None] PATH_INFO: `/` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:58:39.289152 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1/2] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 3 13:58:39 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 13:58:39.294601 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bbbbb2-4efe-444a-9125-34e25dfd7de7 None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:58:39.295045 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bbbbb2-4efe-444a-9125-34e25dfd7de7 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:58:39.295133 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bbbbb2-4efe-444a-9125-34e25dfd7de7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:58:39.326460 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG oslo_db.sqlalchemy.engines [None req-a3bbbbb2-4efe-444a-9125-34e25dfd7de7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80013) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 03 13:58:39.508119 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG passlib.handlers.bcrypt [None req-a3bbbbb2-4efe-444a-9125-34e25dfd7de7 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80013) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 03 13:58:39.508539 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG passlib.handlers.bcrypt [None req-a3bbbbb2-4efe-444a-9125-34e25dfd7de7 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80013) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 03 13:58:39.565623 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-a3bbbbb2-4efe-444a-9125-34e25dfd7de7 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 13:58:39.567280 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-a3bbbbb2-4efe-444a-9125-34e25dfd7de7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 13:58:39.693837 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 2/3] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 3 13:58:39 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 400 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 03 13:58:39.727489 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b435636-85cf-47ac-a3c3-4c869ad0acb5 None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:58:39.762253 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG oslo_db.sqlalchemy.engines [None req-8b435636-85cf-47ac-a3c3-4c869ad0acb5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80012) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 03 13:58:39.901490 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b435636-85cf-47ac-a3c3-4c869ad0acb5 None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:58:39.907142 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7e0cc6-8e0e-49b9-b72f-905000185453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:58:39.907813 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7e0cc6-8e0e-49b9-b72f-905000185453 admin admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:58:39.908096 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7e0cc6-8e0e-49b9-b72f-905000185453 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:58:39.908368 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7e0cc6-8e0e-49b9-b72f-905000185453 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:58:39.917510 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7e0cc6-8e0e-49b9-b72f-905000185453 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:58:39.970090 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: WARNING keystone.common.rbac_enforcer.enforcer [None req-7a7e0cc6-8e0e-49b9-b72f-905000185453 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 03 13:58:39.970369 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7e0cc6-8e0e-49b9-b72f-905000185453 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:58:39.980418 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 2/4] 10.222.0.36 () {58 vars in 1324 bytes} [Tue May 3 13:58:39 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 03 13:58:39.986919 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bbbbb2-4efe-444a-9125-34e25dfd7de7 None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:58:40.002228 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bbbbb2-4efe-444a-9125-34e25dfd7de7 None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:58:40.008052 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead4564c-760e-4392-806b-20eddaf77c3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:58:40.009300 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead4564c-760e-4392-806b-20eddaf77c3d admin admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:58:40.009582 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead4564c-760e-4392-806b-20eddaf77c3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:58:40.009892 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead4564c-760e-4392-806b-20eddaf77c3d admin admin] PATH_INFO: `/v3/projects/71795b2bf1064a2fb47b7b3b4817ce5c` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:58:40.011541 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead4564c-760e-4392-806b-20eddaf77c3d admin admin] RBAC: Authorizing `identity:get_project(project_id=71795b2bf1064a2fb47b7b3b4817ce5c)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:58:40.062482 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: WARNING keystone.common.rbac_enforcer.enforcer [None req-ead4564c-760e-4392-806b-20eddaf77c3d admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 03 13:58:40.062857 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead4564c-760e-4392-806b-20eddaf77c3d admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:58:40.067861 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 3/5] 10.222.0.36 () {56 vars in 1207 bytes} [Tue May 3 13:58:39 2022] GET /identity/v3/projects/71795b2bf1064a2fb47b7b3b4817ce5c => generated 344 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 13:58:42.271639 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf54fcd0-c5aa-47a0-a667-7aaf210a43c8 None None] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:58:42.272218 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf54fcd0-c5aa-47a0-a667-7aaf210a43c8 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:58:42.272218 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf54fcd0-c5aa-47a0-a667-7aaf210a43c8 None None] PATH_INFO: `/` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:58:42.276372 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 3/6] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 3 13:58:42 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 13:58:42.283304 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf198793-a2b5-43af-aec2-828630aa72bc None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:58:42.284043 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf198793-a2b5-43af-aec2-828630aa72bc None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:58:42.284216 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf198793-a2b5-43af-aec2-828630aa72bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:58:42.309988 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-cf198793-a2b5-43af-aec2-828630aa72bc None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 13:58:42.311515 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-cf198793-a2b5-43af-aec2-828630aa72bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 13:58:42.322232 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 4/7] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 3 13:58:42 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 03 13:58:42.347229 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf54fcd0-c5aa-47a0-a667-7aaf210a43c8 None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:58:42.361471 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf54fcd0-c5aa-47a0-a667-7aaf210a43c8 None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:58:42.367159 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37482f4d-97ec-401e-8b19-68d06ba0a5d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:58:42.367797 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37482f4d-97ec-401e-8b19-68d06ba0a5d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:58:42.368077 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37482f4d-97ec-401e-8b19-68d06ba0a5d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:58:42.368365 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37482f4d-97ec-401e-8b19-68d06ba0a5d4 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:58:42.376947 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37482f4d-97ec-401e-8b19-68d06ba0a5d4 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:58:42.378756 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37482f4d-97ec-401e-8b19-68d06ba0a5d4 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:58:42.388147 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 4/8] 10.222.0.36 () {58 vars in 1324 bytes} [Tue May 3 13:58:42 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 03 13:58:42.393995 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf198793-a2b5-43af-aec2-828630aa72bc None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:58:42.403815 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf198793-a2b5-43af-aec2-828630aa72bc None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:58:42.410270 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa84dad6-1f7c-444c-a8a0-74d11935afce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:58:42.411138 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa84dad6-1f7c-444c-a8a0-74d11935afce admin admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:58:42.411418 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa84dad6-1f7c-444c-a8a0-74d11935afce admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:58:42.411668 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa84dad6-1f7c-444c-a8a0-74d11935afce admin admin] PATH_INFO: `/v3/users/87a3e2c426774a3eba9534209ef0a44b` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:58:42.413231 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa84dad6-1f7c-444c-a8a0-74d11935afce admin admin] RBAC: Authorizing `identity:get_user(user_id=87a3e2c426774a3eba9534209ef0a44b)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:58:42.415100 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa84dad6-1f7c-444c-a8a0-74d11935afce admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:58:42.416960 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 5/9] 10.222.0.36 () {56 vars in 1198 bytes} [Tue May 3 13:58:42 2022] GET /identity/v3/users/87a3e2c426774a3eba9534209ef0a44b => generated 247 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 13:58:44.703008 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc98efc-1ba3-4cc3-af53-42834ec6d8cb None None] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:58:44.703582 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc98efc-1ba3-4cc3-af53-42834ec6d8cb None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:58:44.703687 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc98efc-1ba3-4cc3-af53-42834ec6d8cb None None] PATH_INFO: `/` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:58:44.705066 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 5/10] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 3 13:58:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 13:58:44.710498 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a39560-0189-4f39-b500-eb751e7a7176 None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:58:44.710932 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a39560-0189-4f39-b500-eb751e7a7176 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:58:44.711055 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a39560-0189-4f39-b500-eb751e7a7176 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:58:44.749918 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46501fa6-5cc4-4ae8-bcce-ff9ff232ba2e None None] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:58:44.750211 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46501fa6-5cc4-4ae8-bcce-ff9ff232ba2e None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:58:44.750493 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46501fa6-5cc4-4ae8-bcce-ff9ff232ba2e None None] PATH_INFO: `/` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:58:44.751899 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 6/11] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 3 13:58:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 13:58:44.757803 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c80a44-fcf4-4d87-bb08-baf318dfb495 None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:58:44.758097 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c80a44-fcf4-4d87-bb08-baf318dfb495 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:58:44.758378 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c80a44-fcf4-4d87-bb08-baf318dfb495 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:58:44.800771 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG passlib.handlers.bcrypt [None req-b7c80a44-fcf4-4d87-bb08-baf318dfb495 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80012) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 03 13:58:44.801203 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG passlib.handlers.bcrypt [None req-b7c80a44-fcf4-4d87-bb08-baf318dfb495 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80012) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 03 13:58:44.839638 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-f7a39560-0189-4f39-b500-eb751e7a7176 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 13:58:44.840827 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-f7a39560-0189-4f39-b500-eb751e7a7176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 13:58:44.847877 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-b7c80a44-fcf4-4d87-bb08-baf318dfb495 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 13:58:44.849506 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-b7c80a44-fcf4-4d87-bb08-baf318dfb495 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 13:58:44.921122 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 6/12] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 3 13:58:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 13:58:44.943949 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a39560-0189-4f39-b500-eb751e7a7176 None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:58:44.949494 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 7/13] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 3 13:58:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 13:58:44.971906 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c80a44-fcf4-4d87-bb08-baf318dfb495 None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:58:45.044949 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a39560-0189-4f39-b500-eb751e7a7176 None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:58:45.067964 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c80a44-fcf4-4d87-bb08-baf318dfb495 None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:58:45.078217 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f056a836-c6b0-4471-ad79-4194b171ead6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:58:45.079020 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f056a836-c6b0-4471-ad79-4194b171ead6 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:58:45.079295 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f056a836-c6b0-4471-ad79-4194b171ead6 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:58:45.079538 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f056a836-c6b0-4471-ad79-4194b171ead6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:58:45.090820 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f056a836-c6b0-4471-ad79-4194b171ead6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 13:58:45.101977 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application [None req-f056a836-c6b0-4471-ad79-4194b171ead6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 03 13:58:45.101977 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 13:58:45.101977 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 13:58:45.101977 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 13:58:45.101977 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 13:58:45.101977 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 13:58:45.101977 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 13:58:45.101977 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 13:58:45.101977 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 13:58:45.101977 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 13:58:45.101977 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 13:58:45.101977 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 13:58:45.101977 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 13:58:45.101977 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 13:58:45.101977 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 13:58:45.101977 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 13:58:45.103005 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 13:58:45.103005 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 13:58:45.103005 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 13:58:45.103005 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 13:58:45.103005 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 13:58:45.103005 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 13:58:45.103005 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 13:58:45.103005 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 13:58:45.103005 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 13:58:45.103005 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.get_or_create( May 03 13:58:45.103005 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 13:58:45.103005 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application with Lock( May 03 13:58:45.103005 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 13:58:45.103005 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._enter() May 03 13:58:45.103005 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 13:58:45.103005 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 13:58:45.103848 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 13:58:45.103848 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.creator() May 03 13:58:45.103848 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 13:58:45.103848 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application created_value = creator( May 03 13:58:45.103848 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 13:58:45.103848 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 13:58:45.103848 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 13:58:45.103848 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 13:58:45.103848 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 13:58:45.103848 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 13:58:45.103848 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 03 13:58:45.103848 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application May 03 13:58:45.104473 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d960458e-d3c3-4b22-bcc6-0ab5a2928cba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:58:45.104473 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d960458e-d3c3-4b22-bcc6-0ab5a2928cba None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:58:45.104473 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d960458e-d3c3-4b22-bcc6-0ab5a2928cba None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:58:45.104682 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 7/14] 10.222.0.36 () {56 vars in 1096 bytes} [Tue May 3 13:58:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 13:58:45.104749 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d960458e-d3c3-4b22-bcc6-0ab5a2928cba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:58:45.109001 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f056a836-c6b0-4471-ad79-4194b171ead6 None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:58:45.168766 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d960458e-d3c3-4b22-bcc6-0ab5a2928cba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:58:45.170332 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d960458e-d3c3-4b22-bcc6-0ab5a2928cba None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:58:45.200454 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f056a836-c6b0-4471-ad79-4194b171ead6 None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:58:45.234024 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb7ca7b-a8af-40a6-9466-c148322b7a76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:58:45.234644 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb7ca7b-a8af-40a6-9466-c148322b7a76 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:58:45.235014 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb7ca7b-a8af-40a6-9466-c148322b7a76 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:58:45.235291 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb7ca7b-a8af-40a6-9466-c148322b7a76 None admin] PATH_INFO: `/v3/roles` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:58:45.236034 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb7ca7b-a8af-40a6-9466-c148322b7a76 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 13:58:45.236322 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb7ca7b-a8af-40a6-9466-c148322b7a76 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:58:45.237741 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb7ca7b-a8af-40a6-9466-c148322b7a76 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:58:45.249425 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 8/15] 10.222.0.36 () {56 vars in 1099 bytes} [Tue May 3 13:58:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 13:58:45.255098 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb7ca7b-a8af-40a6-9466-c148322b7a76 None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:58:45.266272 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 8/16] 10.222.0.36 () {58 vars in 1282 bytes} [Tue May 3 13:58:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 03 13:58:45.272060 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d960458e-d3c3-4b22-bcc6-0ab5a2928cba None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:58:45.351619 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb7ca7b-a8af-40a6-9466-c148322b7a76 None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:58:45.371062 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d960458e-d3c3-4b22-bcc6-0ab5a2928cba None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:58:45.386596 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2066d670-eb2e-46dc-85f0-356fdb184ff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:58:45.387469 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2066d670-eb2e-46dc-85f0-356fdb184ff4 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:58:45.387747 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2066d670-eb2e-46dc-85f0-356fdb184ff4 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:58:45.388016 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2066d670-eb2e-46dc-85f0-356fdb184ff4 None admin] PATH_INFO: `/v3/users/87a3e2c426774a3eba9534209ef0a44b` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:58:45.389220 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2066d670-eb2e-46dc-85f0-356fdb184ff4 None admin] RBAC: Authorizing `identity:get_user(user_id=87a3e2c426774a3eba9534209ef0a44b)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:58:45.390736 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2066d670-eb2e-46dc-85f0-356fdb184ff4 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:58:45.392348 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 9/17] 10.222.0.36 () {56 vars in 1177 bytes} [Tue May 3 13:58:45 2022] GET /identity/v3/users/87a3e2c426774a3eba9534209ef0a44b => generated 247 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 13:58:45.397752 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2066d670-eb2e-46dc-85f0-356fdb184ff4 None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:58:45.404070 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5808bf53-adfb-4b0c-88a1-6c57f2bbe06b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:58:45.404875 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5808bf53-adfb-4b0c-88a1-6c57f2bbe06b None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:58:45.405159 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5808bf53-adfb-4b0c-88a1-6c57f2bbe06b None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:58:45.405453 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5808bf53-adfb-4b0c-88a1-6c57f2bbe06b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:58:45.502997 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2066d670-eb2e-46dc-85f0-356fdb184ff4 None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:58:45.534201 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5808bf53-adfb-4b0c-88a1-6c57f2bbe06b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:58:45.535697 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5808bf53-adfb-4b0c-88a1-6c57f2bbe06b None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:58:45.539853 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01efe6da-bb3f-4cec-973f-bf8a0b5018c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:58:45.540678 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01efe6da-bb3f-4cec-973f-bf8a0b5018c0 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:58:45.540951 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01efe6da-bb3f-4cec-973f-bf8a0b5018c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:58:45.541205 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01efe6da-bb3f-4cec-973f-bf8a0b5018c0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:58:45.542434 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01efe6da-bb3f-4cec-973f-bf8a0b5018c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:58:45.543849 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01efe6da-bb3f-4cec-973f-bf8a0b5018c0 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:58:45.545683 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 10/18] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 3 13:58:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 13:58:45.551326 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01efe6da-bb3f-4cec-973f-bf8a0b5018c0 None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:58:45.557105 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application [None req-5808bf53-adfb-4b0c-88a1-6c57f2bbe06b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 13:58:45.557105 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 13:58:45.557105 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 13:58:45.557105 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 13:58:45.557105 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 13:58:45.557105 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 13:58:45.557105 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 13:58:45.557105 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 13:58:45.557105 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 13:58:45.557105 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 13:58:45.557105 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 13:58:45.557105 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 13:58:45.557105 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 13:58:45.557105 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 13:58:45.557105 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 13:58:45.558006 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 13:58:45.558006 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 13:58:45.558006 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 13:58:45.558006 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 13:58:45.558006 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 13:58:45.558006 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 13:58:45.558006 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.get_or_create( May 03 13:58:45.558006 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 13:58:45.558006 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application with Lock( May 03 13:58:45.558006 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 13:58:45.558006 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._enter() May 03 13:58:45.558006 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 13:58:45.558006 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 13:58:45.558006 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 13:58:45.558006 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.creator() May 03 13:58:45.558006 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 13:58:45.558006 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application created_value = creator( May 03 13:58:45.558839 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 13:58:45.558839 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 13:58:45.558839 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 13:58:45.558839 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application May 03 13:58:45.558839 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 9/19] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 3 13:58:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 13:58:45.564526 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5808bf53-adfb-4b0c-88a1-6c57f2bbe06b None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:58:45.648947 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01efe6da-bb3f-4cec-973f-bf8a0b5018c0 None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:58:45.663726 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5808bf53-adfb-4b0c-88a1-6c57f2bbe06b None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:58:45.684246 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320ceb7d-7f79-4153-8001-b8670f038b48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:58:45.684908 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320ceb7d-7f79-4153-8001-b8670f038b48 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:58:45.685191 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320ceb7d-7f79-4153-8001-b8670f038b48 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:58:45.685502 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320ceb7d-7f79-4153-8001-b8670f038b48 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:58:45.686338 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320ceb7d-7f79-4153-8001-b8670f038b48 None admin] RBAC: Adding query filter params (role.id=36abe9b50fd8479c86c4f8f70fd85aa3, scope.domain.id=default, user.id=87a3e2c426774a3eba9534209ef0a44b) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 13:58:45.686654 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320ceb7d-7f79-4153-8001-b8670f038b48 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:58:45.688173 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320ceb7d-7f79-4153-8001-b8670f038b48 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:58:45.695356 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 11/20] 10.222.0.36 () {56 vars in 1322 bytes} [Tue May 3 13:58:45 2022] GET /identity/v3/role_assignments?user.id=87a3e2c426774a3eba9534209ef0a44b&scope.domain.id=default&role.id=36abe9b50fd8479c86c4f8f70fd85aa3 => generated 233 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 13:58:45.699036 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d529ad7-27bb-49f3-8617-e2cd06c42393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:58:45.699709 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d529ad7-27bb-49f3-8617-e2cd06c42393 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:58:45.699992 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d529ad7-27bb-49f3-8617-e2cd06c42393 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:58:45.700268 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d529ad7-27bb-49f3-8617-e2cd06c42393 None admin] PATH_INFO: `/v3/domains` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:58:45.700995 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d529ad7-27bb-49f3-8617-e2cd06c42393 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80012) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 13:58:45.701319 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d529ad7-27bb-49f3-8617-e2cd06c42393 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:58:45.702741 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d529ad7-27bb-49f3-8617-e2cd06c42393 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:58:45.722948 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 10/21] 10.222.0.36 () {56 vars in 1109 bytes} [Tue May 3 13:58:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 13:58:48.429797 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71571ffa-6b05-4a58-9469-a45be6803dab None None] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:58:48.430288 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71571ffa-6b05-4a58-9469-a45be6803dab None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:58:48.430288 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71571ffa-6b05-4a58-9469-a45be6803dab None None] PATH_INFO: `/` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:58:48.431647 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 12/22] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 3 13:58:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 13:58:48.443864 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a0eba5-9263-499d-b4fa-24ee67b77dfd None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:58:48.444349 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a0eba5-9263-499d-b4fa-24ee67b77dfd None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:58:48.444422 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a0eba5-9263-499d-b4fa-24ee67b77dfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:58:48.465807 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-f2a0eba5-9263-499d-b4fa-24ee67b77dfd None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 13:58:48.467009 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-f2a0eba5-9263-499d-b4fa-24ee67b77dfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 13:58:48.561401 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 11/23] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 3 13:58:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 13:58:48.588343 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71571ffa-6b05-4a58-9469-a45be6803dab None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:58:48.719566 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71571ffa-6b05-4a58-9469-a45be6803dab None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:58:48.762987 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2b76a5-e4f3-4675-b714-da4d7edeb775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:58:48.763805 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2b76a5-e4f3-4675-b714-da4d7edeb775 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:58:48.764089 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2b76a5-e4f3-4675-b714-da4d7edeb775 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:58:48.764374 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2b76a5-e4f3-4675-b714-da4d7edeb775 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:58:48.775994 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2b76a5-e4f3-4675-b714-da4d7edeb775 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:58:48.777053 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e73b75f-f800-4957-8239-a42a557e302e None None] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:58:48.777358 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e73b75f-f800-4957-8239-a42a557e302e None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:58:48.777635 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e73b75f-f800-4957-8239-a42a557e302e None None] PATH_INFO: `/` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:58:48.777741 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2b76a5-e4f3-4675-b714-da4d7edeb775 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:58:48.780030 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 12/24] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 3 13:58:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 13:58:48.785037 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354ed779-5f5d-4eb7-9268-63af5abeeb38 None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:58:48.785341 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354ed779-5f5d-4eb7-9268-63af5abeeb38 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:58:48.785627 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354ed779-5f5d-4eb7-9268-63af5abeeb38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:58:48.805011 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application [None req-5b2b76a5-e4f3-4675-b714-da4d7edeb775 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 13:58:48.805011 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 13:58:48.805011 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 13:58:48.805011 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 13:58:48.805011 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 13:58:48.805011 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 13:58:48.805011 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 13:58:48.805011 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 13:58:48.805011 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 13:58:48.805011 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 13:58:48.805011 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 13:58:48.805011 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 13:58:48.805011 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 13:58:48.805011 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 13:58:48.805011 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 13:58:48.805949 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 13:58:48.805949 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 13:58:48.805949 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 13:58:48.805949 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 13:58:48.805949 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 13:58:48.805949 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 13:58:48.805949 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.get_or_create( May 03 13:58:48.805949 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 13:58:48.805949 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application with Lock( May 03 13:58:48.805949 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 13:58:48.805949 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._enter() May 03 13:58:48.805949 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 13:58:48.805949 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 13:58:48.805949 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 13:58:48.805949 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.creator() May 03 13:58:48.805949 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 13:58:48.805949 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application created_value = creator( May 03 13:58:48.807383 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 13:58:48.807383 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 13:58:48.807383 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 13:58:48.807383 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application May 03 13:58:48.807383 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 13/25] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 3 13:58:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 13:58:48.811465 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-354ed779-5f5d-4eb7-9268-63af5abeeb38 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 13:58:48.813084 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-354ed779-5f5d-4eb7-9268-63af5abeeb38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 13:58:48.813988 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2b76a5-e4f3-4675-b714-da4d7edeb775 None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:58:48.937898 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 13/26] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 3 13:58:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 13:58:48.939695 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7c088d-f6cc-4c22-94dc-b17f08af4c8d None None] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:58:48.942441 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7c088d-f6cc-4c22-94dc-b17f08af4c8d None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:58:48.942965 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7c088d-f6cc-4c22-94dc-b17f08af4c8d None None] PATH_INFO: `/` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:58:48.946335 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 14/27] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 3 13:58:48 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 13:58:48.950991 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aca41df-d776-4a8f-b99b-6d9cad426c6d None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:58:48.951516 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aca41df-d776-4a8f-b99b-6d9cad426c6d None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:58:48.952002 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aca41df-d776-4a8f-b99b-6d9cad426c6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:58:48.978366 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-5aca41df-d776-4a8f-b99b-6d9cad426c6d None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 13:58:48.980498 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-5aca41df-d776-4a8f-b99b-6d9cad426c6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 13:58:48.988371 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2b76a5-e4f3-4675-b714-da4d7edeb775 None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:58:49.058574 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e742983-8457-4b9d-9bc1-61f5676c68a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:58:49.059637 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e742983-8457-4b9d-9bc1-61f5676c68a3 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:58:49.060114 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e742983-8457-4b9d-9bc1-61f5676c68a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:58:49.065601 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e742983-8457-4b9d-9bc1-61f5676c68a3 None admin] PATH_INFO: `/v3/domains` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:58:49.066586 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e742983-8457-4b9d-9bc1-61f5676c68a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 13:58:49.067105 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e742983-8457-4b9d-9bc1-61f5676c68a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:58:49.068877 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e742983-8457-4b9d-9bc1-61f5676c68a3 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:58:49.073323 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 15/28] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 3 13:58:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 03 13:58:49.073323 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aca41df-d776-4a8f-b99b-6d9cad426c6d None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:58:49.100441 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 14/29] 10.222.0.36 () {56 vars in 1109 bytes} [Tue May 3 13:58:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 13:58:49.106273 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e742983-8457-4b9d-9bc1-61f5676c68a3 None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:58:49.177073 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aca41df-d776-4a8f-b99b-6d9cad426c6d None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:58:49.210714 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47013d6-1c40-4ed4-b177-ae04cf3c12ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:58:49.211718 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47013d6-1c40-4ed4-b177-ae04cf3c12ec None admin] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:58:49.212198 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47013d6-1c40-4ed4-b177-ae04cf3c12ec None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:58:49.212694 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47013d6-1c40-4ed4-b177-ae04cf3c12ec None admin] PATH_INFO: `/v3/roles` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:58:49.213682 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47013d6-1c40-4ed4-b177-ae04cf3c12ec None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:58:49.215584 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47013d6-1c40-4ed4-b177-ae04cf3c12ec None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:58:49.232102 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e742983-8457-4b9d-9bc1-61f5676c68a3 None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:58:49.273282 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88669d5-1701-422c-9a10-52e6f414c210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:58:49.274062 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88669d5-1701-422c-9a10-52e6f414c210 None admin] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:58:49.274343 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88669d5-1701-422c-9a10-52e6f414c210 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:58:49.274619 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88669d5-1701-422c-9a10-52e6f414c210 None admin] PATH_INFO: `/v3/projects` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:58:49.275346 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88669d5-1701-422c-9a10-52e6f414c210 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:58:49.276838 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88669d5-1701-422c-9a10-52e6f414c210 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:58:49.358088 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 16/30] 10.222.0.36 () {60 vars in 1131 bytes} [Tue May 3 13:58:49 2022] POST /identity/v3/roles => generated 219 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 13:58:49.359640 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47013d6-1c40-4ed4-b177-ae04cf3c12ec None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:58:49.438878 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 15/31] 10.222.0.36 () {60 vars in 1141 bytes} [Tue May 3 13:58:49 2022] POST /identity/v3/projects => generated 301 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 13:58:49.441183 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdd3c79-e796-4339-bbcd-f848f0748fb2 None None] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:58:49.441713 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdd3c79-e796-4339-bbcd-f848f0748fb2 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:58:49.442215 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdd3c79-e796-4339-bbcd-f848f0748fb2 None None] PATH_INFO: `/` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:58:49.444309 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 16/32] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 3 13:58:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 13:58:49.451269 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cc39d2-dec6-481b-878f-c5527e1a540a None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:58:49.451903 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cc39d2-dec6-481b-878f-c5527e1a540a None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:58:49.452379 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cc39d2-dec6-481b-878f-c5527e1a540a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:58:49.481882 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-41cc39d2-dec6-481b-878f-c5527e1a540a None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 13:58:49.484343 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-41cc39d2-dec6-481b-878f-c5527e1a540a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 13:58:49.570384 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 17/33] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 3 13:58:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 13:58:49.572352 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19a5a13-1f8d-4cec-a2e2-3fbc31a4ad10 None None] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:58:49.572810 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19a5a13-1f8d-4cec-a2e2-3fbc31a4ad10 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:58:49.573433 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19a5a13-1f8d-4cec-a2e2-3fbc31a4ad10 None None] PATH_INFO: `/` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:58:49.575302 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 18/34] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 3 13:58:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 13:58:49.587100 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff00c14a-c842-40d3-b9fc-596a60c297a0 None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:58:49.587664 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff00c14a-c842-40d3-b9fc-596a60c297a0 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:58:49.587968 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47013d6-1c40-4ed4-b177-ae04cf3c12ec None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:58:49.588431 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff00c14a-c842-40d3-b9fc-596a60c297a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:58:49.615461 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-ff00c14a-c842-40d3-b9fc-596a60c297a0 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 13:58:49.616908 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-ff00c14a-c842-40d3-b9fc-596a60c297a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 13:58:49.661141 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e668a55a-0756-445b-9bc0-f6e6d2fb5347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:58:49.661874 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e668a55a-0756-445b-9bc0-f6e6d2fb5347 None admin] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:58:49.662158 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e668a55a-0756-445b-9bc0-f6e6d2fb5347 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:58:49.662434 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e668a55a-0756-445b-9bc0-f6e6d2fb5347 None admin] PATH_INFO: `/v3/roles` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:58:49.663197 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e668a55a-0756-445b-9bc0-f6e6d2fb5347 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:58:49.664735 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e668a55a-0756-445b-9bc0-f6e6d2fb5347 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:58:49.684010 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 17/35] 10.222.0.36 () {60 vars in 1131 bytes} [Tue May 3 13:58:49 2022] POST /identity/v3/roles => generated 225 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 13:58:49.684972 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e668a55a-0756-445b-9bc0-f6e6d2fb5347 None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:58:49.700819 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 19/36] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 3 13:58:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 13:58:49.725620 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff00c14a-c842-40d3-b9fc-596a60c297a0 None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:58:49.819184 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e668a55a-0756-445b-9bc0-f6e6d2fb5347 None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:58:49.833932 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff00c14a-c842-40d3-b9fc-596a60c297a0 None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:58:49.866093 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e28b7b-c519-4ac4-b33e-30c59072b92c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:58:49.867607 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e28b7b-c519-4ac4-b33e-30c59072b92c None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:58:49.868422 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e28b7b-c519-4ac4-b33e-30c59072b92c None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:58:49.868906 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e28b7b-c519-4ac4-b33e-30c59072b92c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:58:49.876328 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648f57ac-63e6-46d9-86d4-e50dda57cdbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:58:49.877018 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648f57ac-63e6-46d9-86d4-e50dda57cdbf None admin] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:58:49.877892 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648f57ac-63e6-46d9-86d4-e50dda57cdbf None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:58:49.878183 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648f57ac-63e6-46d9-86d4-e50dda57cdbf None admin] PATH_INFO: `/v3/roles` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:58:49.878954 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648f57ac-63e6-46d9-86d4-e50dda57cdbf None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:58:49.880495 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648f57ac-63e6-46d9-86d4-e50dda57cdbf None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:58:49.887908 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e28b7b-c519-4ac4-b33e-30c59072b92c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 13:58:49.897731 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 20/37] 10.222.0.36 () {60 vars in 1131 bytes} [Tue May 3 13:58:49 2022] POST /identity/v3/roles => generated 223 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 13:58:49.898102 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application [None req-64e28b7b-c519-4ac4-b33e-30c59072b92c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 03 13:58:49.898102 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 13:58:49.898102 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 13:58:49.898102 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 13:58:49.898102 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 13:58:49.898102 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 13:58:49.898102 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 13:58:49.898102 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 13:58:49.898102 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 13:58:49.898102 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 13:58:49.898102 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 13:58:49.898102 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 13:58:49.898102 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 13:58:49.898102 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 13:58:49.898102 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 13:58:49.898102 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 13:58:49.898938 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 13:58:49.898938 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 13:58:49.898938 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 13:58:49.898938 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 13:58:49.898938 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 13:58:49.898938 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 13:58:49.898938 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 13:58:49.898938 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 13:58:49.898938 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 13:58:49.898938 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.get_or_create( May 03 13:58:49.898938 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 13:58:49.898938 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application with Lock( May 03 13:58:49.898938 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 13:58:49.898938 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._enter() May 03 13:58:49.898938 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 13:58:49.898938 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 13:58:49.899714 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 13:58:49.899714 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.creator() May 03 13:58:49.899714 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 13:58:49.899714 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application created_value = creator( May 03 13:58:49.899714 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 13:58:49.899714 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 13:58:49.899714 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 13:58:49.899714 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 13:58:49.899714 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 13:58:49.899714 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 13:58:49.899714 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 03 13:58:49.899714 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application May 03 13:58:49.904429 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 18/38] 10.222.0.36 () {56 vars in 1096 bytes} [Tue May 3 13:58:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 13:58:49.905964 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648f57ac-63e6-46d9-86d4-e50dda57cdbf None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:58:50.023380 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648f57ac-63e6-46d9-86d4-e50dda57cdbf None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:58:50.064989 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1593206-1c87-47d1-85ff-681292e2d78c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:58:50.066168 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1593206-1c87-47d1-85ff-681292e2d78c None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:58:50.066349 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1593206-1c87-47d1-85ff-681292e2d78c None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:58:50.066621 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1593206-1c87-47d1-85ff-681292e2d78c None admin] PATH_INFO: `/v3/roles` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:58:50.067394 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1593206-1c87-47d1-85ff-681292e2d78c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 13:58:50.067765 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1593206-1c87-47d1-85ff-681292e2d78c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:58:50.069255 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1593206-1c87-47d1-85ff-681292e2d78c None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:58:50.079280 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 21/39] 10.222.0.36 () {56 vars in 1099 bytes} [Tue May 3 13:58:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 13:58:50.084727 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e28b7b-c519-4ac4-b33e-30c59072b92c None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:58:50.184905 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e28b7b-c519-4ac4-b33e-30c59072b92c None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:58:50.206566 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0506e73f-1583-4db1-b553-3474999414bd None None] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:58:50.206866 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0506e73f-1583-4db1-b553-3474999414bd None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:58:50.207148 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0506e73f-1583-4db1-b553-3474999414bd None None] PATH_INFO: `/` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:58:50.208523 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 22/40] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 3 13:58:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 13:58:50.213342 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755cdbc1-898e-4d4a-88bb-077f98d9497f None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:58:50.213719 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755cdbc1-898e-4d4a-88bb-077f98d9497f None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:58:50.214097 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755cdbc1-898e-4d4a-88bb-077f98d9497f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:58:50.216466 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb45438-c20e-4832-a4da-bcf1d7f3580a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:58:50.217365 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb45438-c20e-4832-a4da-bcf1d7f3580a None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:58:50.217640 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb45438-c20e-4832-a4da-bcf1d7f3580a None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:58:50.217907 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb45438-c20e-4832-a4da-bcf1d7f3580a None admin] PATH_INFO: `/v3/users/87a3e2c426774a3eba9534209ef0a44b` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:58:50.219529 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb45438-c20e-4832-a4da-bcf1d7f3580a None admin] RBAC: Authorizing `identity:get_user(user_id=87a3e2c426774a3eba9534209ef0a44b)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:58:50.220986 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb45438-c20e-4832-a4da-bcf1d7f3580a None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:58:50.222643 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 19/41] 10.222.0.36 () {56 vars in 1177 bytes} [Tue May 3 13:58:50 2022] GET /identity/v3/users/87a3e2c426774a3eba9534209ef0a44b => generated 247 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 13:58:50.228056 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb45438-c20e-4832-a4da-bcf1d7f3580a None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:58:50.230755 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-755cdbc1-898e-4d4a-88bb-077f98d9497f None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 13:58:50.231945 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-755cdbc1-898e-4d4a-88bb-077f98d9497f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 13:58:50.296382 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 23/42] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 3 13:58:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 03 13:58:50.319472 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755cdbc1-898e-4d4a-88bb-077f98d9497f None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:58:50.321314 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb45438-c20e-4832-a4da-bcf1d7f3580a None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:58:50.353235 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee3ecc8-fbb4-45eb-a3ed-fa9b7525e1ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:58:50.354055 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee3ecc8-fbb4-45eb-a3ed-fa9b7525e1ce None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:58:50.354340 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee3ecc8-fbb4-45eb-a3ed-fa9b7525e1ce None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:58:50.354617 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee3ecc8-fbb4-45eb-a3ed-fa9b7525e1ce None admin] PATH_INFO: `/v3/domains/default` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:58:50.355893 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee3ecc8-fbb4-45eb-a3ed-fa9b7525e1ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:58:50.357360 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee3ecc8-fbb4-45eb-a3ed-fa9b7525e1ce None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:58:50.358980 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 20/43] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 3 13:58:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 13:58:50.364562 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee3ecc8-fbb4-45eb-a3ed-fa9b7525e1ce None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:58:50.416401 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755cdbc1-898e-4d4a-88bb-077f98d9497f None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:58:50.449715 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5f9465-b292-410f-9da0-e1ca66324093 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:58:50.450510 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5f9465-b292-410f-9da0-e1ca66324093 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:58:50.450790 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5f9465-b292-410f-9da0-e1ca66324093 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:58:50.451066 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5f9465-b292-410f-9da0-e1ca66324093 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:58:50.452258 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5f9465-b292-410f-9da0-e1ca66324093 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:58:50.453953 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5f9465-b292-410f-9da0-e1ca66324093 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:58:50.455574 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 24/44] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 3 13:58:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 13:58:50.460944 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee3ecc8-fbb4-45eb-a3ed-fa9b7525e1ce None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:58:50.461084 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5f9465-b292-410f-9da0-e1ca66324093 None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:58:50.494533 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef10787e-12fb-47fc-b5ae-cd42b2e18d4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:58:50.495394 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef10787e-12fb-47fc-b5ae-cd42b2e18d4a None admin] REQUEST_METHOD: `PUT` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:58:50.495678 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef10787e-12fb-47fc-b5ae-cd42b2e18d4a None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:58:50.495966 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef10787e-12fb-47fc-b5ae-cd42b2e18d4a None admin] PATH_INFO: `/v3/domains/default/users/87a3e2c426774a3eba9534209ef0a44b/roles/36abe9b50fd8479c86c4f8f70fd85aa3` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:58:50.498120 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef10787e-12fb-47fc-b5ae-cd42b2e18d4a None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=87a3e2c426774a3eba9534209ef0a44b, role_id=36abe9b50fd8479c86c4f8f70fd85aa3)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:58:50.499602 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef10787e-12fb-47fc-b5ae-cd42b2e18d4a None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:58:50.515303 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 21/45] 10.222.0.36 () {58 vars in 1361 bytes} [Tue May 3 13:58:50 2022] PUT /identity/v3/domains/default/users/87a3e2c426774a3eba9534209ef0a44b/roles/36abe9b50fd8479c86c4f8f70fd85aa3 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 13:58:50.559196 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5f9465-b292-410f-9da0-e1ca66324093 None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:58:50.595496 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ff296c-1914-4c63-9761-80f61f0eb876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:58:50.596077 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ff296c-1914-4c63-9761-80f61f0eb876 None admin] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:58:50.596365 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ff296c-1914-4c63-9761-80f61f0eb876 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:58:50.596641 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ff296c-1914-4c63-9761-80f61f0eb876 None admin] PATH_INFO: `/v3/projects` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:58:50.597417 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ff296c-1914-4c63-9761-80f61f0eb876 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:58:50.598912 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ff296c-1914-4c63-9761-80f61f0eb876 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:58:50.627816 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 25/46] 10.222.0.36 () {60 vars in 1141 bytes} [Tue May 3 13:58:50 2022] POST /identity/v3/projects => generated 312 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 13:58:52.722388 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7501a806-b32d-4fc3-9bac-5b5d476e4336 None None] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:58:52.722916 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7501a806-b32d-4fc3-9bac-5b5d476e4336 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:58:52.722916 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7501a806-b32d-4fc3-9bac-5b5d476e4336 None None] PATH_INFO: `/` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:58:52.724298 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 22/47] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 3 13:58:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 13:58:52.729764 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717cf4a0-0439-4ba8-9673-b09cb93f9929 None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:58:52.730192 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717cf4a0-0439-4ba8-9673-b09cb93f9929 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:58:52.730464 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717cf4a0-0439-4ba8-9673-b09cb93f9929 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:58:52.747402 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-717cf4a0-0439-4ba8-9673-b09cb93f9929 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 13:58:52.748567 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-717cf4a0-0439-4ba8-9673-b09cb93f9929 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 13:58:52.814137 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 26/48] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 3 13:58:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 03 13:58:52.836726 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7501a806-b32d-4fc3-9bac-5b5d476e4336 None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:58:52.875174 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed719e3-3503-4aa1-99c3-6d5cf934e4c7 None None] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:58:52.875445 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed719e3-3503-4aa1-99c3-6d5cf934e4c7 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:58:52.875742 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed719e3-3503-4aa1-99c3-6d5cf934e4c7 None None] PATH_INFO: `/` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:58:52.877096 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 27/49] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 3 13:58:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 13:58:52.882049 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b45befc-7a43-4ee5-9ad7-bd6fef874a82 None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:58:52.882336 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b45befc-7a43-4ee5-9ad7-bd6fef874a82 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:58:52.882678 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b45befc-7a43-4ee5-9ad7-bd6fef874a82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:58:52.898839 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-3b45befc-7a43-4ee5-9ad7-bd6fef874a82 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 13:58:52.899996 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-3b45befc-7a43-4ee5-9ad7-bd6fef874a82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 13:58:52.940942 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7501a806-b32d-4fc3-9bac-5b5d476e4336 None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:58:52.962863 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 28/50] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 3 13:58:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 03 13:58:52.974646 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b43e0f-3170-417f-9c8e-ff931287ef1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:58:52.975390 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b43e0f-3170-417f-9c8e-ff931287ef1e None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:58:52.975676 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b43e0f-3170-417f-9c8e-ff931287ef1e None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:58:52.975956 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b43e0f-3170-417f-9c8e-ff931287ef1e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:58:52.985945 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b43e0f-3170-417f-9c8e-ff931287ef1e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 13:58:52.986086 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b45befc-7a43-4ee5-9ad7-bd6fef874a82 None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:58:52.993635 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application [None req-e9b43e0f-3170-417f-9c8e-ff931287ef1e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 03 13:58:52.993635 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 13:58:52.993635 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 13:58:52.993635 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 13:58:52.993635 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 13:58:52.993635 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 13:58:52.993635 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 13:58:52.993635 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 13:58:52.993635 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 13:58:52.993635 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 13:58:52.993635 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 13:58:52.993635 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 13:58:52.993635 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 13:58:52.993635 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 13:58:52.993635 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 13:58:52.993635 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 13:58:52.994608 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 13:58:52.994608 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 13:58:52.994608 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 13:58:52.994608 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 13:58:52.994608 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 13:58:52.994608 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 13:58:52.994608 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 13:58:52.994608 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 13:58:52.994608 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 13:58:52.994608 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.get_or_create( May 03 13:58:52.994608 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 13:58:52.994608 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application with Lock( May 03 13:58:52.994608 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 13:58:52.994608 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._enter() May 03 13:58:52.994608 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 13:58:52.994608 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 13:58:52.995390 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 13:58:52.995390 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.creator() May 03 13:58:52.995390 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 13:58:52.995390 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application created_value = creator( May 03 13:58:52.995390 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 13:58:52.995390 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 13:58:52.995390 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 13:58:52.995390 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 13:58:52.995390 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 13:58:52.995390 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 13:58:52.995390 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 03 13:58:52.995390 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application May 03 13:58:52.995390 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 23/51] 10.222.0.36 () {56 vars in 1096 bytes} [Tue May 3 13:58:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 13:58:53.000772 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b43e0f-3170-417f-9c8e-ff931287ef1e None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:58:53.080877 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b45befc-7a43-4ee5-9ad7-bd6fef874a82 None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:58:53.101998 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b43e0f-3170-417f-9c8e-ff931287ef1e None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:58:53.119225 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d96d1e-4cda-4a23-884d-d78ca7a070d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:58:53.120485 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d96d1e-4cda-4a23-884d-d78ca7a070d7 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:58:53.120787 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d96d1e-4cda-4a23-884d-d78ca7a070d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:58:53.121214 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d96d1e-4cda-4a23-884d-d78ca7a070d7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:58:53.122821 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d96d1e-4cda-4a23-884d-d78ca7a070d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:58:53.124878 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d96d1e-4cda-4a23-884d-d78ca7a070d7 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:58:53.127421 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 29/52] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 3 13:58:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 13:58:53.134488 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d96d1e-4cda-4a23-884d-d78ca7a070d7 None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:58:53.139242 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277e96fc-b3d6-431a-b090-a9806a196320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:58:53.139911 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277e96fc-b3d6-431a-b090-a9806a196320 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:58:53.140288 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277e96fc-b3d6-431a-b090-a9806a196320 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:58:53.140697 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277e96fc-b3d6-431a-b090-a9806a196320 None admin] PATH_INFO: `/v3/roles` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:58:53.141490 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277e96fc-b3d6-431a-b090-a9806a196320 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80012) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 13:58:53.141798 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277e96fc-b3d6-431a-b090-a9806a196320 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:58:53.143197 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277e96fc-b3d6-431a-b090-a9806a196320 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:58:53.154513 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 24/53] 10.222.0.36 () {56 vars in 1099 bytes} [Tue May 3 13:58:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 13:58:53.159885 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277e96fc-b3d6-431a-b090-a9806a196320 None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:58:53.225956 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d96d1e-4cda-4a23-884d-d78ca7a070d7 None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:58:53.254685 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277e96fc-b3d6-431a-b090-a9806a196320 None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:58:53.258770 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16453d46-c535-4de6-9db1-051af8a6cddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:58:53.259422 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16453d46-c535-4de6-9db1-051af8a6cddd None admin] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:58:53.259702 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16453d46-c535-4de6-9db1-051af8a6cddd None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:58:53.259970 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16453d46-c535-4de6-9db1-051af8a6cddd None admin] PATH_INFO: `/v3/projects` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:58:53.260669 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16453d46-c535-4de6-9db1-051af8a6cddd None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:58:53.262134 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16453d46-c535-4de6-9db1-051af8a6cddd None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:58:53.287417 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3591dbb3-99ca-41c1-85f6-f1706e97883e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:58:53.288304 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3591dbb3-99ca-41c1-85f6-f1706e97883e None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:58:53.288584 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3591dbb3-99ca-41c1-85f6-f1706e97883e None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:58:53.288859 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3591dbb3-99ca-41c1-85f6-f1706e97883e None admin] PATH_INFO: `/v3/users/87a3e2c426774a3eba9534209ef0a44b` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:58:53.290081 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3591dbb3-99ca-41c1-85f6-f1706e97883e None admin] RBAC: Authorizing `identity:get_user(user_id=87a3e2c426774a3eba9534209ef0a44b)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:58:53.290833 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 30/54] 10.222.0.36 () {60 vars in 1140 bytes} [Tue May 3 13:58:53 2022] POST /identity/v3/projects => generated 298 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 13:58:53.296796 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3591dbb3-99ca-41c1-85f6-f1706e97883e None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:58:53.296796 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 25/55] 10.222.0.36 () {56 vars in 1177 bytes} [Tue May 3 13:58:53 2022] GET /identity/v3/users/87a3e2c426774a3eba9534209ef0a44b => generated 247 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 13:58:53.299012 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16453d46-c535-4de6-9db1-051af8a6cddd None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:58:53.402869 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16453d46-c535-4de6-9db1-051af8a6cddd None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:58:53.438575 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb0e5c2-e935-4c00-afbb-d8e2f882819a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:58:53.439367 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb0e5c2-e935-4c00-afbb-d8e2f882819a None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:58:53.439645 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb0e5c2-e935-4c00-afbb-d8e2f882819a None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:58:53.439918 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb0e5c2-e935-4c00-afbb-d8e2f882819a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:58:53.441176 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb0e5c2-e935-4c00-afbb-d8e2f882819a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:58:53.442685 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb0e5c2-e935-4c00-afbb-d8e2f882819a None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:58:53.444489 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 31/56] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 3 13:58:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 13:58:53.450620 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3591dbb3-99ca-41c1-85f6-f1706e97883e None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:58:53.547995 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3591dbb3-99ca-41c1-85f6-f1706e97883e None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:58:53.580183 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81acaa54-d2fc-467d-9220-8c7a89b96563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:58:53.580834 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81acaa54-d2fc-467d-9220-8c7a89b96563 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:58:53.581110 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81acaa54-d2fc-467d-9220-8c7a89b96563 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:58:53.581411 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81acaa54-d2fc-467d-9220-8c7a89b96563 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:58:53.582237 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81acaa54-d2fc-467d-9220-8c7a89b96563 None admin] RBAC: Adding query filter params (role.id=36abe9b50fd8479c86c4f8f70fd85aa3, scope.domain.id=default, user.id=87a3e2c426774a3eba9534209ef0a44b) {{(pid=80012) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 13:58:53.582544 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81acaa54-d2fc-467d-9220-8c7a89b96563 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:58:53.583994 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81acaa54-d2fc-467d-9220-8c7a89b96563 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:58:53.592336 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 26/57] 10.222.0.36 () {56 vars in 1322 bytes} [Tue May 3 13:58:53 2022] GET /identity/v3/role_assignments?user.id=87a3e2c426774a3eba9534209ef0a44b&scope.domain.id=default&role.id=36abe9b50fd8479c86c4f8f70fd85aa3 => generated 530 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 13:58:55.539578 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b622b49-adfe-4776-bf29-f72f3c3f7c80 None None] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:58:55.540397 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b622b49-adfe-4776-bf29-f72f3c3f7c80 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:58:55.540509 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b622b49-adfe-4776-bf29-f72f3c3f7c80 None None] PATH_INFO: `/` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:58:55.542675 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 32/58] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 3 13:58:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 13:58:55.548835 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a5787b-d6ad-4094-93a3-11231ebdb8c8 None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:58:55.549260 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a5787b-d6ad-4094-93a3-11231ebdb8c8 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:58:55.549468 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a5787b-d6ad-4094-93a3-11231ebdb8c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:58:55.571729 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-91a5787b-d6ad-4094-93a3-11231ebdb8c8 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 13:58:55.573222 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-91a5787b-d6ad-4094-93a3-11231ebdb8c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 13:58:55.640940 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 27/59] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 3 13:58:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 13:58:55.665322 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b622b49-adfe-4776-bf29-f72f3c3f7c80 None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:58:55.777883 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b622b49-adfe-4776-bf29-f72f3c3f7c80 None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:58:55.811518 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49045301-dc2f-4f8b-9635-7d15ca5a5ace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:58:55.812251 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49045301-dc2f-4f8b-9635-7d15ca5a5ace None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:58:55.812537 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49045301-dc2f-4f8b-9635-7d15ca5a5ace None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:58:55.812810 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49045301-dc2f-4f8b-9635-7d15ca5a5ace None admin] PATH_INFO: `/v3/domains/default` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:58:55.814101 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49045301-dc2f-4f8b-9635-7d15ca5a5ace None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:58:55.815554 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49045301-dc2f-4f8b-9635-7d15ca5a5ace None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:58:55.817185 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 33/60] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 3 13:58:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 13:58:55.823079 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a5787b-d6ad-4094-93a3-11231ebdb8c8 None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:58:55.922905 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a5787b-d6ad-4094-93a3-11231ebdb8c8 None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:58:55.957396 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a3185c-0d37-4cf1-8b5d-e1a6e6d998b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:58:55.958062 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a3185c-0d37-4cf1-8b5d-e1a6e6d998b1 None admin] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:58:55.958343 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a3185c-0d37-4cf1-8b5d-e1a6e6d998b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:58:55.958621 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a3185c-0d37-4cf1-8b5d-e1a6e6d998b1 None admin] PATH_INFO: `/v3/users` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:58:55.959339 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a3185c-0d37-4cf1-8b5d-e1a6e6d998b1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:58:55.960801 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a3185c-0d37-4cf1-8b5d-e1a6e6d998b1 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:58:55.990718 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 28/61] 10.222.0.36 () {60 vars in 1132 bytes} [Tue May 3 13:58:55 2022] POST /identity/v3/users => generated 275 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 13:58:59.388099 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5975a91-2dc6-43d5-9ffa-4abba5e6d25e None None] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:58:59.388099 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5975a91-2dc6-43d5-9ffa-4abba5e6d25e None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:58:59.388099 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5975a91-2dc6-43d5-9ffa-4abba5e6d25e None None] PATH_INFO: `/` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:58:59.389241 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 34/62] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 3 13:58:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 13:58:59.395374 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b91530e-917d-498a-a2a2-128893ce4438 None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:58:59.396244 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b91530e-917d-498a-a2a2-128893ce4438 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:58:59.396724 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b91530e-917d-498a-a2a2-128893ce4438 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:58:59.418327 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-7b91530e-917d-498a-a2a2-128893ce4438 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 13:58:59.419525 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-7b91530e-917d-498a-a2a2-128893ce4438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 13:58:59.508032 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 29/63] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 3 13:58:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 13:58:59.535137 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3dd57b-5b60-4e68-9603-dbdd5574526e None None] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:58:59.535803 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3dd57b-5b60-4e68-9603-dbdd5574526e None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:58:59.536308 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3dd57b-5b60-4e68-9603-dbdd5574526e None None] PATH_INFO: `/` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:58:59.538052 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 35/64] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 3 13:58:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 13:58:59.542739 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b91530e-917d-498a-a2a2-128893ce4438 None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:58:59.546796 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d8d1bc-f9b5-405d-8160-4e59b8c72381 None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:58:59.547326 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d8d1bc-f9b5-405d-8160-4e59b8c72381 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:58:59.547797 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d8d1bc-f9b5-405d-8160-4e59b8c72381 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:58:59.574256 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-d9d8d1bc-f9b5-405d-8160-4e59b8c72381 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 13:58:59.575759 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-d9d8d1bc-f9b5-405d-8160-4e59b8c72381 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 13:58:59.659162 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b91530e-917d-498a-a2a2-128893ce4438 None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:58:59.703145 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedd2d6f-617c-4ef9-981a-d60b9e2ab981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:58:59.704304 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedd2d6f-617c-4ef9-981a-d60b9e2ab981 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:58:59.704756 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedd2d6f-617c-4ef9-981a-d60b9e2ab981 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:58:59.705195 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedd2d6f-617c-4ef9-981a-d60b9e2ab981 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:58:59.723734 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedd2d6f-617c-4ef9-981a-d60b9e2ab981 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 13:58:59.732320 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application [None req-fedd2d6f-617c-4ef9-981a-d60b9e2ab981 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 03 13:58:59.732320 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 13:58:59.732320 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 13:58:59.732320 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 13:58:59.732320 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 13:58:59.732320 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 13:58:59.732320 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 13:58:59.732320 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 13:58:59.732320 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 13:58:59.732320 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 13:58:59.732320 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 13:58:59.732320 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 13:58:59.732320 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 13:58:59.732320 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 13:58:59.732320 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 13:58:59.732320 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 13:58:59.733208 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 13:58:59.733208 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 13:58:59.733208 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 13:58:59.733208 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 13:58:59.733208 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 13:58:59.733208 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 13:58:59.733208 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 13:58:59.733208 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 13:58:59.733208 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 13:58:59.733208 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.get_or_create( May 03 13:58:59.733208 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 13:58:59.733208 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application with Lock( May 03 13:58:59.733208 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 13:58:59.733208 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._enter() May 03 13:58:59.733208 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 13:58:59.733208 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 13:58:59.734179 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 13:58:59.734179 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.creator() May 03 13:58:59.734179 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 13:58:59.734179 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application created_value = creator( May 03 13:58:59.734179 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 13:58:59.734179 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 13:58:59.734179 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 13:58:59.734179 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 13:58:59.734179 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 13:58:59.734179 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 13:58:59.734179 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 03 13:58:59.734179 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application May 03 13:58:59.736321 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 36/65] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 3 13:58:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 03 13:58:59.737793 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 30/66] 10.222.0.36 () {56 vars in 1099 bytes} [Tue May 3 13:58:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 13:58:59.748203 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d8d1bc-f9b5-405d-8160-4e59b8c72381 None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:58:59.767354 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedd2d6f-617c-4ef9-981a-d60b9e2ab981 None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:58:59.864597 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d8d1bc-f9b5-405d-8160-4e59b8c72381 None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:58:59.865243 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedd2d6f-617c-4ef9-981a-d60b9e2ab981 None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:58:59.897453 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f4a409-fb4a-42b7-9be3-0e4c7afff733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:58:59.897801 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3970b2d-0916-4e8f-bfb3-2af1d7287ffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:58:59.898252 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f4a409-fb4a-42b7-9be3-0e4c7afff733 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:58:59.898447 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3970b2d-0916-4e8f-bfb3-2af1d7287ffa None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:58:59.898540 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f4a409-fb4a-42b7-9be3-0e4c7afff733 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:58:59.898729 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3970b2d-0916-4e8f-bfb3-2af1d7287ffa None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:58:59.898829 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f4a409-fb4a-42b7-9be3-0e4c7afff733 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:58:59.899007 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3970b2d-0916-4e8f-bfb3-2af1d7287ffa None admin] PATH_INFO: `/v3/roles` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:58:59.899759 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3970b2d-0916-4e8f-bfb3-2af1d7287ffa None admin] RBAC: Adding query filter params (name=member) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 13:58:59.900070 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3970b2d-0916-4e8f-bfb3-2af1d7287ffa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:58:59.901520 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3970b2d-0916-4e8f-bfb3-2af1d7287ffa None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:58:59.908892 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f4a409-fb4a-42b7-9be3-0e4c7afff733 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 13:58:59.910943 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 37/67] 10.222.0.36 () {56 vars in 1101 bytes} [Tue May 3 13:58:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 13:58:59.912348 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983949a7-a802-40ed-875e-81f278676c95 None None] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:58:59.912780 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983949a7-a802-40ed-875e-81f278676c95 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:58:59.913214 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983949a7-a802-40ed-875e-81f278676c95 None None] PATH_INFO: `/` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:58:59.918377 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 38/68] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 3 13:58:59 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 13:58:59.918505 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application [None req-63f4a409-fb4a-42b7-9be3-0e4c7afff733 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 03 13:58:59.918505 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 13:58:59.918505 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 13:58:59.918505 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 13:58:59.918505 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 13:58:59.918505 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 13:58:59.918505 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 13:58:59.918505 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 13:58:59.918505 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 13:58:59.918505 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 13:58:59.918505 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 13:58:59.918505 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 13:58:59.918505 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 13:58:59.918505 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 13:58:59.918505 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 13:58:59.918505 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 13:58:59.919348 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 13:58:59.919348 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 13:58:59.919348 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 13:58:59.919348 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 13:58:59.919348 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 13:58:59.919348 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 13:58:59.919348 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 13:58:59.919348 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 13:58:59.919348 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 13:58:59.919348 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.get_or_create( May 03 13:58:59.919348 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 13:58:59.919348 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application with Lock( May 03 13:58:59.919348 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 13:58:59.919348 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._enter() May 03 13:58:59.919348 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 13:58:59.919348 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 13:58:59.920141 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 13:58:59.920141 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.creator() May 03 13:58:59.920141 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 13:58:59.920141 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application created_value = creator( May 03 13:58:59.920141 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 13:58:59.920141 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 13:58:59.920141 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 13:58:59.920141 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 13:58:59.920141 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 13:58:59.920141 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 13:58:59.920141 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 03 13:58:59.920141 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application May 03 13:58:59.920738 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea169d0-40f3-4553-a30b-2166497e086f None None] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:58:59.920738 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea169d0-40f3-4553-a30b-2166497e086f None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:58:59.920738 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea169d0-40f3-4553-a30b-2166497e086f None None] PATH_INFO: `/` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:58:59.920926 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 31/69] 10.222.0.36 () {56 vars in 1096 bytes} [Tue May 3 13:58:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 13:58:59.920926 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f4a409-fb4a-42b7-9be3-0e4c7afff733 None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:58:59.921050 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 39/70] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 3 13:58:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 13:58:59.925538 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fad9dd-d9ab-4606-b94d-db8f4e151c84 None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:58:59.925840 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fad9dd-d9ab-4606-b94d-db8f4e151c84 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:58:59.926100 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fad9dd-d9ab-4606-b94d-db8f4e151c84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:58:59.943929 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-f6fad9dd-d9ab-4606-b94d-db8f4e151c84 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 13:58:59.945167 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-f6fad9dd-d9ab-4606-b94d-db8f4e151c84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 13:59:00.014192 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 40/71] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 3 13:58:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 13:59:00.021444 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a4d5cb-652c-4f5f-83ad-ce2ee7ec267a None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:00.021861 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a4d5cb-652c-4f5f-83ad-ce2ee7ec267a None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:00.022145 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a4d5cb-652c-4f5f-83ad-ce2ee7ec267a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:00.032914 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f4a409-fb4a-42b7-9be3-0e4c7afff733 None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:00.039690 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-32a4d5cb-652c-4f5f-83ad-ce2ee7ec267a None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 13:59:00.040897 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-32a4d5cb-652c-4f5f-83ad-ce2ee7ec267a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 13:59:00.066076 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c4c813-ce6c-4274-8058-1ac335299d70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:00.066991 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c4c813-ce6c-4274-8058-1ac335299d70 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:00.067274 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c4c813-ce6c-4274-8058-1ac335299d70 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:00.067548 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c4c813-ce6c-4274-8058-1ac335299d70 None admin] PATH_INFO: `/v3/users/e9f93aa2136e485ab8827ada190d87ce` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:00.082627 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c4c813-ce6c-4274-8058-1ac335299d70 None admin] RBAC: Authorizing `identity:get_user(user_id=e9f93aa2136e485ab8827ada190d87ce)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:00.084094 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c4c813-ce6c-4274-8058-1ac335299d70 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:00.086012 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 32/72] 10.222.0.36 () {56 vars in 1177 bytes} [Tue May 3 13:58:59 2022] GET /identity/v3/users/e9f93aa2136e485ab8827ada190d87ce => generated 275 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 13:59:00.091304 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c4c813-ce6c-4274-8058-1ac335299d70 None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:00.116784 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 41/73] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 3 13:59:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 13:59:00.117990 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a4d5cb-652c-4f5f-83ad-ce2ee7ec267a None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:00.192186 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c4c813-ce6c-4274-8058-1ac335299d70 None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:00.209533 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a4d5cb-652c-4f5f-83ad-ce2ee7ec267a None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:00.225585 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a44f110-8328-4629-9542-bdefdeae6d3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:00.226238 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a44f110-8328-4629-9542-bdefdeae6d3e None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:00.226516 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a44f110-8328-4629-9542-bdefdeae6d3e None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:00.226792 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a44f110-8328-4629-9542-bdefdeae6d3e None admin] PATH_INFO: `/v3/roles` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:00.227538 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a44f110-8328-4629-9542-bdefdeae6d3e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80012) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 13:59:00.227848 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a44f110-8328-4629-9542-bdefdeae6d3e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:00.229239 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a44f110-8328-4629-9542-bdefdeae6d3e None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:00.237304 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 33/74] 10.222.0.36 () {56 vars in 1099 bytes} [Tue May 3 13:59:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 13:59:00.238089 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a44f110-8328-4629-9542-bdefdeae6d3e None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:00.242560 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9436862a-3894-4eba-b92b-a3a7e39289f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:00.243371 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9436862a-3894-4eba-b92b-a3a7e39289f9 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:00.243660 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9436862a-3894-4eba-b92b-a3a7e39289f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:00.243960 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9436862a-3894-4eba-b92b-a3a7e39289f9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:00.253957 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9436862a-3894-4eba-b92b-a3a7e39289f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 13:59:00.261627 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application [None req-9436862a-3894-4eba-b92b-a3a7e39289f9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 03 13:59:00.261627 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 13:59:00.261627 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 13:59:00.261627 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 13:59:00.261627 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 13:59:00.261627 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 13:59:00.261627 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 13:59:00.261627 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 13:59:00.261627 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 13:59:00.261627 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 13:59:00.261627 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 13:59:00.261627 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 13:59:00.261627 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 13:59:00.261627 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 13:59:00.261627 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 13:59:00.261627 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 13:59:00.262643 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 13:59:00.262643 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 13:59:00.262643 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 13:59:00.262643 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 13:59:00.262643 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 13:59:00.262643 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 13:59:00.262643 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 13:59:00.262643 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 13:59:00.262643 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 13:59:00.262643 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.get_or_create( May 03 13:59:00.262643 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 13:59:00.262643 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application with Lock( May 03 13:59:00.262643 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 13:59:00.262643 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._enter() May 03 13:59:00.262643 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 13:59:00.262643 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 13:59:00.263553 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 13:59:00.263553 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.creator() May 03 13:59:00.263553 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 13:59:00.263553 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application created_value = creator( May 03 13:59:00.263553 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 13:59:00.263553 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 13:59:00.263553 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 13:59:00.263553 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 13:59:00.263553 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 13:59:00.263553 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 13:59:00.263553 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 03 13:59:00.263553 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application May 03 13:59:00.263553 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 42/75] 10.222.0.36 () {56 vars in 1099 bytes} [Tue May 3 13:59:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 13:59:00.265956 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4badc40-b735-4a5b-9eb9-fd5459cc5767 None None] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:00.266233 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4badc40-b735-4a5b-9eb9-fd5459cc5767 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:00.266519 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4badc40-b735-4a5b-9eb9-fd5459cc5767 None None] PATH_INFO: `/` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:00.267833 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 43/76] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 3 13:59:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 13:59:00.269207 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4badc40-b735-4a5b-9eb9-fd5459cc5767 None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:00.337656 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a44f110-8328-4629-9542-bdefdeae6d3e None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:00.366231 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4badc40-b735-4a5b-9eb9-fd5459cc5767 None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:00.369881 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0989c158-937d-426f-b77c-7f9eec7fb112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:00.370521 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0989c158-937d-426f-b77c-7f9eec7fb112 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:00.370804 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0989c158-937d-426f-b77c-7f9eec7fb112 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:00.371074 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0989c158-937d-426f-b77c-7f9eec7fb112 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:00.397733 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12861004-1efc-4fa7-aa8d-2ed54e02395d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:00.398529 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12861004-1efc-4fa7-aa8d-2ed54e02395d None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:00.398810 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12861004-1efc-4fa7-aa8d-2ed54e02395d None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:00.399082 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12861004-1efc-4fa7-aa8d-2ed54e02395d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:00.408902 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12861004-1efc-4fa7-aa8d-2ed54e02395d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 13:59:00.416854 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application [None req-12861004-1efc-4fa7-aa8d-2ed54e02395d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 03 13:59:00.416854 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 13:59:00.416854 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 13:59:00.416854 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 13:59:00.416854 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 13:59:00.416854 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 13:59:00.416854 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 13:59:00.416854 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 13:59:00.416854 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 13:59:00.416854 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 13:59:00.416854 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 13:59:00.416854 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 13:59:00.416854 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 13:59:00.416854 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 13:59:00.416854 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 13:59:00.416854 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 13:59:00.417762 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 13:59:00.417762 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 13:59:00.417762 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 13:59:00.417762 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 13:59:00.417762 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 13:59:00.417762 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 13:59:00.417762 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 13:59:00.417762 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 13:59:00.417762 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 13:59:00.417762 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.get_or_create( May 03 13:59:00.417762 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 13:59:00.417762 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application with Lock( May 03 13:59:00.417762 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 13:59:00.417762 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._enter() May 03 13:59:00.417762 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 13:59:00.417762 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 13:59:00.418549 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 13:59:00.418549 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.creator() May 03 13:59:00.418549 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 13:59:00.418549 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application created_value = creator( May 03 13:59:00.418549 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 13:59:00.418549 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 13:59:00.418549 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 13:59:00.418549 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 13:59:00.418549 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 13:59:00.418549 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 13:59:00.418549 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 03 13:59:00.418549 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application May 03 13:59:00.418549 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 44/77] 10.222.0.36 () {56 vars in 1114 bytes} [Tue May 3 13:59:00 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 13:59:00.419279 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12861004-1efc-4fa7-aa8d-2ed54e02395d None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:00.434485 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0989c158-937d-426f-b77c-7f9eec7fb112 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:00.435941 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0989c158-937d-426f-b77c-7f9eec7fb112 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:00.517193 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12861004-1efc-4fa7-aa8d-2ed54e02395d None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:00.530457 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 34/78] 10.222.0.36 () {58 vars in 1282 bytes} [Tue May 3 13:59:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 03 13:59:00.531267 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0989c158-937d-426f-b77c-7f9eec7fb112 None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:00.551331 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deafb384-8285-4131-a1bc-18b839f856d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:00.552216 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deafb384-8285-4131-a1bc-18b839f856d8 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:00.552498 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deafb384-8285-4131-a1bc-18b839f856d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:00.552774 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deafb384-8285-4131-a1bc-18b839f856d8 None admin] PATH_INFO: `/v3/users/87a3e2c426774a3eba9534209ef0a44b` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:00.553966 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deafb384-8285-4131-a1bc-18b839f856d8 None admin] RBAC: Authorizing `identity:get_user(user_id=87a3e2c426774a3eba9534209ef0a44b)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:00.555440 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deafb384-8285-4131-a1bc-18b839f856d8 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:00.557060 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 45/79] 10.222.0.36 () {56 vars in 1177 bytes} [Tue May 3 13:59:00 2022] GET /identity/v3/users/87a3e2c426774a3eba9534209ef0a44b => generated 247 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 13:59:00.559327 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c392d0a1-4d40-40e3-bf92-74383e2d82ff None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:00.559693 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c392d0a1-4d40-40e3-bf92-74383e2d82ff None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:00.559975 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c392d0a1-4d40-40e3-bf92-74383e2d82ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:00.576284 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-c392d0a1-4d40-40e3-bf92-74383e2d82ff None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 13:59:00.577548 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-c392d0a1-4d40-40e3-bf92-74383e2d82ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 13:59:00.622589 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0989c158-937d-426f-b77c-7f9eec7fb112 None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:00.641360 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 46/80] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 3 13:59:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 13:59:00.643238 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c392d0a1-4d40-40e3-bf92-74383e2d82ff None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:00.656462 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2e942f-a0f6-402c-9e74-f09be5fc31ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:00.657126 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2e942f-a0f6-402c-9e74-f09be5fc31ee None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:00.657443 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2e942f-a0f6-402c-9e74-f09be5fc31ee None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:00.657919 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2e942f-a0f6-402c-9e74-f09be5fc31ee None admin] PATH_INFO: `/v3/roles` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:00.658461 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2e942f-a0f6-402c-9e74-f09be5fc31ee None admin] RBAC: Adding query filter params (name=member) {{(pid=80012) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 13:59:00.658770 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2e942f-a0f6-402c-9e74-f09be5fc31ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:00.660122 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2e942f-a0f6-402c-9e74-f09be5fc31ee None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:00.669353 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 35/81] 10.222.0.36 () {56 vars in 1101 bytes} [Tue May 3 13:59:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 13:59:00.669353 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2e942f-a0f6-402c-9e74-f09be5fc31ee None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:00.740221 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c392d0a1-4d40-40e3-bf92-74383e2d82ff None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:00.761407 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2e942f-a0f6-402c-9e74-f09be5fc31ee None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:00.771648 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1419e37-0f44-4538-b1be-50de6a9cf149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:00.772250 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1419e37-0f44-4538-b1be-50de6a9cf149 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:00.772533 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1419e37-0f44-4538-b1be-50de6a9cf149 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:00.772804 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1419e37-0f44-4538-b1be-50de6a9cf149 None admin] PATH_INFO: `/v3/roles` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:00.773574 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1419e37-0f44-4538-b1be-50de6a9cf149 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 13:59:00.773878 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1419e37-0f44-4538-b1be-50de6a9cf149 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:00.775260 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1419e37-0f44-4538-b1be-50de6a9cf149 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:00.787379 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 47/82] 10.222.0.36 () {56 vars in 1111 bytes} [Tue May 3 13:59:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 13:59:00.787379 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1419e37-0f44-4538-b1be-50de6a9cf149 None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:00.792866 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fac8bf-b39c-4c0f-9172-62712ed407ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:00.793768 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fac8bf-b39c-4c0f-9172-62712ed407ce None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:00.794050 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fac8bf-b39c-4c0f-9172-62712ed407ce None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:00.794327 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fac8bf-b39c-4c0f-9172-62712ed407ce None admin] PATH_INFO: `/v3/projects/3256bc7158894136b4937ecc0a8b3073` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:00.795514 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fac8bf-b39c-4c0f-9172-62712ed407ce None admin] RBAC: Authorizing `identity:get_project(project_id=3256bc7158894136b4937ecc0a8b3073)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:00.796974 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fac8bf-b39c-4c0f-9172-62712ed407ce None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:00.798709 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 36/83] 10.222.0.36 () {56 vars in 1186 bytes} [Tue May 3 13:59:00 2022] GET /identity/v3/projects/3256bc7158894136b4937ecc0a8b3073 => generated 298 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 13:59:00.799454 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fac8bf-b39c-4c0f-9172-62712ed407ce None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:00.875614 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1419e37-0f44-4538-b1be-50de6a9cf149 None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:00.891981 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fac8bf-b39c-4c0f-9172-62712ed407ce None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:00.906777 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4045c4d-99b8-4cd9-aa84-e6df1d9bd19f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:00.907422 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4045c4d-99b8-4cd9-aa84-e6df1d9bd19f None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:00.907708 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4045c4d-99b8-4cd9-aa84-e6df1d9bd19f None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:00.907970 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4045c4d-99b8-4cd9-aa84-e6df1d9bd19f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:00.923778 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239f63a1-84b6-41a7-852e-8830f738ccfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:00.924566 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239f63a1-84b6-41a7-852e-8830f738ccfd None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:00.924841 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239f63a1-84b6-41a7-852e-8830f738ccfd None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:00.925114 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239f63a1-84b6-41a7-852e-8830f738ccfd None admin] PATH_INFO: `/v3/domains/default` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:00.926340 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239f63a1-84b6-41a7-852e-8830f738ccfd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:00.927804 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239f63a1-84b6-41a7-852e-8830f738ccfd None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:00.929453 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 37/84] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 3 13:59:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 13:59:00.930206 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239f63a1-84b6-41a7-852e-8830f738ccfd None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:00.979122 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4045c4d-99b8-4cd9-aa84-e6df1d9bd19f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:00.980584 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4045c4d-99b8-4cd9-aa84-e6df1d9bd19f None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:01.021496 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239f63a1-84b6-41a7-852e-8830f738ccfd None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:01.053372 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb145aa8-8f43-4048-bbd2-b10f7443b300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:01.054198 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb145aa8-8f43-4048-bbd2-b10f7443b300 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:01.054449 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb145aa8-8f43-4048-bbd2-b10f7443b300 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:01.054720 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb145aa8-8f43-4048-bbd2-b10f7443b300 None admin] PATH_INFO: `/v3/users/e9f93aa2136e485ab8827ada190d87ce` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:01.056056 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb145aa8-8f43-4048-bbd2-b10f7443b300 None admin] RBAC: Authorizing `identity:get_user(user_id=e9f93aa2136e485ab8827ada190d87ce)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:01.057532 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb145aa8-8f43-4048-bbd2-b10f7443b300 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:01.059149 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 38/85] 10.222.0.36 () {56 vars in 1177 bytes} [Tue May 3 13:59:00 2022] GET /identity/v3/users/e9f93aa2136e485ab8827ada190d87ce => generated 275 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 13:59:01.059948 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb145aa8-8f43-4048-bbd2-b10f7443b300 None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:01.075471 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 48/86] 10.222.0.36 () {58 vars in 1282 bytes} [Tue May 3 13:59:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 03 13:59:01.076324 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4045c4d-99b8-4cd9-aa84-e6df1d9bd19f None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:01.160673 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb145aa8-8f43-4048-bbd2-b10f7443b300 None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:01.170758 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4045c4d-99b8-4cd9-aa84-e6df1d9bd19f None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:01.193202 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95d1d7b-6eda-45da-9003-9bce4595f066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:01.194117 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95d1d7b-6eda-45da-9003-9bce4595f066 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:01.194401 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95d1d7b-6eda-45da-9003-9bce4595f066 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:01.194667 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95d1d7b-6eda-45da-9003-9bce4595f066 None admin] PATH_INFO: `/v3/users/e9f93aa2136e485ab8827ada190d87ce` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:01.196005 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95d1d7b-6eda-45da-9003-9bce4595f066 None admin] RBAC: Authorizing `identity:get_user(user_id=e9f93aa2136e485ab8827ada190d87ce)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:01.197513 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95d1d7b-6eda-45da-9003-9bce4595f066 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:01.199166 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 39/87] 10.222.0.36 () {56 vars in 1177 bytes} [Tue May 3 13:59:01 2022] GET /identity/v3/users/e9f93aa2136e485ab8827ada190d87ce => generated 275 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 13:59:01.199904 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95d1d7b-6eda-45da-9003-9bce4595f066 None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:01.206230 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69355785-c304-4d45-bbeb-29fa215db15a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:01.206989 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69355785-c304-4d45-bbeb-29fa215db15a None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:01.207272 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69355785-c304-4d45-bbeb-29fa215db15a None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:01.207532 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69355785-c304-4d45-bbeb-29fa215db15a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:01.208367 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69355785-c304-4d45-bbeb-29fa215db15a None admin] RBAC: Adding query filter params (role.id=441fdc11e95b47f4813f72610e39018b, scope.project.id=3256bc7158894136b4937ecc0a8b3073, user.id=e9f93aa2136e485ab8827ada190d87ce) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 13:59:01.208677 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69355785-c304-4d45-bbeb-29fa215db15a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:01.210153 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69355785-c304-4d45-bbeb-29fa215db15a None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:01.216003 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 49/88] 10.222.0.36 () {56 vars in 1374 bytes} [Tue May 3 13:59:01 2022] GET /identity/v3/role_assignments?user.id=e9f93aa2136e485ab8827ada190d87ce&scope.project.id=3256bc7158894136b4937ecc0a8b3073&role.id=441fdc11e95b47f4813f72610e39018b => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 13:59:01.216768 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69355785-c304-4d45-bbeb-29fa215db15a None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:01.307967 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95d1d7b-6eda-45da-9003-9bce4595f066 None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:01.321732 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69355785-c304-4d45-bbeb-29fa215db15a None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:01.342164 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a54a6b-78f9-4d50-a158-3507b05f199e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:01.342845 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a54a6b-78f9-4d50-a158-3507b05f199e None admin] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:01.343158 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a54a6b-78f9-4d50-a158-3507b05f199e None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:01.343434 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a54a6b-78f9-4d50-a158-3507b05f199e None admin] PATH_INFO: `/v3/users` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:01.344284 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a54a6b-78f9-4d50-a158-3507b05f199e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:01.345790 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a54a6b-78f9-4d50-a158-3507b05f199e None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:01.355407 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3441a105-0edf-4641-a50c-5ee3755c92d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:01.356075 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3441a105-0edf-4641-a50c-5ee3755c92d5 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:01.356368 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3441a105-0edf-4641-a50c-5ee3755c92d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:01.356645 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3441a105-0edf-4641-a50c-5ee3755c92d5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:01.366250 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 40/89] 10.222.0.36 () {60 vars in 1132 bytes} [Tue May 3 13:59:01 2022] POST /identity/v3/users => generated 289 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 13:59:01.366250 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a54a6b-78f9-4d50-a158-3507b05f199e None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:01.432627 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3441a105-0edf-4641-a50c-5ee3755c92d5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:01.434197 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3441a105-0edf-4641-a50c-5ee3755c92d5 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:01.487047 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a54a6b-78f9-4d50-a158-3507b05f199e None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:01.522542 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47ac291-96e5-45fa-87df-06adec4d88f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:01.523589 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47ac291-96e5-45fa-87df-06adec4d88f5 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:01.523873 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47ac291-96e5-45fa-87df-06adec4d88f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:01.524148 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47ac291-96e5-45fa-87df-06adec4d88f5 None admin] PATH_INFO: `/v3/projects/3256bc7158894136b4937ecc0a8b3073` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:01.525435 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47ac291-96e5-45fa-87df-06adec4d88f5 None admin] RBAC: Authorizing `identity:get_project(project_id=3256bc7158894136b4937ecc0a8b3073)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:01.526920 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47ac291-96e5-45fa-87df-06adec4d88f5 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:01.529046 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 41/90] 10.222.0.36 () {56 vars in 1186 bytes} [Tue May 3 13:59:01 2022] GET /identity/v3/projects/3256bc7158894136b4937ecc0a8b3073 => generated 298 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 13:59:01.529948 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47ac291-96e5-45fa-87df-06adec4d88f5 None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:01.540857 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 50/91] 10.222.0.36 () {58 vars in 1282 bytes} [Tue May 3 13:59:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 03 13:59:01.541769 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3441a105-0edf-4641-a50c-5ee3755c92d5 None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:01.643172 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47ac291-96e5-45fa-87df-06adec4d88f5 None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:01.663535 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3441a105-0edf-4641-a50c-5ee3755c92d5 None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:01.692542 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e484396a-a0fd-4068-b405-a6c4b852cd34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:01.693674 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e484396a-a0fd-4068-b405-a6c4b852cd34 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:01.694149 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e484396a-a0fd-4068-b405-a6c4b852cd34 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:01.694611 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e484396a-a0fd-4068-b405-a6c4b852cd34 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:01.706213 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbed5800-8151-446b-ae8c-1f876f649328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:01.706913 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbed5800-8151-446b-ae8c-1f876f649328 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:01.707195 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbed5800-8151-446b-ae8c-1f876f649328 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:01.707466 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbed5800-8151-446b-ae8c-1f876f649328 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:01.708306 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbed5800-8151-446b-ae8c-1f876f649328 None admin] RBAC: Adding query filter params (role.id=36abe9b50fd8479c86c4f8f70fd85aa3, scope.project.id=3256bc7158894136b4937ecc0a8b3073, user.id=87a3e2c426774a3eba9534209ef0a44b) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 13:59:01.708609 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbed5800-8151-446b-ae8c-1f876f649328 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:01.710144 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbed5800-8151-446b-ae8c-1f876f649328 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:01.716217 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 51/92] 10.222.0.36 () {56 vars in 1374 bytes} [Tue May 3 13:59:01 2022] GET /identity/v3/role_assignments?user.id=87a3e2c426774a3eba9534209ef0a44b&scope.project.id=3256bc7158894136b4937ecc0a8b3073&role.id=36abe9b50fd8479c86c4f8f70fd85aa3 => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 13:59:01.717026 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbed5800-8151-446b-ae8c-1f876f649328 None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:01.767437 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e484396a-a0fd-4068-b405-a6c4b852cd34 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:01.769237 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e484396a-a0fd-4068-b405-a6c4b852cd34 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:01.823344 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbed5800-8151-446b-ae8c-1f876f649328 None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:01.862529 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c153d390-fe78-4969-b2b4-912bf0d69d90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:01.863429 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c153d390-fe78-4969-b2b4-912bf0d69d90 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:01.863689 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c153d390-fe78-4969-b2b4-912bf0d69d90 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:01.863962 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c153d390-fe78-4969-b2b4-912bf0d69d90 None admin] PATH_INFO: `/v3/projects/ef261a2208534afcaa981ebd3e012d44` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:01.866421 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c153d390-fe78-4969-b2b4-912bf0d69d90 None admin] RBAC: Authorizing `identity:get_project(project_id=ef261a2208534afcaa981ebd3e012d44)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:01.867973 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c153d390-fe78-4969-b2b4-912bf0d69d90 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:01.869863 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 52/93] 10.222.0.36 () {56 vars in 1186 bytes} [Tue May 3 13:59:01 2022] GET /identity/v3/projects/ef261a2208534afcaa981ebd3e012d44 => generated 312 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 13:59:01.874990 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 42/94] 10.222.0.36 () {58 vars in 1282 bytes} [Tue May 3 13:59:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 03 13:59:01.875725 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c153d390-fe78-4969-b2b4-912bf0d69d90 None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:01.885216 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e484396a-a0fd-4068-b405-a6c4b852cd34 None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:01.988683 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e484396a-a0fd-4068-b405-a6c4b852cd34 None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:01.995225 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c153d390-fe78-4969-b2b4-912bf0d69d90 None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:02.024810 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7c4814-d776-42a6-b8e7-a525deda571d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:02.025729 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7c4814-d776-42a6-b8e7-a525deda571d None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:02.026013 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7c4814-d776-42a6-b8e7-a525deda571d None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:02.026249 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7c4814-d776-42a6-b8e7-a525deda571d None admin] PATH_INFO: `/v3/projects/3256bc7158894136b4937ecc0a8b3073` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:02.027436 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7c4814-d776-42a6-b8e7-a525deda571d None admin] RBAC: Authorizing `identity:get_project(project_id=3256bc7158894136b4937ecc0a8b3073)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:02.028895 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7c4814-d776-42a6-b8e7-a525deda571d None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:02.030691 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 43/95] 10.222.0.36 () {56 vars in 1186 bytes} [Tue May 3 13:59:01 2022] GET /identity/v3/projects/3256bc7158894136b4937ecc0a8b3073 => generated 298 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 13:59:02.037329 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7c4814-d776-42a6-b8e7-a525deda571d None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:02.038370 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a166a9bd-655d-463d-a828-5fc8ae0d3085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:02.039317 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a166a9bd-655d-463d-a828-5fc8ae0d3085 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:02.039857 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a166a9bd-655d-463d-a828-5fc8ae0d3085 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:02.040318 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a166a9bd-655d-463d-a828-5fc8ae0d3085 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:02.041390 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a166a9bd-655d-463d-a828-5fc8ae0d3085 None admin] RBAC: Adding query filter params (role.id=441fdc11e95b47f4813f72610e39018b, scope.project.id=ef261a2208534afcaa981ebd3e012d44, user.id=e9f93aa2136e485ab8827ada190d87ce) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 13:59:02.041918 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a166a9bd-655d-463d-a828-5fc8ae0d3085 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:02.043592 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a166a9bd-655d-463d-a828-5fc8ae0d3085 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:02.058289 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 53/96] 10.222.0.36 () {56 vars in 1374 bytes} [Tue May 3 13:59:01 2022] GET /identity/v3/role_assignments?user.id=e9f93aa2136e485ab8827ada190d87ce&scope.project.id=ef261a2208534afcaa981ebd3e012d44&role.id=441fdc11e95b47f4813f72610e39018b => generated 259 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 13:59:02.173338 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7c4814-d776-42a6-b8e7-a525deda571d None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:02.209106 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624b8755-51f0-46c3-bbfb-c32c99513116 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:02.209801 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624b8755-51f0-46c3-bbfb-c32c99513116 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:02.210082 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624b8755-51f0-46c3-bbfb-c32c99513116 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:02.210359 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624b8755-51f0-46c3-bbfb-c32c99513116 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:02.211202 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624b8755-51f0-46c3-bbfb-c32c99513116 None admin] RBAC: Adding query filter params (role.id=bd29d35ea39b4ba293ffbf1ffbf4b940, scope.project.id=3256bc7158894136b4937ecc0a8b3073, user.id=e9f93aa2136e485ab8827ada190d87ce) {{(pid=80012) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 13:59:02.211512 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624b8755-51f0-46c3-bbfb-c32c99513116 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:02.212988 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624b8755-51f0-46c3-bbfb-c32c99513116 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:02.220015 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 44/97] 10.222.0.36 () {56 vars in 1374 bytes} [Tue May 3 13:59:02 2022] GET /identity/v3/role_assignments?user.id=e9f93aa2136e485ab8827ada190d87ce&scope.project.id=3256bc7158894136b4937ecc0a8b3073&role.id=bd29d35ea39b4ba293ffbf1ffbf4b940 => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 13:59:04.055977 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3433ba-f3b9-4a63-b297-ae9638b5ecd1 None None] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:04.056603 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3433ba-f3b9-4a63-b297-ae9638b5ecd1 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:04.056603 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3433ba-f3b9-4a63-b297-ae9638b5ecd1 None None] PATH_INFO: `/` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:04.057929 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 54/98] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 3 13:59:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 13:59:04.075850 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f128e94-ba5b-4023-8542-ba1576072e46 None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:04.076732 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f128e94-ba5b-4023-8542-ba1576072e46 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:04.077216 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f128e94-ba5b-4023-8542-ba1576072e46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:04.098917 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-3f128e94-ba5b-4023-8542-ba1576072e46 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 13:59:04.100429 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-3f128e94-ba5b-4023-8542-ba1576072e46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 13:59:04.187117 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 45/99] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 3 13:59:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 13:59:04.221959 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3433ba-f3b9-4a63-b297-ae9638b5ecd1 None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:04.350098 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3433ba-f3b9-4a63-b297-ae9638b5ecd1 None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:04.391374 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fada3e-e7d7-4ffe-b251-ae36e25526f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:04.392182 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fada3e-e7d7-4ffe-b251-ae36e25526f8 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:04.392463 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fada3e-e7d7-4ffe-b251-ae36e25526f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:04.392740 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fada3e-e7d7-4ffe-b251-ae36e25526f8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:04.407294 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fada3e-e7d7-4ffe-b251-ae36e25526f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 13:59:04.414948 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application [None req-28fada3e-e7d7-4ffe-b251-ae36e25526f8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 03 13:59:04.414948 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 13:59:04.414948 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 13:59:04.414948 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 13:59:04.414948 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 13:59:04.414948 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 13:59:04.414948 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 13:59:04.414948 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 13:59:04.414948 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 13:59:04.414948 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 13:59:04.414948 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 13:59:04.414948 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 13:59:04.414948 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 13:59:04.414948 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 13:59:04.414948 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 13:59:04.414948 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 13:59:04.416012 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 13:59:04.416012 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 13:59:04.416012 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 13:59:04.416012 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 13:59:04.416012 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 13:59:04.416012 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 13:59:04.416012 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 13:59:04.416012 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 13:59:04.416012 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 13:59:04.416012 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.get_or_create( May 03 13:59:04.416012 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 13:59:04.416012 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application with Lock( May 03 13:59:04.416012 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 13:59:04.416012 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._enter() May 03 13:59:04.416012 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 13:59:04.416012 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 13:59:04.416964 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 13:59:04.416964 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.creator() May 03 13:59:04.416964 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 13:59:04.416964 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application created_value = creator( May 03 13:59:04.416964 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 13:59:04.416964 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 13:59:04.416964 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 13:59:04.416964 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 13:59:04.416964 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 13:59:04.416964 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 13:59:04.416964 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 03 13:59:04.416964 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application May 03 13:59:04.416964 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 55/100] 10.222.0.36 () {56 vars in 1099 bytes} [Tue May 3 13:59:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 13:59:04.422360 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f128e94-ba5b-4023-8542-ba1576072e46 None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:04.552117 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f128e94-ba5b-4023-8542-ba1576072e46 None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:04.571374 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ac1e29-2145-4720-ac7f-0c36af76c4eb None None] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:04.571710 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ac1e29-2145-4720-ac7f-0c36af76c4eb None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:04.571944 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ac1e29-2145-4720-ac7f-0c36af76c4eb None None] PATH_INFO: `/` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:04.573552 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 56/101] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 3 13:59:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 13:59:04.579595 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e720979d-e7cc-4be5-9864-076c4bc75f12 None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:04.579884 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e720979d-e7cc-4be5-9864-076c4bc75f12 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:04.580165 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e720979d-e7cc-4be5-9864-076c4bc75f12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:04.600504 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-e720979d-e7cc-4be5-9864-076c4bc75f12 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 13:59:04.601646 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-e720979d-e7cc-4be5-9864-076c4bc75f12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 13:59:04.602996 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395cd700-716e-414b-80b3-bfd80ac31657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:04.603951 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395cd700-716e-414b-80b3-bfd80ac31657 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:04.604429 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395cd700-716e-414b-80b3-bfd80ac31657 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:04.604910 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395cd700-716e-414b-80b3-bfd80ac31657 None admin] PATH_INFO: `/v3/roles` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:04.605891 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395cd700-716e-414b-80b3-bfd80ac31657 None admin] RBAC: Adding query filter params (name=member) {{(pid=80012) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 13:59:04.606412 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395cd700-716e-414b-80b3-bfd80ac31657 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:04.608017 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395cd700-716e-414b-80b3-bfd80ac31657 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:04.626998 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 46/102] 10.222.0.36 () {56 vars in 1101 bytes} [Tue May 3 13:59:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 13:59:04.633251 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395cd700-716e-414b-80b3-bfd80ac31657 None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:04.716291 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 57/103] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 3 13:59:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 03 13:59:04.760223 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e720979d-e7cc-4be5-9864-076c4bc75f12 None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:04.788929 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395cd700-716e-414b-80b3-bfd80ac31657 None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:04.821906 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bb99be-dff5-40f4-9677-d205ee6c1cb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:04.822839 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bb99be-dff5-40f4-9677-d205ee6c1cb3 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:04.823121 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bb99be-dff5-40f4-9677-d205ee6c1cb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:04.823394 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bb99be-dff5-40f4-9677-d205ee6c1cb3 None admin] PATH_INFO: `/v3/users/e9f93aa2136e485ab8827ada190d87ce` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:04.824606 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bb99be-dff5-40f4-9677-d205ee6c1cb3 None admin] RBAC: Authorizing `identity:get_user(user_id=e9f93aa2136e485ab8827ada190d87ce)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:04.826076 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bb99be-dff5-40f4-9677-d205ee6c1cb3 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:04.828402 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 47/104] 10.222.0.36 () {56 vars in 1177 bytes} [Tue May 3 13:59:04 2022] GET /identity/v3/users/e9f93aa2136e485ab8827ada190d87ce => generated 275 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 13:59:04.829658 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fa7a3d-692d-46c8-993d-ebc45b218b82 None None] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:04.829943 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fa7a3d-692d-46c8-993d-ebc45b218b82 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:04.830216 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fa7a3d-692d-46c8-993d-ebc45b218b82 None None] PATH_INFO: `/` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:04.831636 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 48/105] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 3 13:59:04 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 13:59:04.836321 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fa7a3d-692d-46c8-993d-ebc45b218b82 None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:04.955325 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e720979d-e7cc-4be5-9864-076c4bc75f12 None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:04.987643 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fa7a3d-692d-46c8-993d-ebc45b218b82 None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:05.020825 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b13e02-e90a-4f32-a6f8-2e7d97c604dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:05.021731 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b13e02-e90a-4f32-a6f8-2e7d97c604dc None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:05.022012 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b13e02-e90a-4f32-a6f8-2e7d97c604dc None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:05.022284 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b13e02-e90a-4f32-a6f8-2e7d97c604dc None admin] PATH_INFO: `/v3/projects/3256bc7158894136b4937ecc0a8b3073` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:05.023469 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b13e02-e90a-4f32-a6f8-2e7d97c604dc None admin] RBAC: Authorizing `identity:get_project(project_id=3256bc7158894136b4937ecc0a8b3073)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:05.024908 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b13e02-e90a-4f32-a6f8-2e7d97c604dc None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:05.027312 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 49/106] 10.222.0.36 () {56 vars in 1186 bytes} [Tue May 3 13:59:04 2022] GET /identity/v3/projects/3256bc7158894136b4937ecc0a8b3073 => generated 298 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 13:59:05.028532 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768e4f39-847a-453f-adc7-438e01f1cbac None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:05.028859 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768e4f39-847a-453f-adc7-438e01f1cbac None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:05.029135 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768e4f39-847a-453f-adc7-438e01f1cbac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:05.035060 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14a4e5e-c6b0-4adc-921b-c638b96c583a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:05.035892 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14a4e5e-c6b0-4adc-921b-c638b96c583a None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:05.036176 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14a4e5e-c6b0-4adc-921b-c638b96c583a None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:05.036456 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14a4e5e-c6b0-4adc-921b-c638b96c583a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:05.046930 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-768e4f39-847a-453f-adc7-438e01f1cbac None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 13:59:05.048223 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-768e4f39-847a-453f-adc7-438e01f1cbac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 13:59:05.058671 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14a4e5e-c6b0-4adc-921b-c638b96c583a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 13:59:05.075847 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application [None req-a14a4e5e-c6b0-4adc-921b-c638b96c583a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 03 13:59:05.075847 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 13:59:05.075847 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 13:59:05.075847 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 13:59:05.075847 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 13:59:05.075847 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 13:59:05.075847 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 13:59:05.075847 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 13:59:05.075847 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 13:59:05.075847 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 13:59:05.075847 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 13:59:05.075847 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 13:59:05.075847 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 13:59:05.075847 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 13:59:05.075847 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 13:59:05.075847 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 13:59:05.076756 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 13:59:05.076756 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 13:59:05.076756 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 13:59:05.076756 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 13:59:05.076756 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 13:59:05.076756 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 13:59:05.076756 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 13:59:05.076756 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 13:59:05.076756 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 13:59:05.076756 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.get_or_create( May 03 13:59:05.076756 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 13:59:05.076756 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application with Lock( May 03 13:59:05.076756 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 13:59:05.076756 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._enter() May 03 13:59:05.076756 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 13:59:05.076756 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 13:59:05.077614 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 13:59:05.077614 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.creator() May 03 13:59:05.077614 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 13:59:05.077614 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application created_value = creator( May 03 13:59:05.077614 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 13:59:05.077614 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 13:59:05.077614 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 13:59:05.077614 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 13:59:05.077614 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 13:59:05.077614 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 13:59:05.077614 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 03 13:59:05.077614 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application May 03 13:59:05.079698 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 58/107] 10.222.0.36 () {56 vars in 1099 bytes} [Tue May 3 13:59:04 2022] GET /identity/v3/roles/reader => generated 84 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 13:59:05.079698 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14a4e5e-c6b0-4adc-921b-c638b96c583a None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:05.146408 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 50/108] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 3 13:59:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 13:59:05.147272 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768e4f39-847a-453f-adc7-438e01f1cbac None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:05.261788 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14a4e5e-c6b0-4adc-921b-c638b96c583a None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:05.299239 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cdd6e8-009c-44dd-96a4-b8394e752be6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:05.300140 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cdd6e8-009c-44dd-96a4-b8394e752be6 None admin] REQUEST_METHOD: `PUT` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:05.300418 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cdd6e8-009c-44dd-96a4-b8394e752be6 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:05.300692 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cdd6e8-009c-44dd-96a4-b8394e752be6 None admin] PATH_INFO: `/v3/projects/3256bc7158894136b4937ecc0a8b3073/users/e9f93aa2136e485ab8827ada190d87ce/roles/441fdc11e95b47f4813f72610e39018b` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:05.303258 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cdd6e8-009c-44dd-96a4-b8394e752be6 None admin] RBAC: Authorizing `identity:create_grant(project_id=3256bc7158894136b4937ecc0a8b3073, user_id=e9f93aa2136e485ab8827ada190d87ce, role_id=441fdc11e95b47f4813f72610e39018b)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:05.304989 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cdd6e8-009c-44dd-96a4-b8394e752be6 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:05.331038 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 59/109] 10.222.0.36 () {58 vars in 1439 bytes} [Tue May 3 13:59:05 2022] PUT /identity/v3/projects/3256bc7158894136b4937ecc0a8b3073/users/e9f93aa2136e485ab8827ada190d87ce/roles/441fdc11e95b47f4813f72610e39018b => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 13:59:05.332104 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cdd6e8-009c-44dd-96a4-b8394e752be6 None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:05.378041 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768e4f39-847a-453f-adc7-438e01f1cbac None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:05.459262 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe28f4fb-4b5f-4e6a-9f6c-b5c102a37c07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:05.459959 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe28f4fb-4b5f-4e6a-9f6c-b5c102a37c07 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:05.460238 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe28f4fb-4b5f-4e6a-9f6c-b5c102a37c07 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:05.460511 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe28f4fb-4b5f-4e6a-9f6c-b5c102a37c07 None admin] PATH_INFO: `/v3/roles` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:05.461305 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe28f4fb-4b5f-4e6a-9f6c-b5c102a37c07 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80012) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 13:59:05.461614 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe28f4fb-4b5f-4e6a-9f6c-b5c102a37c07 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:05.463056 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe28f4fb-4b5f-4e6a-9f6c-b5c102a37c07 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:05.475690 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 51/110] 10.222.0.36 () {56 vars in 1101 bytes} [Tue May 3 13:59:05 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 13:59:05.477472 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1379fc-0c6d-44d8-bb4d-4241b24fce53 None None] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:05.477964 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1379fc-0c6d-44d8-bb4d-4241b24fce53 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:05.478471 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1379fc-0c6d-44d8-bb4d-4241b24fce53 None None] PATH_INFO: `/` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:05.479889 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 52/111] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 3 13:59:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 13:59:05.481232 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1379fc-0c6d-44d8-bb4d-4241b24fce53 None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:05.570951 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cdd6e8-009c-44dd-96a4-b8394e752be6 None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:05.614179 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688f9b14-795d-4121-8bfe-468864f1378b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:05.615367 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688f9b14-795d-4121-8bfe-468864f1378b None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:05.617659 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688f9b14-795d-4121-8bfe-468864f1378b None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:05.618216 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688f9b14-795d-4121-8bfe-468864f1378b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:05.623068 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688f9b14-795d-4121-8bfe-468864f1378b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:05.623902 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688f9b14-795d-4121-8bfe-468864f1378b None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:05.625927 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 60/112] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 3 13:59:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 13:59:05.627209 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95b0132-2834-43c6-ae9b-2781dfb1aa89 None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:05.627489 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95b0132-2834-43c6-ae9b-2781dfb1aa89 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:05.627770 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95b0132-2834-43c6-ae9b-2781dfb1aa89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:05.646322 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-c95b0132-2834-43c6-ae9b-2781dfb1aa89 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 13:59:05.648125 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-c95b0132-2834-43c6-ae9b-2781dfb1aa89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 13:59:05.653269 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1379fc-0c6d-44d8-bb4d-4241b24fce53 None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:05.699414 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbc9730-f9e9-499e-bcbf-ae4bce6ee793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:05.700517 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbc9730-f9e9-499e-bcbf-ae4bce6ee793 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:05.700844 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbc9730-f9e9-499e-bcbf-ae4bce6ee793 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:05.701167 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbc9730-f9e9-499e-bcbf-ae4bce6ee793 None admin] PATH_INFO: `/v3/users/ca59e1fd3bc04530a60400eaa7f6001b` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:05.719221 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbc9730-f9e9-499e-bcbf-ae4bce6ee793 None admin] RBAC: Authorizing `identity:get_user(user_id=ca59e1fd3bc04530a60400eaa7f6001b)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:05.721208 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbc9730-f9e9-499e-bcbf-ae4bce6ee793 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:05.723077 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 53/113] 10.222.0.36 () {56 vars in 1177 bytes} [Tue May 3 13:59:05 2022] GET /identity/v3/users/ca59e1fd3bc04530a60400eaa7f6001b => generated 289 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 13:59:05.724407 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c771ded3-c36e-4bf9-b247-7a5db6a23d0a None None] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:05.724659 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c771ded3-c36e-4bf9-b247-7a5db6a23d0a None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:05.724776 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 61/114] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 3 13:59:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 13:59:05.724978 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c771ded3-c36e-4bf9-b247-7a5db6a23d0a None None] PATH_INFO: `/` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:05.733310 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95b0132-2834-43c6-ae9b-2781dfb1aa89 None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:05.733468 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 54/115] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 3 13:59:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 13:59:05.733468 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c771ded3-c36e-4bf9-b247-7a5db6a23d0a None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:05.832433 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c771ded3-c36e-4bf9-b247-7a5db6a23d0a None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:05.837601 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95b0132-2834-43c6-ae9b-2781dfb1aa89 None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:05.866173 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79351f8-0278-439e-b09c-26d9c4128c45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:05.866826 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79351f8-0278-439e-b09c-26d9c4128c45 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:05.867105 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79351f8-0278-439e-b09c-26d9c4128c45 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:05.867378 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79351f8-0278-439e-b09c-26d9c4128c45 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:05.876254 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29125b1c-98e8-441e-bde9-d500cb499342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:05.877228 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29125b1c-98e8-441e-bde9-d500cb499342 None admin] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:05.877682 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29125b1c-98e8-441e-bde9-d500cb499342 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:05.877961 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29125b1c-98e8-441e-bde9-d500cb499342 None admin] PATH_INFO: `/v3/projects` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:05.878762 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29125b1c-98e8-441e-bde9-d500cb499342 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:05.880275 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29125b1c-98e8-441e-bde9-d500cb499342 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:05.905675 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 62/116] 10.222.0.36 () {60 vars in 1141 bytes} [Tue May 3 13:59:05 2022] POST /identity/v3/projects => generated 302 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 13:59:05.907084 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51f5e18-a277-46d0-a648-d07e1a6eddbf None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:05.907438 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51f5e18-a277-46d0-a648-d07e1a6eddbf None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:05.907781 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51f5e18-a277-46d0-a648-d07e1a6eddbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:05.938956 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-e51f5e18-a277-46d0-a648-d07e1a6eddbf None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 13:59:05.940983 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-e51f5e18-a277-46d0-a648-d07e1a6eddbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 13:59:05.947073 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79351f8-0278-439e-b09c-26d9c4128c45 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:05.948811 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79351f8-0278-439e-b09c-26d9c4128c45 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:06.034802 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 63/117] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 3 13:59:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 13:59:06.037177 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d62b10-1539-443b-b290-a0ea0b3ef7cb None None] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:06.037561 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d62b10-1539-443b-b290-a0ea0b3ef7cb None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:06.037908 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d62b10-1539-443b-b290-a0ea0b3ef7cb None None] PATH_INFO: `/` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:06.045247 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 64/118] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 3 13:59:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 13:59:06.045247 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d62b10-1539-443b-b290-a0ea0b3ef7cb None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:06.081820 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 55/119] 10.222.0.36 () {58 vars in 1282 bytes} [Tue May 3 13:59:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 03 13:59:06.087094 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2724c6d7-e35a-4581-b740-32527071ca5d None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:06.087312 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2724c6d7-e35a-4581-b740-32527071ca5d None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:06.087588 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2724c6d7-e35a-4581-b740-32527071ca5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:06.110660 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-2724c6d7-e35a-4581-b740-32527071ca5d None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 13:59:06.111844 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-2724c6d7-e35a-4581-b740-32527071ca5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 13:59:06.168224 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d62b10-1539-443b-b290-a0ea0b3ef7cb None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:06.196598 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 56/120] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 3 13:59:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 13:59:06.197377 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2724c6d7-e35a-4581-b740-32527071ca5d None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:06.205119 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6443b85-9421-412c-9ac9-62d2ee8bc1e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:06.206286 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6443b85-9421-412c-9ac9-62d2ee8bc1e4 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:06.206780 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6443b85-9421-412c-9ac9-62d2ee8bc1e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:06.207283 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6443b85-9421-412c-9ac9-62d2ee8bc1e4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:06.219365 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6443b85-9421-412c-9ac9-62d2ee8bc1e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 13:59:06.228394 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application [None req-e6443b85-9421-412c-9ac9-62d2ee8bc1e4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 03 13:59:06.228394 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 13:59:06.228394 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 13:59:06.228394 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 13:59:06.228394 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 13:59:06.228394 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 13:59:06.228394 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 13:59:06.228394 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 13:59:06.228394 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 13:59:06.228394 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 13:59:06.228394 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 13:59:06.228394 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 13:59:06.228394 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 13:59:06.228394 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 13:59:06.228394 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 13:59:06.228394 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 13:59:06.229319 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 13:59:06.229319 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 13:59:06.229319 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 13:59:06.229319 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 13:59:06.229319 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 13:59:06.229319 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 13:59:06.229319 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 13:59:06.229319 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 13:59:06.229319 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 13:59:06.229319 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.get_or_create( May 03 13:59:06.229319 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 13:59:06.229319 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application with Lock( May 03 13:59:06.229319 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 13:59:06.229319 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._enter() May 03 13:59:06.229319 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 13:59:06.229319 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 13:59:06.230114 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 13:59:06.230114 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.creator() May 03 13:59:06.230114 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 13:59:06.230114 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application created_value = creator( May 03 13:59:06.230114 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 13:59:06.230114 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 13:59:06.230114 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 13:59:06.230114 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 13:59:06.230114 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 13:59:06.230114 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 13:59:06.230114 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 03 13:59:06.230114 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application May 03 13:59:06.232503 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 65/121] 10.222.0.36 () {56 vars in 1099 bytes} [Tue May 3 13:59:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 13:59:06.233866 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6443b85-9421-412c-9ac9-62d2ee8bc1e4 None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:06.292399 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2724c6d7-e35a-4581-b740-32527071ca5d None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:06.327493 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c68c49-f624-4872-857c-8b02a8aed24a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:06.328314 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c68c49-f624-4872-857c-8b02a8aed24a None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:06.328598 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c68c49-f624-4872-857c-8b02a8aed24a None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:06.328872 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c68c49-f624-4872-857c-8b02a8aed24a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:06.339469 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c68c49-f624-4872-857c-8b02a8aed24a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 13:59:06.339733 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6443b85-9421-412c-9ac9-62d2ee8bc1e4 None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:06.347672 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application [None req-25c68c49-f624-4872-857c-8b02a8aed24a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 03 13:59:06.347672 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 13:59:06.347672 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 13:59:06.347672 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 13:59:06.347672 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 13:59:06.347672 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 13:59:06.347672 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 13:59:06.347672 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 13:59:06.347672 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 13:59:06.347672 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 13:59:06.347672 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 13:59:06.347672 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 13:59:06.347672 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 13:59:06.347672 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 13:59:06.347672 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 13:59:06.347672 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 13:59:06.348607 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 13:59:06.348607 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 13:59:06.348607 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 13:59:06.348607 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 13:59:06.348607 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 13:59:06.348607 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 13:59:06.348607 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 13:59:06.348607 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 13:59:06.348607 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 13:59:06.348607 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.get_or_create( May 03 13:59:06.348607 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 13:59:06.348607 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application with Lock( May 03 13:59:06.348607 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 13:59:06.348607 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._enter() May 03 13:59:06.348607 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 13:59:06.348607 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 13:59:06.349414 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 13:59:06.349414 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.creator() May 03 13:59:06.349414 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 13:59:06.349414 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application created_value = creator( May 03 13:59:06.349414 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 13:59:06.349414 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 13:59:06.349414 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 13:59:06.349414 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 13:59:06.349414 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 13:59:06.349414 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 13:59:06.349414 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 03 13:59:06.349414 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application May 03 13:59:06.353880 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 57/122] 10.222.0.36 () {56 vars in 1114 bytes} [Tue May 3 13:59:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 13:59:06.354777 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c68c49-f624-4872-857c-8b02a8aed24a None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:06.378662 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d94cc2-215a-4b4c-8a66-6d8ece0b7d53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:06.379984 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d94cc2-215a-4b4c-8a66-6d8ece0b7d53 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:06.380387 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d94cc2-215a-4b4c-8a66-6d8ece0b7d53 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:06.380675 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d94cc2-215a-4b4c-8a66-6d8ece0b7d53 None admin] PATH_INFO: `/v3/projects/3256bc7158894136b4937ecc0a8b3073` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:06.382349 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d94cc2-215a-4b4c-8a66-6d8ece0b7d53 None admin] RBAC: Authorizing `identity:get_project(project_id=3256bc7158894136b4937ecc0a8b3073)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:06.384238 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d94cc2-215a-4b4c-8a66-6d8ece0b7d53 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:06.386546 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 66/123] 10.222.0.36 () {56 vars in 1186 bytes} [Tue May 3 13:59:06 2022] GET /identity/v3/projects/3256bc7158894136b4937ecc0a8b3073 => generated 298 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 13:59:06.387308 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d94cc2-215a-4b4c-8a66-6d8ece0b7d53 None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:06.465344 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c68c49-f624-4872-857c-8b02a8aed24a None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:06.488923 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d94cc2-215a-4b4c-8a66-6d8ece0b7d53 None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:06.499518 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59ec2de-5cd4-45ab-ba6f-7f341f8b37f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:06.500197 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59ec2de-5cd4-45ab-ba6f-7f341f8b37f0 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:06.500482 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59ec2de-5cd4-45ab-ba6f-7f341f8b37f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:06.500761 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59ec2de-5cd4-45ab-ba6f-7f341f8b37f0 None admin] PATH_INFO: `/v3/roles` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:06.501538 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59ec2de-5cd4-45ab-ba6f-7f341f8b37f0 None admin] RBAC: Adding query filter params (name=member) {{(pid=80012) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 13:59:06.501850 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59ec2de-5cd4-45ab-ba6f-7f341f8b37f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:06.503244 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59ec2de-5cd4-45ab-ba6f-7f341f8b37f0 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:06.511670 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 58/124] 10.222.0.36 () {56 vars in 1101 bytes} [Tue May 3 13:59:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 13:59:06.512484 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59ec2de-5cd4-45ab-ba6f-7f341f8b37f0 None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:06.523820 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7113b315-7f95-49a3-a546-eba3b6040c26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:06.524668 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7113b315-7f95-49a3-a546-eba3b6040c26 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:06.524949 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7113b315-7f95-49a3-a546-eba3b6040c26 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:06.525220 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7113b315-7f95-49a3-a546-eba3b6040c26 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:06.535951 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7113b315-7f95-49a3-a546-eba3b6040c26 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 13:59:06.543672 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application [None req-7113b315-7f95-49a3-a546-eba3b6040c26 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 03 13:59:06.543672 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 13:59:06.543672 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 13:59:06.543672 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 13:59:06.543672 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 13:59:06.543672 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 13:59:06.543672 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 13:59:06.543672 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 13:59:06.543672 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 13:59:06.543672 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 13:59:06.543672 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 13:59:06.543672 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 13:59:06.543672 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 13:59:06.543672 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 13:59:06.543672 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 13:59:06.543672 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 13:59:06.545673 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 13:59:06.545673 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 13:59:06.545673 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 13:59:06.545673 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 13:59:06.545673 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 13:59:06.545673 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 13:59:06.545673 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 13:59:06.545673 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 13:59:06.545673 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 13:59:06.545673 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.get_or_create( May 03 13:59:06.545673 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 13:59:06.545673 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application with Lock( May 03 13:59:06.545673 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 13:59:06.545673 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._enter() May 03 13:59:06.545673 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 13:59:06.545673 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 13:59:06.547654 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 13:59:06.547654 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.creator() May 03 13:59:06.547654 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 13:59:06.547654 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application created_value = creator( May 03 13:59:06.547654 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 13:59:06.547654 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 13:59:06.547654 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 13:59:06.547654 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 13:59:06.547654 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 13:59:06.547654 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 13:59:06.547654 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 03 13:59:06.547654 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application May 03 13:59:06.547654 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 67/125] 10.222.0.36 () {56 vars in 1096 bytes} [Tue May 3 13:59:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 13:59:06.547654 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7113b315-7f95-49a3-a546-eba3b6040c26 None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:06.608815 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59ec2de-5cd4-45ab-ba6f-7f341f8b37f0 None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:06.642826 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2128ea-b0a6-47f8-95c9-c317a1ea124b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:06.643505 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2128ea-b0a6-47f8-95c9-c317a1ea124b None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:06.643788 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2128ea-b0a6-47f8-95c9-c317a1ea124b None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:06.644067 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2128ea-b0a6-47f8-95c9-c317a1ea124b None admin] PATH_INFO: `/v3/roles` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:06.644821 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2128ea-b0a6-47f8-95c9-c317a1ea124b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80012) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 13:59:06.645129 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2128ea-b0a6-47f8-95c9-c317a1ea124b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:06.646564 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2128ea-b0a6-47f8-95c9-c317a1ea124b None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:06.646755 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7113b315-7f95-49a3-a546-eba3b6040c26 None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:06.654827 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 59/126] 10.222.0.36 () {56 vars in 1111 bytes} [Tue May 3 13:59:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 13:59:06.655908 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2128ea-b0a6-47f8-95c9-c317a1ea124b None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:06.690207 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419c6863-6b54-4b75-8b55-812ee8f9f876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:06.690984 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419c6863-6b54-4b75-8b55-812ee8f9f876 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:06.691269 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419c6863-6b54-4b75-8b55-812ee8f9f876 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:06.691545 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419c6863-6b54-4b75-8b55-812ee8f9f876 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:06.692376 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419c6863-6b54-4b75-8b55-812ee8f9f876 None admin] RBAC: Adding query filter params (role.id=881b929165074739a253b35012fbc4fb, scope.project.id=3256bc7158894136b4937ecc0a8b3073, user.id=ca59e1fd3bc04530a60400eaa7f6001b) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 13:59:06.692683 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419c6863-6b54-4b75-8b55-812ee8f9f876 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:06.694164 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419c6863-6b54-4b75-8b55-812ee8f9f876 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:06.700177 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 68/127] 10.222.0.36 () {56 vars in 1374 bytes} [Tue May 3 13:59:06 2022] GET /identity/v3/role_assignments?user.id=ca59e1fd3bc04530a60400eaa7f6001b&scope.project.id=3256bc7158894136b4937ecc0a8b3073&role.id=881b929165074739a253b35012fbc4fb => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 13:59:06.700794 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419c6863-6b54-4b75-8b55-812ee8f9f876 None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:06.765208 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2128ea-b0a6-47f8-95c9-c317a1ea124b None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:06.798811 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d50bb91-1479-4cbb-b3ea-ffba05f4aacc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:06.799718 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d50bb91-1479-4cbb-b3ea-ffba05f4aacc None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:06.800000 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d50bb91-1479-4cbb-b3ea-ffba05f4aacc None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:06.800279 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d50bb91-1479-4cbb-b3ea-ffba05f4aacc None admin] PATH_INFO: `/v3/users/e9f93aa2136e485ab8827ada190d87ce` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:06.801624 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d50bb91-1479-4cbb-b3ea-ffba05f4aacc None admin] RBAC: Authorizing `identity:get_user(user_id=e9f93aa2136e485ab8827ada190d87ce)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:06.803101 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d50bb91-1479-4cbb-b3ea-ffba05f4aacc None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:06.803971 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419c6863-6b54-4b75-8b55-812ee8f9f876 None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:06.804775 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 60/128] 10.222.0.36 () {56 vars in 1177 bytes} [Tue May 3 13:59:06 2022] GET /identity/v3/users/e9f93aa2136e485ab8827ada190d87ce => generated 275 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 13:59:06.805568 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d50bb91-1479-4cbb-b3ea-ffba05f4aacc None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:06.840560 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dfc7cd-0b84-4ce6-bfc8-04f46c8c1816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:06.841243 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dfc7cd-0b84-4ce6-bfc8-04f46c8c1816 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:06.841554 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dfc7cd-0b84-4ce6-bfc8-04f46c8c1816 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:06.841829 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dfc7cd-0b84-4ce6-bfc8-04f46c8c1816 None admin] PATH_INFO: `/v3/roles` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:06.842587 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dfc7cd-0b84-4ce6-bfc8-04f46c8c1816 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 13:59:06.842946 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dfc7cd-0b84-4ce6-bfc8-04f46c8c1816 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:06.844485 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dfc7cd-0b84-4ce6-bfc8-04f46c8c1816 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:06.854038 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 69/129] 10.222.0.36 () {56 vars in 1099 bytes} [Tue May 3 13:59:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 13:59:06.854729 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dfc7cd-0b84-4ce6-bfc8-04f46c8c1816 None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:06.971324 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dfc7cd-0b84-4ce6-bfc8-04f46c8c1816 None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:07.010298 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4902f2bf-3a33-4f28-9965-4cf4d57bc53d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:07.011180 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4902f2bf-3a33-4f28-9965-4cf4d57bc53d None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:07.011460 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4902f2bf-3a33-4f28-9965-4cf4d57bc53d None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:07.011736 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4902f2bf-3a33-4f28-9965-4cf4d57bc53d None admin] PATH_INFO: `/v3/projects/ef261a2208534afcaa981ebd3e012d44` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:07.017156 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d50bb91-1479-4cbb-b3ea-ffba05f4aacc None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:07.018046 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4902f2bf-3a33-4f28-9965-4cf4d57bc53d None admin] RBAC: Authorizing `identity:get_project(project_id=ef261a2208534afcaa981ebd3e012d44)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:07.019532 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4902f2bf-3a33-4f28-9965-4cf4d57bc53d None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:07.022813 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 70/130] 10.222.0.36 () {56 vars in 1186 bytes} [Tue May 3 13:59:06 2022] GET /identity/v3/projects/ef261a2208534afcaa981ebd3e012d44 => generated 312 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 13:59:07.023592 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4902f2bf-3a33-4f28-9965-4cf4d57bc53d None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:07.073979 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3241f6-646e-477c-afac-c353824c3a57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:07.074869 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3241f6-646e-477c-afac-c353824c3a57 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:07.075149 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3241f6-646e-477c-afac-c353824c3a57 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:07.075423 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3241f6-646e-477c-afac-c353824c3a57 None admin] PATH_INFO: `/v3/users/e9f93aa2136e485ab8827ada190d87ce` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:07.079129 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3241f6-646e-477c-afac-c353824c3a57 None admin] RBAC: Authorizing `identity:get_user(user_id=e9f93aa2136e485ab8827ada190d87ce)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:07.080975 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3241f6-646e-477c-afac-c353824c3a57 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:07.083901 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 61/131] 10.222.0.36 () {56 vars in 1177 bytes} [Tue May 3 13:59:06 2022] GET /identity/v3/users/e9f93aa2136e485ab8827ada190d87ce => generated 275 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 13:59:07.084643 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3241f6-646e-477c-afac-c353824c3a57 None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:07.231413 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3241f6-646e-477c-afac-c353824c3a57 None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:07.260896 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4902f2bf-3a33-4f28-9965-4cf4d57bc53d None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:07.266099 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2e6726-8129-451b-a05c-c319b417bc54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:07.267736 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2e6726-8129-451b-a05c-c319b417bc54 None admin] REQUEST_METHOD: `PUT` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:07.268020 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2e6726-8129-451b-a05c-c319b417bc54 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:07.268293 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2e6726-8129-451b-a05c-c319b417bc54 None admin] PATH_INFO: `/v3/projects/ef261a2208534afcaa981ebd3e012d44/users/e9f93aa2136e485ab8827ada190d87ce/roles/441fdc11e95b47f4813f72610e39018b` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:07.276253 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2e6726-8129-451b-a05c-c319b417bc54 None admin] RBAC: Authorizing `identity:create_grant(project_id=ef261a2208534afcaa981ebd3e012d44, user_id=e9f93aa2136e485ab8827ada190d87ce, role_id=441fdc11e95b47f4813f72610e39018b)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:07.277781 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2e6726-8129-451b-a05c-c319b417bc54 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:07.302112 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 62/132] 10.222.0.36 () {58 vars in 1439 bytes} [Tue May 3 13:59:07 2022] PUT /identity/v3/projects/ef261a2208534afcaa981ebd3e012d44/users/e9f93aa2136e485ab8827ada190d87ce/roles/441fdc11e95b47f4813f72610e39018b => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 13:59:07.303009 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2e6726-8129-451b-a05c-c319b417bc54 None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:07.330205 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e798ee-cfc0-428e-a5f0-9ba4b67fcd46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:07.333307 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e798ee-cfc0-428e-a5f0-9ba4b67fcd46 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:07.333585 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e798ee-cfc0-428e-a5f0-9ba4b67fcd46 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:07.333910 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e798ee-cfc0-428e-a5f0-9ba4b67fcd46 None admin] PATH_INFO: `/v3/users/87a3e2c426774a3eba9534209ef0a44b` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:07.336330 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e798ee-cfc0-428e-a5f0-9ba4b67fcd46 None admin] RBAC: Authorizing `identity:get_user(user_id=87a3e2c426774a3eba9534209ef0a44b)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:07.338048 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e798ee-cfc0-428e-a5f0-9ba4b67fcd46 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:07.340011 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 71/133] 10.222.0.36 () {56 vars in 1177 bytes} [Tue May 3 13:59:07 2022] GET /identity/v3/users/87a3e2c426774a3eba9534209ef0a44b => generated 247 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 13:59:07.350521 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e798ee-cfc0-428e-a5f0-9ba4b67fcd46 None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:07.507326 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2e6726-8129-451b-a05c-c319b417bc54 None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:07.554882 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e798ee-cfc0-428e-a5f0-9ba4b67fcd46 None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:07.574080 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3fab8f-04d0-40b4-b63e-308f85e5ebd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:07.574966 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3fab8f-04d0-40b4-b63e-308f85e5ebd6 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:07.575244 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3fab8f-04d0-40b4-b63e-308f85e5ebd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:07.575517 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3fab8f-04d0-40b4-b63e-308f85e5ebd6 None admin] PATH_INFO: `/v3/projects/3256bc7158894136b4937ecc0a8b3073` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:07.576721 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3fab8f-04d0-40b4-b63e-308f85e5ebd6 None admin] RBAC: Authorizing `identity:get_project(project_id=3256bc7158894136b4937ecc0a8b3073)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:07.578276 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3fab8f-04d0-40b4-b63e-308f85e5ebd6 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:07.580022 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 63/134] 10.222.0.36 () {56 vars in 1186 bytes} [Tue May 3 13:59:07 2022] GET /identity/v3/projects/3256bc7158894136b4937ecc0a8b3073 => generated 298 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 13:59:07.586094 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3fab8f-04d0-40b4-b63e-308f85e5ebd6 None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:07.622538 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a67aeb-4963-4c30-9586-1f7f0735a96c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:07.623453 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a67aeb-4963-4c30-9586-1f7f0735a96c None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:07.623741 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a67aeb-4963-4c30-9586-1f7f0735a96c None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:07.624018 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a67aeb-4963-4c30-9586-1f7f0735a96c None admin] PATH_INFO: `/v3/projects/3256bc7158894136b4937ecc0a8b3073` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:07.627464 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a67aeb-4963-4c30-9586-1f7f0735a96c None admin] RBAC: Authorizing `identity:get_project(project_id=3256bc7158894136b4937ecc0a8b3073)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:07.628947 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a67aeb-4963-4c30-9586-1f7f0735a96c None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:07.639079 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 72/135] 10.222.0.36 () {56 vars in 1186 bytes} [Tue May 3 13:59:07 2022] GET /identity/v3/projects/3256bc7158894136b4937ecc0a8b3073 => generated 298 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 13:59:07.643406 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a67aeb-4963-4c30-9586-1f7f0735a96c None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:07.775213 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3fab8f-04d0-40b4-b63e-308f85e5ebd6 None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:07.837629 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff83e1b-ac85-41ed-8432-1b6a82a49b20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:07.839330 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff83e1b-ac85-41ed-8432-1b6a82a49b20 None admin] REQUEST_METHOD: `PUT` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:07.839793 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff83e1b-ac85-41ed-8432-1b6a82a49b20 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:07.840246 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff83e1b-ac85-41ed-8432-1b6a82a49b20 None admin] PATH_INFO: `/v3/projects/3256bc7158894136b4937ecc0a8b3073/users/e9f93aa2136e485ab8827ada190d87ce/roles/bd29d35ea39b4ba293ffbf1ffbf4b940` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:07.845377 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff83e1b-ac85-41ed-8432-1b6a82a49b20 None admin] RBAC: Authorizing `identity:create_grant(project_id=3256bc7158894136b4937ecc0a8b3073, user_id=e9f93aa2136e485ab8827ada190d87ce, role_id=bd29d35ea39b4ba293ffbf1ffbf4b940)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:07.847047 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff83e1b-ac85-41ed-8432-1b6a82a49b20 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:07.849969 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a67aeb-4963-4c30-9586-1f7f0735a96c None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:07.873598 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 64/136] 10.222.0.36 () {58 vars in 1439 bytes} [Tue May 3 13:59:07 2022] PUT /identity/v3/projects/3256bc7158894136b4937ecc0a8b3073/users/e9f93aa2136e485ab8827ada190d87ce/roles/bd29d35ea39b4ba293ffbf1ffbf4b940 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 13:59:07.900225 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce8765a-1e54-4718-8d16-e25c71f887ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:07.901613 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce8765a-1e54-4718-8d16-e25c71f887ca None admin] REQUEST_METHOD: `PUT` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:07.902092 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce8765a-1e54-4718-8d16-e25c71f887ca None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:07.902560 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce8765a-1e54-4718-8d16-e25c71f887ca None admin] PATH_INFO: `/v3/projects/3256bc7158894136b4937ecc0a8b3073/users/87a3e2c426774a3eba9534209ef0a44b/roles/36abe9b50fd8479c86c4f8f70fd85aa3` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:07.905935 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce8765a-1e54-4718-8d16-e25c71f887ca None admin] RBAC: Authorizing `identity:create_grant(project_id=3256bc7158894136b4937ecc0a8b3073, user_id=87a3e2c426774a3eba9534209ef0a44b, role_id=36abe9b50fd8479c86c4f8f70fd85aa3)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:07.907728 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce8765a-1e54-4718-8d16-e25c71f887ca None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:07.930063 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 73/137] 10.222.0.36 () {58 vars in 1439 bytes} [Tue May 3 13:59:07 2022] PUT /identity/v3/projects/3256bc7158894136b4937ecc0a8b3073/users/87a3e2c426774a3eba9534209ef0a44b/roles/36abe9b50fd8479c86c4f8f70fd85aa3 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 13:59:08.077945 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1993c4-6366-4947-8096-19b10f3c88b7 None None] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:08.078594 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1993c4-6366-4947-8096-19b10f3c88b7 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:08.079060 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1993c4-6366-4947-8096-19b10f3c88b7 None None] PATH_INFO: `/` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:08.081021 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 65/138] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 3 13:59:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 13:59:08.099229 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b996112-8c06-4d28-aa73-0b4573f9604f None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:08.099847 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b996112-8c06-4d28-aa73-0b4573f9604f None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:08.100300 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b996112-8c06-4d28-aa73-0b4573f9604f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:08.126523 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-6b996112-8c06-4d28-aa73-0b4573f9604f None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 13:59:08.128100 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-6b996112-8c06-4d28-aa73-0b4573f9604f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 13:59:08.223605 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 74/139] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 3 13:59:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 13:59:08.267182 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1993c4-6366-4947-8096-19b10f3c88b7 None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:08.388643 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1993c4-6366-4947-8096-19b10f3c88b7 None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:08.434925 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ab6e8b-1d86-4377-862a-dbe9eb295356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:08.436052 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ab6e8b-1d86-4377-862a-dbe9eb295356 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:08.436509 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ab6e8b-1d86-4377-862a-dbe9eb295356 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:08.437106 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ab6e8b-1d86-4377-862a-dbe9eb295356 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:08.458558 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ab6e8b-1d86-4377-862a-dbe9eb295356 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 13:59:08.467296 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application [None req-71ab6e8b-1d86-4377-862a-dbe9eb295356 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 03 13:59:08.467296 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 13:59:08.467296 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 13:59:08.467296 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 13:59:08.467296 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 13:59:08.467296 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 13:59:08.467296 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 13:59:08.467296 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 13:59:08.467296 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 13:59:08.467296 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 13:59:08.467296 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 13:59:08.467296 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 13:59:08.467296 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 13:59:08.467296 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 13:59:08.467296 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 13:59:08.467296 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 13:59:08.468806 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 13:59:08.468806 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 13:59:08.468806 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 13:59:08.468806 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 13:59:08.468806 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 13:59:08.468806 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 13:59:08.468806 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 13:59:08.468806 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 13:59:08.468806 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 13:59:08.468806 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.get_or_create( May 03 13:59:08.468806 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 13:59:08.468806 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application with Lock( May 03 13:59:08.468806 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 13:59:08.468806 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._enter() May 03 13:59:08.468806 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 13:59:08.468806 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 13:59:08.469620 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 13:59:08.469620 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.creator() May 03 13:59:08.469620 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 13:59:08.469620 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application created_value = creator( May 03 13:59:08.469620 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 13:59:08.469620 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 13:59:08.469620 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 13:59:08.469620 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 13:59:08.469620 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 13:59:08.469620 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 13:59:08.469620 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 03 13:59:08.469620 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application May 03 13:59:08.472146 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 66/140] 10.222.0.36 () {56 vars in 1099 bytes} [Tue May 3 13:59:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 13:59:08.478274 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b996112-8c06-4d28-aa73-0b4573f9604f None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:08.579101 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b996112-8c06-4d28-aa73-0b4573f9604f None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:08.616793 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b72218-e153-4cc9-84a4-43d9e781e340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:08.617815 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b72218-e153-4cc9-84a4-43d9e781e340 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:08.618264 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b72218-e153-4cc9-84a4-43d9e781e340 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:08.618988 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b72218-e153-4cc9-84a4-43d9e781e340 None admin] PATH_INFO: `/v3/roles` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:08.619766 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b72218-e153-4cc9-84a4-43d9e781e340 None admin] RBAC: Adding query filter params (name=member) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 13:59:08.620278 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b72218-e153-4cc9-84a4-43d9e781e340 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:08.621973 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b72218-e153-4cc9-84a4-43d9e781e340 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:08.631408 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 75/141] 10.222.0.36 () {56 vars in 1101 bytes} [Tue May 3 13:59:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 13:59:08.636719 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ab6e8b-1d86-4377-862a-dbe9eb295356 None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:08.759801 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ab6e8b-1d86-4377-862a-dbe9eb295356 None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:08.801830 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61766c8-3b88-463d-9053-e12d3123210c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:08.802980 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61766c8-3b88-463d-9053-e12d3123210c None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:08.803405 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61766c8-3b88-463d-9053-e12d3123210c None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:08.803835 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61766c8-3b88-463d-9053-e12d3123210c None admin] PATH_INFO: `/v3/users/e9f93aa2136e485ab8827ada190d87ce` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:08.810064 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61766c8-3b88-463d-9053-e12d3123210c None admin] RBAC: Authorizing `identity:get_user(user_id=e9f93aa2136e485ab8827ada190d87ce)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:08.811748 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61766c8-3b88-463d-9053-e12d3123210c None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:08.813638 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 67/142] 10.222.0.36 () {56 vars in 1177 bytes} [Tue May 3 13:59:08 2022] GET /identity/v3/users/e9f93aa2136e485ab8827ada190d87ce => generated 275 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 13:59:08.819265 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b72218-e153-4cc9-84a4-43d9e781e340 None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:08.920452 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b72218-e153-4cc9-84a4-43d9e781e340 None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:08.931646 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db55981c-400b-4407-ab9e-680ff3cdd68d None None] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:08.932155 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db55981c-400b-4407-ab9e-680ff3cdd68d None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:08.932604 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db55981c-400b-4407-ab9e-680ff3cdd68d None None] PATH_INFO: `/` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:08.934153 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 68/143] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 3 13:59:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 13:59:08.939512 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505ed86f-9ff9-45f2-acdc-e8fe23cfe171 None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:08.939993 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505ed86f-9ff9-45f2-acdc-e8fe23cfe171 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:08.940414 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505ed86f-9ff9-45f2-acdc-e8fe23cfe171 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:08.966518 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-505ed86f-9ff9-45f2-acdc-e8fe23cfe171 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 13:59:08.967508 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-505ed86f-9ff9-45f2-acdc-e8fe23cfe171 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 13:59:08.986157 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da365828-0973-417f-8b34-210f33807e37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:08.987070 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da365828-0973-417f-8b34-210f33807e37 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:08.987501 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da365828-0973-417f-8b34-210f33807e37 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:08.987925 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da365828-0973-417f-8b34-210f33807e37 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:09.091877 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da365828-0973-417f-8b34-210f33807e37 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:09.093685 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da365828-0973-417f-8b34-210f33807e37 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:09.146785 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 69/144] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 3 13:59:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 03 13:59:09.182878 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505ed86f-9ff9-45f2-acdc-e8fe23cfe171 None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:09.202113 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 76/145] 10.222.0.36 () {58 vars in 1282 bytes} [Tue May 3 13:59:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 03 13:59:09.210650 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da365828-0973-417f-8b34-210f33807e37 None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:09.312837 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da365828-0973-417f-8b34-210f33807e37 None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:09.354556 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f99dd0-2f13-4486-9350-e791d021e08e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:09.355357 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f99dd0-2f13-4486-9350-e791d021e08e None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:09.355641 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f99dd0-2f13-4486-9350-e791d021e08e None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:09.355911 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f99dd0-2f13-4486-9350-e791d021e08e None admin] PATH_INFO: `/v3/projects/3256bc7158894136b4937ecc0a8b3073` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:09.357782 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f99dd0-2f13-4486-9350-e791d021e08e None admin] RBAC: Authorizing `identity:get_project(project_id=3256bc7158894136b4937ecc0a8b3073)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:09.359596 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f99dd0-2f13-4486-9350-e791d021e08e None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:09.361347 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 77/146] 10.222.0.36 () {56 vars in 1186 bytes} [Tue May 3 13:59:09 2022] GET /identity/v3/projects/3256bc7158894136b4937ecc0a8b3073 => generated 298 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 13:59:09.369100 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f99dd0-2f13-4486-9350-e791d021e08e None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:09.376197 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505ed86f-9ff9-45f2-acdc-e8fe23cfe171 None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:09.443057 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047152ac-4d39-4bd8-b5ec-dee6cb82774b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:09.443874 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047152ac-4d39-4bd8-b5ec-dee6cb82774b None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:09.444167 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047152ac-4d39-4bd8-b5ec-dee6cb82774b None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:09.444446 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047152ac-4d39-4bd8-b5ec-dee6cb82774b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:09.447645 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047152ac-4d39-4bd8-b5ec-dee6cb82774b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:09.449116 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047152ac-4d39-4bd8-b5ec-dee6cb82774b None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:09.450789 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 70/147] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 3 13:59:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 13:59:09.456384 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047152ac-4d39-4bd8-b5ec-dee6cb82774b None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:09.562407 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f99dd0-2f13-4486-9350-e791d021e08e None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:09.625364 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff5b5c6-5c3c-4a10-9c5d-039705a2840f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:09.626473 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff5b5c6-5c3c-4a10-9c5d-039705a2840f None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:09.627048 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff5b5c6-5c3c-4a10-9c5d-039705a2840f None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:09.627545 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff5b5c6-5c3c-4a10-9c5d-039705a2840f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:09.628605 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff5b5c6-5c3c-4a10-9c5d-039705a2840f None admin] RBAC: Adding query filter params (role.id=441fdc11e95b47f4813f72610e39018b, scope.project.id=3256bc7158894136b4937ecc0a8b3073, user.id=e9f93aa2136e485ab8827ada190d87ce) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 13:59:09.629126 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff5b5c6-5c3c-4a10-9c5d-039705a2840f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:09.630783 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff5b5c6-5c3c-4a10-9c5d-039705a2840f None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:09.645749 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 78/148] 10.222.0.36 () {56 vars in 1374 bytes} [Tue May 3 13:59:09 2022] GET /identity/v3/role_assignments?user.id=e9f93aa2136e485ab8827ada190d87ce&scope.project.id=3256bc7158894136b4937ecc0a8b3073&role.id=441fdc11e95b47f4813f72610e39018b => generated 608 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 13:59:09.668816 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047152ac-4d39-4bd8-b5ec-dee6cb82774b None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:09.728367 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5151eb1c-2d74-4f13-8fc2-06911c028c4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:09.729058 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5151eb1c-2d74-4f13-8fc2-06911c028c4d None admin] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:09.729376 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5151eb1c-2d74-4f13-8fc2-06911c028c4d None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:09.729656 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5151eb1c-2d74-4f13-8fc2-06911c028c4d None admin] PATH_INFO: `/v3/users` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:09.730382 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5151eb1c-2d74-4f13-8fc2-06911c028c4d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:09.731863 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5151eb1c-2d74-4f13-8fc2-06911c028c4d None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:09.768055 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 71/149] 10.222.0.36 () {60 vars in 1132 bytes} [Tue May 3 13:59:09 2022] POST /identity/v3/users => generated 283 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 13:59:09.834870 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15aedb1-ca9d-495f-b876-55c825ca6edc None None] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:09.835564 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15aedb1-ca9d-495f-b876-55c825ca6edc None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:09.836040 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15aedb1-ca9d-495f-b876-55c825ca6edc None None] PATH_INFO: `/` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:09.837724 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 79/150] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 3 13:59:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 13:59:09.844750 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2173e409-157f-4b90-b9d0-d267ab85bb51 None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:09.845414 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2173e409-157f-4b90-b9d0-d267ab85bb51 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:09.845890 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2173e409-157f-4b90-b9d0-d267ab85bb51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:09.864036 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-2173e409-157f-4b90-b9d0-d267ab85bb51 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 13:59:09.865585 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-2173e409-157f-4b90-b9d0-d267ab85bb51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 13:59:09.954789 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 72/151] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 3 13:59:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 13:59:09.990642 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15aedb1-ca9d-495f-b876-55c825ca6edc None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:10.144633 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15aedb1-ca9d-495f-b876-55c825ca6edc None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:10.183336 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ce260f-6783-493b-b8f2-d654baacd2bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:10.184152 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ce260f-6783-493b-b8f2-d654baacd2bc None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:10.184436 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ce260f-6783-493b-b8f2-d654baacd2bc None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:10.184715 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ce260f-6783-493b-b8f2-d654baacd2bc None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:10.196467 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ce260f-6783-493b-b8f2-d654baacd2bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 13:59:10.204418 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application [None req-13ce260f-6783-493b-b8f2-d654baacd2bc None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 03 13:59:10.204418 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 13:59:10.204418 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 13:59:10.204418 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 13:59:10.204418 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 13:59:10.204418 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 13:59:10.204418 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 13:59:10.204418 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 13:59:10.204418 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 13:59:10.204418 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 13:59:10.204418 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 13:59:10.204418 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 13:59:10.204418 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 13:59:10.204418 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 13:59:10.204418 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 13:59:10.204418 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 13:59:10.205381 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 13:59:10.205381 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 13:59:10.205381 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 13:59:10.205381 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 13:59:10.205381 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 13:59:10.205381 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 13:59:10.205381 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 13:59:10.205381 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 13:59:10.205381 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 13:59:10.205381 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.get_or_create( May 03 13:59:10.205381 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 13:59:10.205381 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application with Lock( May 03 13:59:10.205381 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 13:59:10.205381 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._enter() May 03 13:59:10.205381 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 13:59:10.205381 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 13:59:10.206219 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 13:59:10.206219 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.creator() May 03 13:59:10.206219 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 13:59:10.206219 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application created_value = creator( May 03 13:59:10.206219 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 13:59:10.206219 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 13:59:10.206219 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 13:59:10.206219 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 13:59:10.206219 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 13:59:10.206219 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 13:59:10.206219 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 03 13:59:10.206219 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application May 03 13:59:10.206219 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 80/152] 10.222.0.36 () {56 vars in 1099 bytes} [Tue May 3 13:59:09 2022] GET /identity/v3/roles/reader => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 13:59:10.216200 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2173e409-157f-4b90-b9d0-d267ab85bb51 None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:10.330633 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2173e409-157f-4b90-b9d0-d267ab85bb51 None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:10.371155 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d003f97b-e648-442a-b69d-dd4d9139563a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:10.371844 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d003f97b-e648-442a-b69d-dd4d9139563a None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:10.372126 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d003f97b-e648-442a-b69d-dd4d9139563a None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:10.372403 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d003f97b-e648-442a-b69d-dd4d9139563a None admin] PATH_INFO: `/v3/roles` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:10.373162 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d003f97b-e648-442a-b69d-dd4d9139563a None admin] RBAC: Adding query filter params (name=reader) {{(pid=80012) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 13:59:10.373502 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d003f97b-e648-442a-b69d-dd4d9139563a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:10.375177 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d003f97b-e648-442a-b69d-dd4d9139563a None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:10.385480 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 73/153] 10.222.0.36 () {56 vars in 1101 bytes} [Tue May 3 13:59:10 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 13:59:10.391796 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ce260f-6783-493b-b8f2-d654baacd2bc None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:10.521797 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ce260f-6783-493b-b8f2-d654baacd2bc None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:10.560052 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5455fe3-7bee-4823-859f-d2566fb1e898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:10.560951 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5455fe3-7bee-4823-859f-d2566fb1e898 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:10.561235 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5455fe3-7bee-4823-859f-d2566fb1e898 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:10.561652 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5455fe3-7bee-4823-859f-d2566fb1e898 None admin] PATH_INFO: `/v3/users/ca59e1fd3bc04530a60400eaa7f6001b` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:10.563062 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5455fe3-7bee-4823-859f-d2566fb1e898 None admin] RBAC: Authorizing `identity:get_user(user_id=ca59e1fd3bc04530a60400eaa7f6001b)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:10.564564 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5455fe3-7bee-4823-859f-d2566fb1e898 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:10.566344 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 81/154] 10.222.0.36 () {56 vars in 1177 bytes} [Tue May 3 13:59:10 2022] GET /identity/v3/users/ca59e1fd3bc04530a60400eaa7f6001b => generated 289 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 13:59:10.572351 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d003f97b-e648-442a-b69d-dd4d9139563a None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:10.679000 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d003f97b-e648-442a-b69d-dd4d9139563a None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:10.712659 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8896081f-221d-4f00-89af-e6e63bb2c549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:10.713569 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8896081f-221d-4f00-89af-e6e63bb2c549 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:10.713856 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8896081f-221d-4f00-89af-e6e63bb2c549 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:10.714502 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8896081f-221d-4f00-89af-e6e63bb2c549 None admin] PATH_INFO: `/v3/projects/3256bc7158894136b4937ecc0a8b3073` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:10.715762 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8896081f-221d-4f00-89af-e6e63bb2c549 None admin] RBAC: Authorizing `identity:get_project(project_id=3256bc7158894136b4937ecc0a8b3073)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:10.717279 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8896081f-221d-4f00-89af-e6e63bb2c549 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:10.719190 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 74/155] 10.222.0.36 () {56 vars in 1186 bytes} [Tue May 3 13:59:10 2022] GET /identity/v3/projects/3256bc7158894136b4937ecc0a8b3073 => generated 298 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 13:59:10.725152 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5455fe3-7bee-4823-859f-d2566fb1e898 None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:10.807699 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f55e2d8-1676-41e2-9faa-6d05145641f5 None None] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:10.807980 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f55e2d8-1676-41e2-9faa-6d05145641f5 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:10.808236 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f55e2d8-1676-41e2-9faa-6d05145641f5 None None] PATH_INFO: `/` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:10.809655 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 75/156] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 3 13:59:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 13:59:10.815129 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d386454b-c461-46a9-a5ee-fd524a43443b None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:10.815411 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d386454b-c461-46a9-a5ee-fd524a43443b None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:10.815700 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d386454b-c461-46a9-a5ee-fd524a43443b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:10.843537 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-d386454b-c461-46a9-a5ee-fd524a43443b None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 13:59:10.846793 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-d386454b-c461-46a9-a5ee-fd524a43443b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 13:59:10.862640 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5455fe3-7bee-4823-859f-d2566fb1e898 None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:10.907985 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982cd4c1-0328-4abf-a30a-87a63cea3fd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:10.908894 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982cd4c1-0328-4abf-a30a-87a63cea3fd6 None admin] REQUEST_METHOD: `PUT` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:10.909173 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982cd4c1-0328-4abf-a30a-87a63cea3fd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:10.909481 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982cd4c1-0328-4abf-a30a-87a63cea3fd6 None admin] PATH_INFO: `/v3/projects/3256bc7158894136b4937ecc0a8b3073/users/ca59e1fd3bc04530a60400eaa7f6001b/roles/881b929165074739a253b35012fbc4fb` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:10.911568 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982cd4c1-0328-4abf-a30a-87a63cea3fd6 None admin] RBAC: Authorizing `identity:create_grant(project_id=3256bc7158894136b4937ecc0a8b3073, user_id=ca59e1fd3bc04530a60400eaa7f6001b, role_id=881b929165074739a253b35012fbc4fb)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:10.913134 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982cd4c1-0328-4abf-a30a-87a63cea3fd6 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:10.933308 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 82/157] 10.222.0.36 () {58 vars in 1439 bytes} [Tue May 3 13:59:10 2022] PUT /identity/v3/projects/3256bc7158894136b4937ecc0a8b3073/users/ca59e1fd3bc04530a60400eaa7f6001b/roles/881b929165074739a253b35012fbc4fb => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 13:59:10.991996 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 76/158] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 3 13:59:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 03 13:59:11.035945 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982cd4c1-0328-4abf-a30a-87a63cea3fd6 None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:11.138433 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd242f76-3932-42e9-969d-8e4fe68c3ebb None None] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:11.138755 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd242f76-3932-42e9-969d-8e4fe68c3ebb None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:11.139003 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd242f76-3932-42e9-969d-8e4fe68c3ebb None None] PATH_INFO: `/` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:11.141155 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 77/159] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 3 13:59:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 13:59:11.149076 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66db5de-6ac9-4f8e-ac4f-5da9520470e9 None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:11.149462 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66db5de-6ac9-4f8e-ac4f-5da9520470e9 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:11.149655 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66db5de-6ac9-4f8e-ac4f-5da9520470e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:11.163526 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982cd4c1-0328-4abf-a30a-87a63cea3fd6 None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:11.186463 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-b66db5de-6ac9-4f8e-ac4f-5da9520470e9 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 13:59:11.187920 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-b66db5de-6ac9-4f8e-ac4f-5da9520470e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 13:59:11.200036 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7218843b-a901-47e9-9d3f-d09a13c8c11b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:11.200904 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7218843b-a901-47e9-9d3f-d09a13c8c11b None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:11.201192 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7218843b-a901-47e9-9d3f-d09a13c8c11b None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:11.201498 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7218843b-a901-47e9-9d3f-d09a13c8c11b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:11.220305 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7218843b-a901-47e9-9d3f-d09a13c8c11b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 13:59:11.231027 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application [None req-7218843b-a901-47e9-9d3f-d09a13c8c11b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 03 13:59:11.231027 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 13:59:11.231027 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 13:59:11.231027 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 13:59:11.231027 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 13:59:11.231027 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 13:59:11.231027 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 13:59:11.231027 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 13:59:11.231027 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 13:59:11.231027 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 13:59:11.231027 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 13:59:11.231027 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 13:59:11.231027 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 13:59:11.231027 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 13:59:11.231027 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 13:59:11.231027 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 13:59:11.231997 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 13:59:11.231997 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 13:59:11.231997 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 13:59:11.231997 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 13:59:11.231997 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 13:59:11.231997 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 13:59:11.231997 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 13:59:11.231997 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 13:59:11.231997 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 13:59:11.231997 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.get_or_create( May 03 13:59:11.231997 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 13:59:11.231997 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application with Lock( May 03 13:59:11.231997 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 13:59:11.231997 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._enter() May 03 13:59:11.231997 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 13:59:11.231997 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 13:59:11.233578 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 13:59:11.233578 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.creator() May 03 13:59:11.233578 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 13:59:11.233578 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application created_value = creator( May 03 13:59:11.233578 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 13:59:11.233578 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 13:59:11.233578 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 13:59:11.233578 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 13:59:11.233578 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 13:59:11.233578 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 13:59:11.233578 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 03 13:59:11.233578 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application May 03 13:59:11.233578 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 83/160] 10.222.0.36 () {56 vars in 1099 bytes} [Tue May 3 13:59:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 13:59:11.239780 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7218843b-a901-47e9-9d3f-d09a13c8c11b None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:11.302326 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 78/161] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 3 13:59:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 03 13:59:11.326169 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66db5de-6ac9-4f8e-ac4f-5da9520470e9 None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:11.358737 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7218843b-a901-47e9-9d3f-d09a13c8c11b None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:11.392868 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ba62f2-ab5d-4e21-8ce0-7312aa332529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:11.393613 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ba62f2-ab5d-4e21-8ce0-7312aa332529 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:11.393888 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ba62f2-ab5d-4e21-8ce0-7312aa332529 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:11.394170 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ba62f2-ab5d-4e21-8ce0-7312aa332529 None admin] PATH_INFO: `/v3/roles` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:11.394992 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ba62f2-ab5d-4e21-8ce0-7312aa332529 None admin] RBAC: Adding query filter params (name=member) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 13:59:11.395297 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ba62f2-ab5d-4e21-8ce0-7312aa332529 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:11.396682 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ba62f2-ab5d-4e21-8ce0-7312aa332529 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:11.405381 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 84/162] 10.222.0.36 () {56 vars in 1101 bytes} [Tue May 3 13:59:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 13:59:11.406998 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e241327-2f64-439f-9d9b-a979489e82c1 None None] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:11.407315 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e241327-2f64-439f-9d9b-a979489e82c1 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:11.407551 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e241327-2f64-439f-9d9b-a979489e82c1 None None] PATH_INFO: `/` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:11.408797 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 85/163] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 3 13:59:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 13:59:11.414193 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba56e6ed-53b3-48a6-b269-0d70ef34e4a0 None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:11.414481 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba56e6ed-53b3-48a6-b269-0d70ef34e4a0 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:11.414759 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba56e6ed-53b3-48a6-b269-0d70ef34e4a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:11.426714 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66db5de-6ac9-4f8e-ac4f-5da9520470e9 None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:11.431399 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-ba56e6ed-53b3-48a6-b269-0d70ef34e4a0 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 13:59:11.432571 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-ba56e6ed-53b3-48a6-b269-0d70ef34e4a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 13:59:11.461070 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba57117-af79-4f80-bbe1-2394488f7f6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:11.461906 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba57117-af79-4f80-bbe1-2394488f7f6e None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:11.462183 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba57117-af79-4f80-bbe1-2394488f7f6e None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:11.462455 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba57117-af79-4f80-bbe1-2394488f7f6e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:11.473821 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba57117-af79-4f80-bbe1-2394488f7f6e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 13:59:11.481678 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application [None req-3ba57117-af79-4f80-bbe1-2394488f7f6e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 03 13:59:11.481678 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 13:59:11.481678 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 13:59:11.481678 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 13:59:11.481678 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 13:59:11.481678 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 13:59:11.481678 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 13:59:11.481678 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 13:59:11.481678 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 13:59:11.481678 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 13:59:11.481678 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 13:59:11.481678 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 13:59:11.481678 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 13:59:11.481678 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 13:59:11.481678 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 13:59:11.481678 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 13:59:11.483908 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 13:59:11.483908 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 13:59:11.483908 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 13:59:11.483908 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 13:59:11.483908 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 13:59:11.483908 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 13:59:11.483908 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 13:59:11.483908 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 13:59:11.483908 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 13:59:11.483908 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.get_or_create( May 03 13:59:11.483908 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 13:59:11.483908 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application with Lock( May 03 13:59:11.483908 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 13:59:11.483908 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._enter() May 03 13:59:11.483908 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 13:59:11.483908 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 13:59:11.485834 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 13:59:11.485834 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.creator() May 03 13:59:11.485834 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 13:59:11.485834 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application created_value = creator( May 03 13:59:11.485834 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 13:59:11.485834 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 13:59:11.485834 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 13:59:11.485834 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 13:59:11.485834 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 13:59:11.485834 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 13:59:11.485834 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 03 13:59:11.485834 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application May 03 13:59:11.485834 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 79/164] 10.222.0.36 () {56 vars in 1096 bytes} [Tue May 3 13:59:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 13:59:11.485834 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba57117-af79-4f80-bbe1-2394488f7f6e None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:11.499156 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 86/165] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 3 13:59:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 03 13:59:11.500079 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba56e6ed-53b3-48a6-b269-0d70ef34e4a0 None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:11.588187 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba57117-af79-4f80-bbe1-2394488f7f6e None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:11.600793 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba56e6ed-53b3-48a6-b269-0d70ef34e4a0 None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:11.622847 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0470125-9914-476d-a5c8-dc5d624777d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:11.623751 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0470125-9914-476d-a5c8-dc5d624777d8 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:11.624160 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0470125-9914-476d-a5c8-dc5d624777d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:11.624520 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0470125-9914-476d-a5c8-dc5d624777d8 None admin] PATH_INFO: `/v3/users/e9f93aa2136e485ab8827ada190d87ce` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:11.626439 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0470125-9914-476d-a5c8-dc5d624777d8 None admin] RBAC: Authorizing `identity:get_user(user_id=e9f93aa2136e485ab8827ada190d87ce)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:11.627919 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0470125-9914-476d-a5c8-dc5d624777d8 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:11.629702 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 80/166] 10.222.0.36 () {56 vars in 1177 bytes} [Tue May 3 13:59:11 2022] GET /identity/v3/users/e9f93aa2136e485ab8827ada190d87ce => generated 275 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 13:59:11.630531 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0470125-9914-476d-a5c8-dc5d624777d8 None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:11.635730 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ed48ce-48af-4b71-a66a-934f0968770e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:11.636762 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ed48ce-48af-4b71-a66a-934f0968770e None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:11.637047 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ed48ce-48af-4b71-a66a-934f0968770e None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:11.637341 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ed48ce-48af-4b71-a66a-934f0968770e None admin] PATH_INFO: `/v3/roles` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:11.638205 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ed48ce-48af-4b71-a66a-934f0968770e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 13:59:11.638510 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ed48ce-48af-4b71-a66a-934f0968770e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:11.639984 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ed48ce-48af-4b71-a66a-934f0968770e None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:11.648665 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 87/167] 10.222.0.36 () {56 vars in 1099 bytes} [Tue May 3 13:59:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 13:59:11.649617 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ed48ce-48af-4b71-a66a-934f0968770e None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:11.736535 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0470125-9914-476d-a5c8-dc5d624777d8 None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:11.750493 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ed48ce-48af-4b71-a66a-934f0968770e None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:11.770275 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b4bd26-e7ed-482f-af49-6df539b06187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:11.771096 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b4bd26-e7ed-482f-af49-6df539b06187 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:11.771380 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b4bd26-e7ed-482f-af49-6df539b06187 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:11.771657 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b4bd26-e7ed-482f-af49-6df539b06187 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:11.786780 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b4bd26-e7ed-482f-af49-6df539b06187 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 13:59:11.798418 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a42104-f583-4494-bcbf-bec3f0e4af90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:11.799068 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a42104-f583-4494-bcbf-bec3f0e4af90 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:11.799346 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a42104-f583-4494-bcbf-bec3f0e4af90 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:11.799619 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a42104-f583-4494-bcbf-bec3f0e4af90 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:11.801099 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application [None req-53b4bd26-e7ed-482f-af49-6df539b06187 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 03 13:59:11.801099 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 13:59:11.801099 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 13:59:11.801099 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 13:59:11.801099 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 13:59:11.801099 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 13:59:11.801099 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 13:59:11.801099 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 13:59:11.801099 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 13:59:11.801099 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 13:59:11.801099 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 13:59:11.801099 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 13:59:11.801099 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 13:59:11.801099 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 13:59:11.801099 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 13:59:11.801099 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 13:59:11.803098 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 13:59:11.803098 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 13:59:11.803098 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 13:59:11.803098 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 13:59:11.803098 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 13:59:11.803098 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 13:59:11.803098 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 13:59:11.803098 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 13:59:11.803098 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 13:59:11.803098 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.get_or_create( May 03 13:59:11.803098 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 13:59:11.803098 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application with Lock( May 03 13:59:11.803098 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 13:59:11.803098 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._enter() May 03 13:59:11.803098 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 13:59:11.803098 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 13:59:11.804981 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 13:59:11.804981 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.creator() May 03 13:59:11.804981 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 13:59:11.804981 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application created_value = creator( May 03 13:59:11.804981 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 13:59:11.804981 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 13:59:11.804981 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 13:59:11.804981 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 13:59:11.804981 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 13:59:11.804981 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 13:59:11.804981 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 03 13:59:11.804981 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application May 03 13:59:11.804981 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 81/168] 10.222.0.36 () {56 vars in 1114 bytes} [Tue May 3 13:59:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 13:59:11.813314 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b4bd26-e7ed-482f-af49-6df539b06187 None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:11.922561 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a42104-f583-4494-bcbf-bec3f0e4af90 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:11.923986 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a42104-f583-4494-bcbf-bec3f0e4af90 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:11.980403 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b4bd26-e7ed-482f-af49-6df539b06187 None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:12.041105 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e833f233-0bfa-45ac-ad12-130688c200de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:12.046604 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e833f233-0bfa-45ac-ad12-130688c200de None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:12.046604 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e833f233-0bfa-45ac-ad12-130688c200de None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:12.046604 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e833f233-0bfa-45ac-ad12-130688c200de None admin] PATH_INFO: `/v3/users/87a3e2c426774a3eba9534209ef0a44b` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:12.046604 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e833f233-0bfa-45ac-ad12-130688c200de None admin] RBAC: Authorizing `identity:get_user(user_id=87a3e2c426774a3eba9534209ef0a44b)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:12.046604 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e833f233-0bfa-45ac-ad12-130688c200de None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:12.047325 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 82/169] 10.222.0.36 () {56 vars in 1177 bytes} [Tue May 3 13:59:11 2022] GET /identity/v3/users/87a3e2c426774a3eba9534209ef0a44b => generated 247 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 13:59:12.052454 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e833f233-0bfa-45ac-ad12-130688c200de None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:12.136417 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 88/170] 10.222.0.36 () {58 vars in 1282 bytes} [Tue May 3 13:59:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 487 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 03 13:59:12.137297 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a42104-f583-4494-bcbf-bec3f0e4af90 None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:12.159145 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e833f233-0bfa-45ac-ad12-130688c200de None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:12.192552 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a1d782-a471-4dcd-b704-f54261a0cb83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:12.193151 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a1d782-a471-4dcd-b704-f54261a0cb83 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:12.193518 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a1d782-a471-4dcd-b704-f54261a0cb83 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:12.193800 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a1d782-a471-4dcd-b704-f54261a0cb83 None admin] PATH_INFO: `/v3/roles` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:12.194550 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a1d782-a471-4dcd-b704-f54261a0cb83 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80012) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 13:59:12.194859 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a1d782-a471-4dcd-b704-f54261a0cb83 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:12.196299 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a1d782-a471-4dcd-b704-f54261a0cb83 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:12.205275 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 83/171] 10.222.0.36 () {56 vars in 1111 bytes} [Tue May 3 13:59:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 13:59:12.206136 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a1d782-a471-4dcd-b704-f54261a0cb83 None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:12.307480 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a1d782-a471-4dcd-b704-f54261a0cb83 None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:12.341197 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79b2513-da85-419b-af4a-58556727de9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:12.342154 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79b2513-da85-419b-af4a-58556727de9f None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:12.342435 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79b2513-da85-419b-af4a-58556727de9f None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:12.342788 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79b2513-da85-419b-af4a-58556727de9f None admin] PATH_INFO: `/v3/projects/ef261a2208534afcaa981ebd3e012d44` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:12.343998 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79b2513-da85-419b-af4a-58556727de9f None admin] RBAC: Authorizing `identity:get_project(project_id=ef261a2208534afcaa981ebd3e012d44)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:12.345489 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79b2513-da85-419b-af4a-58556727de9f None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:12.347553 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 84/172] 10.222.0.36 () {56 vars in 1186 bytes} [Tue May 3 13:59:12 2022] GET /identity/v3/projects/ef261a2208534afcaa981ebd3e012d44 => generated 312 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 13:59:12.348329 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79b2513-da85-419b-af4a-58556727de9f None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:12.396866 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a42104-f583-4494-bcbf-bec3f0e4af90 None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:12.448324 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79b2513-da85-419b-af4a-58556727de9f None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:12.482213 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5120294f-a912-4f96-8fe4-cd5215b09d0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:12.482563 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444c7227-d3e2-492c-843d-8c38e148847d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:12.483099 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5120294f-a912-4f96-8fe4-cd5215b09d0a None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:12.483272 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444c7227-d3e2-492c-843d-8c38e148847d None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:12.483529 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5120294f-a912-4f96-8fe4-cd5215b09d0a None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:12.483677 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444c7227-d3e2-492c-843d-8c38e148847d None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:12.483829 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5120294f-a912-4f96-8fe4-cd5215b09d0a None admin] PATH_INFO: `/v3/users/e9f93aa2136e485ab8827ada190d87ce` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:12.483970 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444c7227-d3e2-492c-843d-8c38e148847d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:12.484977 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5120294f-a912-4f96-8fe4-cd5215b09d0a None admin] RBAC: Authorizing `identity:get_user(user_id=e9f93aa2136e485ab8827ada190d87ce)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:12.486575 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5120294f-a912-4f96-8fe4-cd5215b09d0a None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:12.488524 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 85/173] 10.222.0.36 () {56 vars in 1177 bytes} [Tue May 3 13:59:12 2022] GET /identity/v3/users/e9f93aa2136e485ab8827ada190d87ce => generated 275 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 13:59:12.489313 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5120294f-a912-4f96-8fe4-cd5215b09d0a None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:12.587999 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5120294f-a912-4f96-8fe4-cd5215b09d0a None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:12.622748 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0d755b-25f0-4577-a6d8-8b91469cecb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:12.623448 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0d755b-25f0-4577-a6d8-8b91469cecb7 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:12.624342 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0d755b-25f0-4577-a6d8-8b91469cecb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:12.624342 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0d755b-25f0-4577-a6d8-8b91469cecb7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:12.624873 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0d755b-25f0-4577-a6d8-8b91469cecb7 None admin] RBAC: Adding query filter params (role.id=441fdc11e95b47f4813f72610e39018b, scope.project.id=ef261a2208534afcaa981ebd3e012d44, user.id=e9f93aa2136e485ab8827ada190d87ce) {{(pid=80012) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 13:59:12.625186 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0d755b-25f0-4577-a6d8-8b91469cecb7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:12.627037 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0d755b-25f0-4577-a6d8-8b91469cecb7 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:12.633376 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 86/174] 10.222.0.36 () {56 vars in 1374 bytes} [Tue May 3 13:59:12 2022] GET /identity/v3/role_assignments?user.id=e9f93aa2136e485ab8827ada190d87ce&scope.project.id=ef261a2208534afcaa981ebd3e012d44&role.id=441fdc11e95b47f4813f72610e39018b => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 13:59:12.634260 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0d755b-25f0-4577-a6d8-8b91469cecb7 None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:12.638337 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444c7227-d3e2-492c-843d-8c38e148847d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:12.639852 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444c7227-d3e2-492c-843d-8c38e148847d None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:12.740858 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0d755b-25f0-4577-a6d8-8b91469cecb7 None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:12.775925 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f57e3b-de46-44c7-aa20-9f0454e56276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:12.776592 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f57e3b-de46-44c7-aa20-9f0454e56276 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:12.776871 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f57e3b-de46-44c7-aa20-9f0454e56276 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:12.777151 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f57e3b-de46-44c7-aa20-9f0454e56276 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:12.848168 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f57e3b-de46-44c7-aa20-9f0454e56276 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:12.849692 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f57e3b-de46-44c7-aa20-9f0454e56276 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:12.862451 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 89/175] 10.222.0.36 () {58 vars in 1282 bytes} [Tue May 3 13:59:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 725 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 03 13:59:12.886236 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444c7227-d3e2-492c-843d-8c38e148847d None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:12.956738 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 87/176] 10.222.0.36 () {58 vars in 1282 bytes} [Tue May 3 13:59:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 03 13:59:12.962552 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f57e3b-de46-44c7-aa20-9f0454e56276 None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:13.032361 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444c7227-d3e2-492c-843d-8c38e148847d None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:13.064364 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f57e3b-de46-44c7-aa20-9f0454e56276 None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:13.086138 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18363f26-1938-435f-a335-bd6ea0266fe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:13.087022 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18363f26-1938-435f-a335-bd6ea0266fe5 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:13.087296 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18363f26-1938-435f-a335-bd6ea0266fe5 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:13.087570 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18363f26-1938-435f-a335-bd6ea0266fe5 None admin] PATH_INFO: `/v3/projects/3256bc7158894136b4937ecc0a8b3073` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:13.088829 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18363f26-1938-435f-a335-bd6ea0266fe5 None admin] RBAC: Authorizing `identity:get_project(project_id=3256bc7158894136b4937ecc0a8b3073)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:13.090619 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18363f26-1938-435f-a335-bd6ea0266fe5 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:13.092338 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 90/177] 10.222.0.36 () {56 vars in 1186 bytes} [Tue May 3 13:59:12 2022] GET /identity/v3/projects/3256bc7158894136b4937ecc0a8b3073 => generated 298 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 13:59:13.102406 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18363f26-1938-435f-a335-bd6ea0266fe5 None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:13.106400 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9c4cbc-1385-4131-bfd1-405a2be765e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:13.107506 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9c4cbc-1385-4131-bfd1-405a2be765e7 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:13.107968 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9c4cbc-1385-4131-bfd1-405a2be765e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:13.108520 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9c4cbc-1385-4131-bfd1-405a2be765e7 None admin] PATH_INFO: `/v3/projects/3256bc7158894136b4937ecc0a8b3073` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:13.109997 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9c4cbc-1385-4131-bfd1-405a2be765e7 None admin] RBAC: Authorizing `identity:get_project(project_id=3256bc7158894136b4937ecc0a8b3073)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:13.111650 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9c4cbc-1385-4131-bfd1-405a2be765e7 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:13.113904 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 88/178] 10.222.0.36 () {56 vars in 1186 bytes} [Tue May 3 13:59:12 2022] GET /identity/v3/projects/3256bc7158894136b4937ecc0a8b3073 => generated 298 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 13:59:13.119939 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9c4cbc-1385-4131-bfd1-405a2be765e7 None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:13.203588 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18363f26-1938-435f-a335-bd6ea0266fe5 None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:13.237222 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdaee29-f932-4aa1-bdb1-90fd28f7b5a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:13.237908 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdaee29-f932-4aa1-bdb1-90fd28f7b5a5 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:13.238185 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdaee29-f932-4aa1-bdb1-90fd28f7b5a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:13.238454 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdaee29-f932-4aa1-bdb1-90fd28f7b5a5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:13.239324 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdaee29-f932-4aa1-bdb1-90fd28f7b5a5 None admin] RBAC: Adding query filter params (role.id=36abe9b50fd8479c86c4f8f70fd85aa3, scope.project.id=3256bc7158894136b4937ecc0a8b3073, user.id=87a3e2c426774a3eba9534209ef0a44b) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 13:59:13.239575 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdaee29-f932-4aa1-bdb1-90fd28f7b5a5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:13.241006 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdaee29-f932-4aa1-bdb1-90fd28f7b5a5 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:13.248019 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 91/179] 10.222.0.36 () {56 vars in 1374 bytes} [Tue May 3 13:59:13 2022] GET /identity/v3/role_assignments?user.id=87a3e2c426774a3eba9534209ef0a44b&scope.project.id=3256bc7158894136b4937ecc0a8b3073&role.id=36abe9b50fd8479c86c4f8f70fd85aa3 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 13:59:13.266144 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9c4cbc-1385-4131-bfd1-405a2be765e7 None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:13.311489 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170505d4-cafa-4ccb-b9c3-b5f6e619199d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:13.312074 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170505d4-cafa-4ccb-b9c3-b5f6e619199d None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:13.312356 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170505d4-cafa-4ccb-b9c3-b5f6e619199d None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:13.312621 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170505d4-cafa-4ccb-b9c3-b5f6e619199d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:13.313495 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170505d4-cafa-4ccb-b9c3-b5f6e619199d None admin] RBAC: Adding query filter params (role.id=bd29d35ea39b4ba293ffbf1ffbf4b940, scope.project.id=3256bc7158894136b4937ecc0a8b3073, user.id=e9f93aa2136e485ab8827ada190d87ce) {{(pid=80012) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 13:59:13.313804 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170505d4-cafa-4ccb-b9c3-b5f6e619199d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:13.315289 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170505d4-cafa-4ccb-b9c3-b5f6e619199d None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:13.326710 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 89/180] 10.222.0.36 () {56 vars in 1374 bytes} [Tue May 3 13:59:13 2022] GET /identity/v3/role_assignments?user.id=e9f93aa2136e485ab8827ada190d87ce&scope.project.id=3256bc7158894136b4937ecc0a8b3073&role.id=bd29d35ea39b4ba293ffbf1ffbf4b940 => generated 608 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 13:59:13.944052 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54cb6b2-056e-4074-ae93-aedf8a41c49c None None] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:13.944567 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54cb6b2-056e-4074-ae93-aedf8a41c49c None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:13.944671 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54cb6b2-056e-4074-ae93-aedf8a41c49c None None] PATH_INFO: `/` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:13.946160 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 92/181] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 3 13:59:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 13:59:13.952621 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6573da10-1a53-4d87-b6c9-42b59990ccf1 None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:13.953333 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6573da10-1a53-4d87-b6c9-42b59990ccf1 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:13.953333 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6573da10-1a53-4d87-b6c9-42b59990ccf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:13.973422 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-6573da10-1a53-4d87-b6c9-42b59990ccf1 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 13:59:13.974596 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-6573da10-1a53-4d87-b6c9-42b59990ccf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 13:59:14.057086 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 90/182] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 3 13:59:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 13:59:14.083434 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54cb6b2-056e-4074-ae93-aedf8a41c49c None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:14.195414 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54cb6b2-056e-4074-ae93-aedf8a41c49c None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:14.232436 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd598ca-e975-40da-8c46-29a80f866dfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:14.233256 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd598ca-e975-40da-8c46-29a80f866dfb None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:14.233769 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd598ca-e975-40da-8c46-29a80f866dfb None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:14.234057 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd598ca-e975-40da-8c46-29a80f866dfb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:14.246661 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd598ca-e975-40da-8c46-29a80f866dfb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 13:59:14.254618 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application [None req-fdd598ca-e975-40da-8c46-29a80f866dfb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 03 13:59:14.254618 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 13:59:14.254618 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 13:59:14.254618 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 13:59:14.254618 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 13:59:14.254618 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 13:59:14.254618 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 13:59:14.254618 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 13:59:14.254618 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 13:59:14.254618 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 13:59:14.254618 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 13:59:14.254618 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 13:59:14.254618 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 13:59:14.254618 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 13:59:14.254618 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 13:59:14.254618 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 13:59:14.255641 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 13:59:14.255641 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 13:59:14.255641 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 13:59:14.255641 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 13:59:14.255641 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 13:59:14.255641 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 13:59:14.255641 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 13:59:14.255641 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 13:59:14.255641 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 13:59:14.255641 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.get_or_create( May 03 13:59:14.255641 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 13:59:14.255641 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application with Lock( May 03 13:59:14.255641 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 13:59:14.255641 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._enter() May 03 13:59:14.255641 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 13:59:14.255641 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 13:59:14.257391 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 13:59:14.257391 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.creator() May 03 13:59:14.257391 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 13:59:14.257391 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application created_value = creator( May 03 13:59:14.257391 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 13:59:14.257391 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 13:59:14.257391 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 13:59:14.257391 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 13:59:14.257391 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 13:59:14.257391 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 13:59:14.257391 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 03 13:59:14.257391 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application May 03 13:59:14.257391 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 93/183] 10.222.0.36 () {56 vars in 1096 bytes} [Tue May 3 13:59:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 13:59:14.262176 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6573da10-1a53-4d87-b6c9-42b59990ccf1 None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:14.362008 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6573da10-1a53-4d87-b6c9-42b59990ccf1 None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:14.395537 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c8f433-8172-42a7-b95d-3da42563a180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:14.396212 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c8f433-8172-42a7-b95d-3da42563a180 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:14.396491 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c8f433-8172-42a7-b95d-3da42563a180 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:14.396765 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c8f433-8172-42a7-b95d-3da42563a180 None admin] PATH_INFO: `/v3/roles` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:14.397545 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c8f433-8172-42a7-b95d-3da42563a180 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80012) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 13:59:14.397850 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c8f433-8172-42a7-b95d-3da42563a180 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:14.399226 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c8f433-8172-42a7-b95d-3da42563a180 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:14.407771 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 91/184] 10.222.0.36 () {56 vars in 1099 bytes} [Tue May 3 13:59:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 13:59:14.413523 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd598ca-e975-40da-8c46-29a80f866dfb None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:14.418569 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc887c9-258e-422f-9ccf-9086c3f1717d None None] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:14.418859 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc887c9-258e-422f-9ccf-9086c3f1717d None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:14.419139 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc887c9-258e-422f-9ccf-9086c3f1717d None None] PATH_INFO: `/` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:14.420702 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 92/185] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 3 13:59:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 13:59:14.425979 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03ae04d-7472-47f3-8afd-f11238442680 None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:14.426267 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03ae04d-7472-47f3-8afd-f11238442680 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:14.426549 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03ae04d-7472-47f3-8afd-f11238442680 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:14.443653 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-b03ae04d-7472-47f3-8afd-f11238442680 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 13:59:14.444854 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-b03ae04d-7472-47f3-8afd-f11238442680 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 13:59:14.513621 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 93/186] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 3 13:59:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 03 13:59:14.513621 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f4fbb6-00c1-4a72-bc01-3d39d3076d78 None None] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:14.513621 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f4fbb6-00c1-4a72-bc01-3d39d3076d78 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:14.513621 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f4fbb6-00c1-4a72-bc01-3d39d3076d78 None None] PATH_INFO: `/` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:14.518207 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 94/187] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 3 13:59:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 13:59:14.519382 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cbd2e4-7087-4d18-b54c-14056bc3f460 None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:14.519663 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cbd2e4-7087-4d18-b54c-14056bc3f460 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:14.519929 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cbd2e4-7087-4d18-b54c-14056bc3f460 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:14.529373 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd598ca-e975-40da-8c46-29a80f866dfb None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:14.540808 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-61cbd2e4-7087-4d18-b54c-14056bc3f460 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 13:59:14.542229 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-61cbd2e4-7087-4d18-b54c-14056bc3f460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 13:59:14.563598 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2393f19b-cf80-4e53-aba3-d0415f7cf748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:14.564486 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2393f19b-cf80-4e53-aba3-d0415f7cf748 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:14.564765 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2393f19b-cf80-4e53-aba3-d0415f7cf748 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:14.565041 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2393f19b-cf80-4e53-aba3-d0415f7cf748 None admin] PATH_INFO: `/v3/users/b8b1e0fcb00a456ca08ac64d408e47a0` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:14.578165 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2393f19b-cf80-4e53-aba3-d0415f7cf748 None admin] RBAC: Authorizing `identity:get_user(user_id=b8b1e0fcb00a456ca08ac64d408e47a0)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:14.579617 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2393f19b-cf80-4e53-aba3-d0415f7cf748 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:14.585747 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 94/188] 10.222.0.36 () {56 vars in 1177 bytes} [Tue May 3 13:59:14 2022] GET /identity/v3/users/b8b1e0fcb00a456ca08ac64d408e47a0 => generated 283 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 13:59:14.585747 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2393f19b-cf80-4e53-aba3-d0415f7cf748 None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:14.606202 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 95/189] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 3 13:59:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 13:59:14.607046 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cbd2e4-7087-4d18-b54c-14056bc3f460 None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:14.697603 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2393f19b-cf80-4e53-aba3-d0415f7cf748 None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:14.710297 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cbd2e4-7087-4d18-b54c-14056bc3f460 None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:14.731508 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599a17e7-b916-44c8-bc77-7adb52543b77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:14.732331 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599a17e7-b916-44c8-bc77-7adb52543b77 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:14.732611 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599a17e7-b916-44c8-bc77-7adb52543b77 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:14.732872 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599a17e7-b916-44c8-bc77-7adb52543b77 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:14.743191 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599a17e7-b916-44c8-bc77-7adb52543b77 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 13:59:14.743658 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2786497-5e56-4dc7-b919-1029beb4830a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:14.744306 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2786497-5e56-4dc7-b919-1029beb4830a None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:14.744586 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2786497-5e56-4dc7-b919-1029beb4830a None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:14.744858 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2786497-5e56-4dc7-b919-1029beb4830a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:14.750945 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application [None req-599a17e7-b916-44c8-bc77-7adb52543b77 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 03 13:59:14.750945 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 13:59:14.750945 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 13:59:14.750945 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 13:59:14.750945 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 13:59:14.750945 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 13:59:14.750945 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 13:59:14.750945 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 13:59:14.750945 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 13:59:14.750945 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 13:59:14.750945 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 13:59:14.750945 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 13:59:14.750945 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 13:59:14.750945 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 13:59:14.750945 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 13:59:14.750945 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 13:59:14.751822 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 13:59:14.751822 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 13:59:14.751822 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 13:59:14.751822 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 13:59:14.751822 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 13:59:14.751822 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 13:59:14.751822 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 13:59:14.751822 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 13:59:14.751822 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 13:59:14.751822 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.get_or_create( May 03 13:59:14.751822 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 13:59:14.751822 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application with Lock( May 03 13:59:14.751822 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 13:59:14.751822 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._enter() May 03 13:59:14.751822 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 13:59:14.751822 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 13:59:14.752645 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 13:59:14.752645 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.creator() May 03 13:59:14.752645 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 13:59:14.752645 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application created_value = creator( May 03 13:59:14.752645 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 13:59:14.752645 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 13:59:14.752645 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 13:59:14.752645 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 13:59:14.752645 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 13:59:14.752645 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 13:59:14.752645 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 03 13:59:14.752645 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application May 03 13:59:14.752645 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 95/190] 10.222.0.36 () {56 vars in 1099 bytes} [Tue May 3 13:59:14 2022] GET /identity/v3/roles/reader => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 13:59:14.753329 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599a17e7-b916-44c8-bc77-7adb52543b77 None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:14.815659 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2786497-5e56-4dc7-b919-1029beb4830a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:14.817053 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2786497-5e56-4dc7-b919-1029beb4830a None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:14.847854 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599a17e7-b916-44c8-bc77-7adb52543b77 None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:14.882819 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4744f80-d01d-4460-b413-c054e4e8f441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:14.883628 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4744f80-d01d-4460-b413-c054e4e8f441 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:14.883908 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4744f80-d01d-4460-b413-c054e4e8f441 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:14.884179 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4744f80-d01d-4460-b413-c054e4e8f441 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:14.894019 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4744f80-d01d-4460-b413-c054e4e8f441 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 13:59:14.902055 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application [None req-c4744f80-d01d-4460-b413-c054e4e8f441 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 03 13:59:14.902055 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 13:59:14.902055 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 13:59:14.902055 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 13:59:14.902055 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 13:59:14.902055 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 13:59:14.902055 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 13:59:14.902055 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 13:59:14.902055 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 13:59:14.902055 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 13:59:14.902055 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 13:59:14.902055 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 13:59:14.902055 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 13:59:14.902055 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 13:59:14.902055 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 13:59:14.902055 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 13:59:14.902984 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 13:59:14.902984 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 13:59:14.902984 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 13:59:14.902984 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 13:59:14.902984 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 13:59:14.902984 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 13:59:14.902984 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 13:59:14.902984 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 13:59:14.902984 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 13:59:14.902984 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.get_or_create( May 03 13:59:14.902984 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 13:59:14.902984 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application with Lock( May 03 13:59:14.902984 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 13:59:14.902984 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._enter() May 03 13:59:14.902984 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 13:59:14.902984 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 13:59:14.903792 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 13:59:14.903792 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.creator() May 03 13:59:14.903792 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 13:59:14.903792 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application created_value = creator( May 03 13:59:14.903792 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 13:59:14.903792 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 13:59:14.903792 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 13:59:14.903792 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 13:59:14.903792 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 13:59:14.903792 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 13:59:14.903792 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 03 13:59:14.903792 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application May 03 13:59:14.903792 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 96/191] 10.222.0.36 () {56 vars in 1114 bytes} [Tue May 3 13:59:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 13:59:14.904588 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4744f80-d01d-4460-b413-c054e4e8f441 None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:14.919911 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 96/192] 10.222.0.36 () {58 vars in 1282 bytes} [Tue May 3 13:59:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 03 13:59:14.919911 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c88234-cbf7-4a0e-9359-0b7e7b3a99ca None None] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:14.919911 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c88234-cbf7-4a0e-9359-0b7e7b3a99ca None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:14.919911 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c88234-cbf7-4a0e-9359-0b7e7b3a99ca None None] PATH_INFO: `/` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:14.919911 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 97/193] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 3 13:59:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 13:59:14.920598 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c88234-cbf7-4a0e-9359-0b7e7b3a99ca None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:14.997310 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4744f80-d01d-4460-b413-c054e4e8f441 None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:15.021882 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c88234-cbf7-4a0e-9359-0b7e7b3a99ca None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:15.028810 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b7562d-2fbe-4a33-8ec3-bf2474efe410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:15.029529 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b7562d-2fbe-4a33-8ec3-bf2474efe410 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:15.029800 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b7562d-2fbe-4a33-8ec3-bf2474efe410 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:15.030054 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b7562d-2fbe-4a33-8ec3-bf2474efe410 None admin] PATH_INFO: `/v3/roles` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:15.030844 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b7562d-2fbe-4a33-8ec3-bf2474efe410 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 13:59:15.031148 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b7562d-2fbe-4a33-8ec3-bf2474efe410 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:15.032526 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b7562d-2fbe-4a33-8ec3-bf2474efe410 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:15.040370 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 97/194] 10.222.0.36 () {56 vars in 1101 bytes} [Tue May 3 13:59:14 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 13:59:15.041134 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b7562d-2fbe-4a33-8ec3-bf2474efe410 None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:15.055342 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa924fd3-0de8-4d31-acc6-3e7b7145ba3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:15.056018 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa924fd3-0de8-4d31-acc6-3e7b7145ba3d None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:15.056270 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa924fd3-0de8-4d31-acc6-3e7b7145ba3d None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:15.056565 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa924fd3-0de8-4d31-acc6-3e7b7145ba3d None admin] PATH_INFO: `/v3/roles` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:15.057320 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa924fd3-0de8-4d31-acc6-3e7b7145ba3d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80012) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 13:59:15.057646 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa924fd3-0de8-4d31-acc6-3e7b7145ba3d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:15.059199 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa924fd3-0de8-4d31-acc6-3e7b7145ba3d None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:15.073786 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 98/195] 10.222.0.36 () {56 vars in 1111 bytes} [Tue May 3 13:59:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 13:59:15.073786 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0ea8b3-9f86-4639-9e6b-3210c5494993 None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:15.073786 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0ea8b3-9f86-4639-9e6b-3210c5494993 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:15.073786 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0ea8b3-9f86-4639-9e6b-3210c5494993 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:15.087560 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-ee0ea8b3-9f86-4639-9e6b-3210c5494993 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 13:59:15.088733 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-ee0ea8b3-9f86-4639-9e6b-3210c5494993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 13:59:15.137730 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b7562d-2fbe-4a33-8ec3-bf2474efe410 None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:15.153185 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 99/196] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 3 13:59:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 13:59:15.154050 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0ea8b3-9f86-4639-9e6b-3210c5494993 None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:15.175433 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873dc0e4-45b6-449a-a701-aef09d5f66a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:15.176312 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873dc0e4-45b6-449a-a701-aef09d5f66a6 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:15.176603 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873dc0e4-45b6-449a-a701-aef09d5f66a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:15.176867 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873dc0e4-45b6-449a-a701-aef09d5f66a6 None admin] PATH_INFO: `/v3/projects/446967649a7d47af8f0eb54b376ac1fa` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:15.178258 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873dc0e4-45b6-449a-a701-aef09d5f66a6 None admin] RBAC: Authorizing `identity:get_project(project_id=446967649a7d47af8f0eb54b376ac1fa)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:15.179740 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873dc0e4-45b6-449a-a701-aef09d5f66a6 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:15.181492 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 98/197] 10.222.0.36 () {56 vars in 1186 bytes} [Tue May 3 13:59:15 2022] GET /identity/v3/projects/446967649a7d47af8f0eb54b376ac1fa => generated 302 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 13:59:15.183342 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873dc0e4-45b6-449a-a701-aef09d5f66a6 None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:15.249414 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0ea8b3-9f86-4639-9e6b-3210c5494993 None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:15.275586 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873dc0e4-45b6-449a-a701-aef09d5f66a6 None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:15.282530 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5028dd3-12a8-4061-827c-4a90154e0860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:15.283410 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5028dd3-12a8-4061-827c-4a90154e0860 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:15.283687 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5028dd3-12a8-4061-827c-4a90154e0860 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:15.283961 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5028dd3-12a8-4061-827c-4a90154e0860 None admin] PATH_INFO: `/v3/users/ca59e1fd3bc04530a60400eaa7f6001b` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:15.285167 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5028dd3-12a8-4061-827c-4a90154e0860 None admin] RBAC: Authorizing `identity:get_user(user_id=ca59e1fd3bc04530a60400eaa7f6001b)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:15.286675 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5028dd3-12a8-4061-827c-4a90154e0860 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:15.288312 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 100/198] 10.222.0.36 () {56 vars in 1177 bytes} [Tue May 3 13:59:15 2022] GET /identity/v3/users/ca59e1fd3bc04530a60400eaa7f6001b => generated 289 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 13:59:15.289060 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5028dd3-12a8-4061-827c-4a90154e0860 None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:15.308983 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bad64b-5961-42f2-953d-b71aebf23fcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:15.309879 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bad64b-5961-42f2-953d-b71aebf23fcc None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:15.310151 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bad64b-5961-42f2-953d-b71aebf23fcc None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:15.310418 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bad64b-5961-42f2-953d-b71aebf23fcc None admin] PATH_INFO: `/v3/users/b8b1e0fcb00a456ca08ac64d408e47a0` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:15.311628 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bad64b-5961-42f2-953d-b71aebf23fcc None admin] RBAC: Authorizing `identity:get_user(user_id=b8b1e0fcb00a456ca08ac64d408e47a0)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:15.313063 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bad64b-5961-42f2-953d-b71aebf23fcc None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:15.314700 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 99/199] 10.222.0.36 () {56 vars in 1177 bytes} [Tue May 3 13:59:15 2022] GET /identity/v3/users/b8b1e0fcb00a456ca08ac64d408e47a0 => generated 283 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 13:59:15.318106 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bad64b-5961-42f2-953d-b71aebf23fcc None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:15.384199 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5028dd3-12a8-4061-827c-4a90154e0860 None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:15.411108 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bad64b-5961-42f2-953d-b71aebf23fcc None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:15.415505 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ea80f3-dddc-4bd9-9538-37d43c634675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:15.416301 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ea80f3-dddc-4bd9-9538-37d43c634675 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:15.416583 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ea80f3-dddc-4bd9-9538-37d43c634675 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:15.416857 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ea80f3-dddc-4bd9-9538-37d43c634675 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:15.418046 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ea80f3-dddc-4bd9-9538-37d43c634675 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:15.419467 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ea80f3-dddc-4bd9-9538-37d43c634675 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:15.421510 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 101/200] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 3 13:59:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 13:59:15.422131 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ea80f3-dddc-4bd9-9538-37d43c634675 None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:15.442875 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5878d2a9-0404-4655-8234-8a0d52d05236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:15.443493 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5878d2a9-0404-4655-8234-8a0d52d05236 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:15.443767 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5878d2a9-0404-4655-8234-8a0d52d05236 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:15.444033 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5878d2a9-0404-4655-8234-8a0d52d05236 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:15.444855 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5878d2a9-0404-4655-8234-8a0d52d05236 None admin] RBAC: Adding query filter params (role.id=36abe9b50fd8479c86c4f8f70fd85aa3, scope.project.id=446967649a7d47af8f0eb54b376ac1fa, user.id=b8b1e0fcb00a456ca08ac64d408e47a0) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 13:59:15.445157 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5878d2a9-0404-4655-8234-8a0d52d05236 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:15.446614 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5878d2a9-0404-4655-8234-8a0d52d05236 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:15.451995 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 100/201] 10.222.0.36 () {56 vars in 1374 bytes} [Tue May 3 13:59:15 2022] GET /identity/v3/role_assignments?user.id=b8b1e0fcb00a456ca08ac64d408e47a0&scope.project.id=446967649a7d47af8f0eb54b376ac1fa&role.id=36abe9b50fd8479c86c4f8f70fd85aa3 => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 13:59:15.452844 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5878d2a9-0404-4655-8234-8a0d52d05236 None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:15.524643 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ea80f3-dddc-4bd9-9538-37d43c634675 None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:15.559963 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed66608-e753-49eb-a6db-6b5a2db82ee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:15.560631 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed66608-e753-49eb-a6db-6b5a2db82ee9 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:15.560921 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed66608-e753-49eb-a6db-6b5a2db82ee9 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:15.561194 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed66608-e753-49eb-a6db-6b5a2db82ee9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:15.565553 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5878d2a9-0404-4655-8234-8a0d52d05236 None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:15.599520 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699a9d53-9667-457d-a04f-289bcdf3f3b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:15.600187 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699a9d53-9667-457d-a04f-289bcdf3f3b2 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:15.600468 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699a9d53-9667-457d-a04f-289bcdf3f3b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:15.600747 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699a9d53-9667-457d-a04f-289bcdf3f3b2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:15.634077 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed66608-e753-49eb-a6db-6b5a2db82ee9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:15.635619 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed66608-e753-49eb-a6db-6b5a2db82ee9 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:15.677616 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699a9d53-9667-457d-a04f-289bcdf3f3b2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:15.679676 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699a9d53-9667-457d-a04f-289bcdf3f3b2 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:15.737147 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 102/202] 10.222.0.36 () {58 vars in 1282 bytes} [Tue May 3 13:59:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 03 13:59:15.738380 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed66608-e753-49eb-a6db-6b5a2db82ee9 None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:15.774575 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 101/203] 10.222.0.36 () {58 vars in 1282 bytes} [Tue May 3 13:59:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 03 13:59:15.775444 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699a9d53-9667-457d-a04f-289bcdf3f3b2 None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:15.838041 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed66608-e753-49eb-a6db-6b5a2db82ee9 None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:15.871294 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc98976-a74c-41af-8e75-16ebaab4473b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:15.872013 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc98976-a74c-41af-8e75-16ebaab4473b None admin] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:15.872272 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc98976-a74c-41af-8e75-16ebaab4473b None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:15.872543 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc98976-a74c-41af-8e75-16ebaab4473b None admin] PATH_INFO: `/v3/users` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:15.873250 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc98976-a74c-41af-8e75-16ebaab4473b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:15.874777 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc98976-a74c-41af-8e75-16ebaab4473b None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:15.878555 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699a9d53-9667-457d-a04f-289bcdf3f3b2 None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:15.895186 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 103/204] 10.222.0.36 () {60 vars in 1132 bytes} [Tue May 3 13:59:15 2022] POST /identity/v3/users => generated 297 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 13:59:15.895927 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc98976-a74c-41af-8e75-16ebaab4473b None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:15.928857 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426eb901-0475-4f4f-a1ac-e27e355e70bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:15.930123 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426eb901-0475-4f4f-a1ac-e27e355e70bc None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:15.930585 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426eb901-0475-4f4f-a1ac-e27e355e70bc None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:15.931197 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426eb901-0475-4f4f-a1ac-e27e355e70bc None admin] PATH_INFO: `/v3/projects/3256bc7158894136b4937ecc0a8b3073` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:15.933629 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426eb901-0475-4f4f-a1ac-e27e355e70bc None admin] RBAC: Authorizing `identity:get_project(project_id=3256bc7158894136b4937ecc0a8b3073)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:15.935351 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426eb901-0475-4f4f-a1ac-e27e355e70bc None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:15.942967 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 102/205] 10.222.0.36 () {56 vars in 1186 bytes} [Tue May 3 13:59:15 2022] GET /identity/v3/projects/3256bc7158894136b4937ecc0a8b3073 => generated 298 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 13:59:15.944445 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426eb901-0475-4f4f-a1ac-e27e355e70bc None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:16.008944 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc98976-a74c-41af-8e75-16ebaab4473b None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:16.044853 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32302028-07a2-4b83-96d2-eab4f2fa9b6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:16.045903 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32302028-07a2-4b83-96d2-eab4f2fa9b6c None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:16.046192 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32302028-07a2-4b83-96d2-eab4f2fa9b6c None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:16.046464 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32302028-07a2-4b83-96d2-eab4f2fa9b6c None admin] PATH_INFO: `/v3/projects/446967649a7d47af8f0eb54b376ac1fa` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:16.047944 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32302028-07a2-4b83-96d2-eab4f2fa9b6c None admin] RBAC: Authorizing `identity:get_project(project_id=446967649a7d47af8f0eb54b376ac1fa)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:16.049527 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32302028-07a2-4b83-96d2-eab4f2fa9b6c None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:16.051881 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 104/206] 10.222.0.36 () {56 vars in 1186 bytes} [Tue May 3 13:59:15 2022] GET /identity/v3/projects/446967649a7d47af8f0eb54b376ac1fa => generated 302 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 13:59:16.057145 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32302028-07a2-4b83-96d2-eab4f2fa9b6c None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:16.100872 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426eb901-0475-4f4f-a1ac-e27e355e70bc None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:16.136946 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b8b3af-637c-4155-ba72-46a55ffe9e71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:16.137637 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b8b3af-637c-4155-ba72-46a55ffe9e71 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:16.137917 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b8b3af-637c-4155-ba72-46a55ffe9e71 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:16.138197 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b8b3af-637c-4155-ba72-46a55ffe9e71 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:16.139386 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b8b3af-637c-4155-ba72-46a55ffe9e71 None admin] RBAC: Adding query filter params (role.id=881b929165074739a253b35012fbc4fb, scope.project.id=3256bc7158894136b4937ecc0a8b3073, user.id=ca59e1fd3bc04530a60400eaa7f6001b) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 13:59:16.139386 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b8b3af-637c-4155-ba72-46a55ffe9e71 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:16.140983 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b8b3af-637c-4155-ba72-46a55ffe9e71 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:16.148487 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 103/207] 10.222.0.36 () {56 vars in 1374 bytes} [Tue May 3 13:59:15 2022] GET /identity/v3/role_assignments?user.id=ca59e1fd3bc04530a60400eaa7f6001b&scope.project.id=3256bc7158894136b4937ecc0a8b3073&role.id=881b929165074739a253b35012fbc4fb => generated 608 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 13:59:16.178317 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32302028-07a2-4b83-96d2-eab4f2fa9b6c None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:16.214806 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e82d8a6-a5a7-4215-80a2-420f48c1d2ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:16.215478 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e82d8a6-a5a7-4215-80a2-420f48c1d2ec None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:16.215755 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e82d8a6-a5a7-4215-80a2-420f48c1d2ec None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:16.216028 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e82d8a6-a5a7-4215-80a2-420f48c1d2ec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:16.216877 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e82d8a6-a5a7-4215-80a2-420f48c1d2ec None admin] RBAC: Adding query filter params (role.id=bd29d35ea39b4ba293ffbf1ffbf4b940, scope.project.id=446967649a7d47af8f0eb54b376ac1fa, user.id=b8b1e0fcb00a456ca08ac64d408e47a0) {{(pid=80012) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 13:59:16.217185 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e82d8a6-a5a7-4215-80a2-420f48c1d2ec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:16.218753 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e82d8a6-a5a7-4215-80a2-420f48c1d2ec None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:16.225756 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 105/208] 10.222.0.36 () {56 vars in 1374 bytes} [Tue May 3 13:59:16 2022] GET /identity/v3/role_assignments?user.id=b8b1e0fcb00a456ca08ac64d408e47a0&scope.project.id=446967649a7d47af8f0eb54b376ac1fa&role.id=bd29d35ea39b4ba293ffbf1ffbf4b940 => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 13:59:17.765357 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa650a0-5e4b-4e34-8c09-eadf2718ec58 None None] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:17.765892 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa650a0-5e4b-4e34-8c09-eadf2718ec58 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:17.765892 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa650a0-5e4b-4e34-8c09-eadf2718ec58 None None] PATH_INFO: `/` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:17.767429 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 104/209] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 3 13:59:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 13:59:17.774791 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3503ec-2345-4676-b6c9-63fe5812fccc None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:17.775374 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3503ec-2345-4676-b6c9-63fe5812fccc None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:17.775374 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3503ec-2345-4676-b6c9-63fe5812fccc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:17.793699 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-6d3503ec-2345-4676-b6c9-63fe5812fccc None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 13:59:17.794878 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-6d3503ec-2345-4676-b6c9-63fe5812fccc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 13:59:17.878692 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 106/210] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 3 13:59:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 13:59:17.906043 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa650a0-5e4b-4e34-8c09-eadf2718ec58 None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:18.029836 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa650a0-5e4b-4e34-8c09-eadf2718ec58 None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:18.072342 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bd7c6b-96b7-4a1f-bb3d-5401e3140936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:18.073232 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bd7c6b-96b7-4a1f-bb3d-5401e3140936 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:18.073535 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bd7c6b-96b7-4a1f-bb3d-5401e3140936 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:18.073809 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bd7c6b-96b7-4a1f-bb3d-5401e3140936 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:18.085004 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bd7c6b-96b7-4a1f-bb3d-5401e3140936 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 13:59:18.094898 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application [None req-c1bd7c6b-96b7-4a1f-bb3d-5401e3140936 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 03 13:59:18.094898 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 13:59:18.094898 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 13:59:18.094898 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 13:59:18.094898 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 13:59:18.094898 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 13:59:18.094898 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 13:59:18.094898 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 13:59:18.094898 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 13:59:18.094898 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 13:59:18.094898 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 13:59:18.094898 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 13:59:18.094898 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 13:59:18.094898 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 13:59:18.094898 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 13:59:18.094898 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 13:59:18.095840 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 13:59:18.095840 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 13:59:18.095840 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 13:59:18.095840 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 13:59:18.095840 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 13:59:18.095840 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 13:59:18.095840 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 13:59:18.095840 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 13:59:18.095840 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 13:59:18.095840 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.get_or_create( May 03 13:59:18.095840 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 13:59:18.095840 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application with Lock( May 03 13:59:18.095840 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 13:59:18.095840 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._enter() May 03 13:59:18.095840 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 13:59:18.095840 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 13:59:18.096651 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 13:59:18.096651 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.creator() May 03 13:59:18.096651 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 13:59:18.096651 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application created_value = creator( May 03 13:59:18.096651 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 13:59:18.096651 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 13:59:18.096651 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 13:59:18.096651 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 13:59:18.096651 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 13:59:18.096651 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 13:59:18.096651 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 03 13:59:18.096651 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application May 03 13:59:18.097277 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 105/211] 10.222.0.36 () {56 vars in 1096 bytes} [Tue May 3 13:59:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 13:59:18.107260 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3503ec-2345-4676-b6c9-63fe5812fccc None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:18.210069 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3503ec-2345-4676-b6c9-63fe5812fccc None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:18.247011 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6132b362-4f88-47b4-82c3-b604bb7d06f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:18.247736 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6132b362-4f88-47b4-82c3-b604bb7d06f6 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:18.248011 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6132b362-4f88-47b4-82c3-b604bb7d06f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:18.248280 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6132b362-4f88-47b4-82c3-b604bb7d06f6 None admin] PATH_INFO: `/v3/roles` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:18.249101 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6132b362-4f88-47b4-82c3-b604bb7d06f6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80012) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 13:59:18.249431 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6132b362-4f88-47b4-82c3-b604bb7d06f6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:18.250810 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6132b362-4f88-47b4-82c3-b604bb7d06f6 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:18.260181 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 107/212] 10.222.0.36 () {56 vars in 1099 bytes} [Tue May 3 13:59:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 13:59:18.266547 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bd7c6b-96b7-4a1f-bb3d-5401e3140936 None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:18.372289 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bd7c6b-96b7-4a1f-bb3d-5401e3140936 None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:18.396542 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a32ef0-a681-4201-a14f-938d057385f5 None None] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:18.396819 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a32ef0-a681-4201-a14f-938d057385f5 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:18.397146 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a32ef0-a681-4201-a14f-938d057385f5 None None] PATH_INFO: `/` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:18.398904 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 108/213] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 3 13:59:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 13:59:18.404245 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ed0a38-3390-419b-92bd-5316c0b45706 None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:18.404524 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ed0a38-3390-419b-92bd-5316c0b45706 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:18.404799 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ed0a38-3390-419b-92bd-5316c0b45706 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:18.412130 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807cb224-19b8-4ca9-a83b-937533c2a71a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:18.413035 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807cb224-19b8-4ca9-a83b-937533c2a71a None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:18.413342 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807cb224-19b8-4ca9-a83b-937533c2a71a None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:18.413617 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807cb224-19b8-4ca9-a83b-937533c2a71a None admin] PATH_INFO: `/v3/users/b8b1e0fcb00a456ca08ac64d408e47a0` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:18.414837 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807cb224-19b8-4ca9-a83b-937533c2a71a None admin] RBAC: Authorizing `identity:get_user(user_id=b8b1e0fcb00a456ca08ac64d408e47a0)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:18.416288 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807cb224-19b8-4ca9-a83b-937533c2a71a None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:18.418014 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 106/214] 10.222.0.36 () {56 vars in 1177 bytes} [Tue May 3 13:59:18 2022] GET /identity/v3/users/b8b1e0fcb00a456ca08ac64d408e47a0 => generated 283 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 13:59:18.422860 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-f9ed0a38-3390-419b-92bd-5316c0b45706 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 13:59:18.424302 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-f9ed0a38-3390-419b-92bd-5316c0b45706 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 13:59:18.425044 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807cb224-19b8-4ca9-a83b-937533c2a71a None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:18.491222 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 109/215] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 3 13:59:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 13:59:18.514903 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ed0a38-3390-419b-92bd-5316c0b45706 None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:18.526160 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807cb224-19b8-4ca9-a83b-937533c2a71a None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:18.560423 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3046633a-f0d2-433c-b21a-abf5dad568dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:18.561333 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3046633a-f0d2-433c-b21a-abf5dad568dc None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:18.561657 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3046633a-f0d2-433c-b21a-abf5dad568dc None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:18.561934 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3046633a-f0d2-433c-b21a-abf5dad568dc None admin] PATH_INFO: `/v3/projects/446967649a7d47af8f0eb54b376ac1fa` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:18.563110 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3046633a-f0d2-433c-b21a-abf5dad568dc None admin] RBAC: Authorizing `identity:get_project(project_id=446967649a7d47af8f0eb54b376ac1fa)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:18.564556 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3046633a-f0d2-433c-b21a-abf5dad568dc None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:18.568245 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 107/216] 10.222.0.36 () {56 vars in 1186 bytes} [Tue May 3 13:59:18 2022] GET /identity/v3/projects/446967649a7d47af8f0eb54b376ac1fa => generated 302 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 13:59:18.569803 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4d4268-a506-4051-abaa-71714be1db16 None None] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:18.570091 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4d4268-a506-4051-abaa-71714be1db16 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:18.570393 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4d4268-a506-4051-abaa-71714be1db16 None None] PATH_INFO: `/` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:18.571644 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 108/217] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 3 13:59:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 13:59:18.572307 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4d4268-a506-4051-abaa-71714be1db16 None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:18.617695 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ed0a38-3390-419b-92bd-5316c0b45706 None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:18.653867 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcd05db-e25e-4ec7-ab3e-2f853ec7cb92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:18.654585 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcd05db-e25e-4ec7-ab3e-2f853ec7cb92 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:18.654859 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcd05db-e25e-4ec7-ab3e-2f853ec7cb92 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:18.655185 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcd05db-e25e-4ec7-ab3e-2f853ec7cb92 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:18.664957 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcd05db-e25e-4ec7-ab3e-2f853ec7cb92 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 13:59:18.672681 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application [None req-bdcd05db-e25e-4ec7-ab3e-2f853ec7cb92 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 03 13:59:18.672681 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 13:59:18.672681 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 13:59:18.672681 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 13:59:18.672681 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 13:59:18.672681 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 13:59:18.672681 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 13:59:18.672681 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 13:59:18.672681 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 13:59:18.672681 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 13:59:18.672681 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 13:59:18.672681 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 13:59:18.672681 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 13:59:18.672681 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 13:59:18.672681 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 13:59:18.672681 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 13:59:18.673704 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 13:59:18.673704 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 13:59:18.673704 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 13:59:18.673704 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 13:59:18.673704 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 13:59:18.673704 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 13:59:18.673704 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 13:59:18.673704 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 13:59:18.673704 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 13:59:18.673704 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.get_or_create( May 03 13:59:18.673704 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 13:59:18.673704 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application with Lock( May 03 13:59:18.673704 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 13:59:18.673704 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._enter() May 03 13:59:18.673704 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 13:59:18.673704 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 13:59:18.679746 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 13:59:18.679746 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.creator() May 03 13:59:18.679746 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 13:59:18.679746 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application created_value = creator( May 03 13:59:18.679746 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 13:59:18.679746 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 13:59:18.679746 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 13:59:18.679746 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 13:59:18.679746 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 13:59:18.679746 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 13:59:18.679746 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 03 13:59:18.679746 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application May 03 13:59:18.680404 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4d4268-a506-4051-abaa-71714be1db16 None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:18.680489 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 110/218] 10.222.0.36 () {56 vars in 1099 bytes} [Tue May 3 13:59:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 13:59:18.680489 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17cd7fe-3ec7-4547-b414-27a5aa682c19 None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:18.680489 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17cd7fe-3ec7-4547-b414-27a5aa682c19 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:18.680489 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17cd7fe-3ec7-4547-b414-27a5aa682c19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:18.699741 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-c17cd7fe-3ec7-4547-b414-27a5aa682c19 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 13:59:18.700997 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-c17cd7fe-3ec7-4547-b414-27a5aa682c19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 13:59:18.707917 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b12587-6982-4d51-a0ed-0448a052e038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:18.708812 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b12587-6982-4d51-a0ed-0448a052e038 None admin] REQUEST_METHOD: `PUT` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:18.709087 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b12587-6982-4d51-a0ed-0448a052e038 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:18.709383 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b12587-6982-4d51-a0ed-0448a052e038 None admin] PATH_INFO: `/v3/projects/446967649a7d47af8f0eb54b376ac1fa/users/b8b1e0fcb00a456ca08ac64d408e47a0/roles/36abe9b50fd8479c86c4f8f70fd85aa3` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:18.711325 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b12587-6982-4d51-a0ed-0448a052e038 None admin] RBAC: Authorizing `identity:create_grant(project_id=446967649a7d47af8f0eb54b376ac1fa, user_id=b8b1e0fcb00a456ca08ac64d408e47a0, role_id=36abe9b50fd8479c86c4f8f70fd85aa3)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:18.712762 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b12587-6982-4d51-a0ed-0448a052e038 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:18.726512 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 109/219] 10.222.0.36 () {58 vars in 1439 bytes} [Tue May 3 13:59:18 2022] PUT /identity/v3/projects/446967649a7d47af8f0eb54b376ac1fa/users/b8b1e0fcb00a456ca08ac64d408e47a0/roles/36abe9b50fd8479c86c4f8f70fd85aa3 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 13:59:18.727308 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b12587-6982-4d51-a0ed-0448a052e038 None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:18.778379 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 111/220] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 3 13:59:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 13:59:18.778379 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d2985a-d3d2-49cf-9707-5c3488e095fb None None] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:18.778379 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d2985a-d3d2-49cf-9707-5c3488e095fb None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:18.778379 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d2985a-d3d2-49cf-9707-5c3488e095fb None None] PATH_INFO: `/` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:18.779100 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 112/221] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 3 13:59:18 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 13:59:18.782184 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549d15b6-34e5-4fcd-bedd-dac670ba4ca4 None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:18.782184 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549d15b6-34e5-4fcd-bedd-dac670ba4ca4 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:18.782184 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549d15b6-34e5-4fcd-bedd-dac670ba4ca4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:18.798008 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-549d15b6-34e5-4fcd-bedd-dac670ba4ca4 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 13:59:18.799209 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-549d15b6-34e5-4fcd-bedd-dac670ba4ca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 13:59:18.832364 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b12587-6982-4d51-a0ed-0448a052e038 None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:18.868419 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c0cefd-a1a7-40e6-b538-374e28dee181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:18.869100 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c0cefd-a1a7-40e6-b538-374e28dee181 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:18.869554 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 113/222] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 3 13:59:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 13:59:18.870664 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549d15b6-34e5-4fcd-bedd-dac670ba4ca4 None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:18.877583 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c0cefd-a1a7-40e6-b538-374e28dee181 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:18.878255 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c0cefd-a1a7-40e6-b538-374e28dee181 None admin] PATH_INFO: `/v3/roles` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:18.879408 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c0cefd-a1a7-40e6-b538-374e28dee181 None admin] RBAC: Adding query filter params (name=member) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 13:59:18.880540 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c0cefd-a1a7-40e6-b538-374e28dee181 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:18.882737 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c0cefd-a1a7-40e6-b538-374e28dee181 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:18.894568 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 110/223] 10.222.0.36 () {56 vars in 1101 bytes} [Tue May 3 13:59:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 13:59:18.895999 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c0cefd-a1a7-40e6-b538-374e28dee181 None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:18.971498 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549d15b6-34e5-4fcd-bedd-dac670ba4ca4 None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:19.002962 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770fa653-13b3-4ef4-923e-6570ee4381b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:19.003784 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770fa653-13b3-4ef4-923e-6570ee4381b4 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:19.004088 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770fa653-13b3-4ef4-923e-6570ee4381b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:19.004305 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770fa653-13b3-4ef4-923e-6570ee4381b4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:19.005480 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770fa653-13b3-4ef4-923e-6570ee4381b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:19.006386 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c0cefd-a1a7-40e6-b538-374e28dee181 None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:19.006911 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770fa653-13b3-4ef4-923e-6570ee4381b4 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:19.012857 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 114/224] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 3 13:59:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 13:59:19.012857 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770fa653-13b3-4ef4-923e-6570ee4381b4 None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:19.050647 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6a42a3-1528-40bd-9f3e-91bf98d89827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:19.051483 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6a42a3-1528-40bd-9f3e-91bf98d89827 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:19.051759 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6a42a3-1528-40bd-9f3e-91bf98d89827 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:19.052026 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6a42a3-1528-40bd-9f3e-91bf98d89827 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:19.065620 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6a42a3-1528-40bd-9f3e-91bf98d89827 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 13:59:19.073827 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application [None req-0c6a42a3-1528-40bd-9f3e-91bf98d89827 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 03 13:59:19.073827 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 13:59:19.073827 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 13:59:19.073827 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 13:59:19.073827 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 13:59:19.073827 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 13:59:19.073827 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 13:59:19.073827 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 13:59:19.073827 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 13:59:19.073827 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 13:59:19.073827 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 13:59:19.073827 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 13:59:19.073827 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 13:59:19.073827 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 13:59:19.073827 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 13:59:19.073827 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 13:59:19.074829 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 13:59:19.074829 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 13:59:19.074829 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 13:59:19.074829 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 13:59:19.074829 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 13:59:19.074829 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 13:59:19.074829 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 13:59:19.074829 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 13:59:19.074829 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 13:59:19.074829 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.get_or_create( May 03 13:59:19.074829 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 13:59:19.074829 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application with Lock( May 03 13:59:19.074829 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 13:59:19.074829 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._enter() May 03 13:59:19.074829 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 13:59:19.074829 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 13:59:19.076453 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 13:59:19.076453 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.creator() May 03 13:59:19.076453 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 13:59:19.076453 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application created_value = creator( May 03 13:59:19.076453 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 13:59:19.076453 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 13:59:19.076453 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 13:59:19.076453 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 13:59:19.076453 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 13:59:19.076453 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 13:59:19.076453 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 03 13:59:19.076453 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application May 03 13:59:19.076453 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 111/225] 10.222.0.36 () {56 vars in 1114 bytes} [Tue May 3 13:59:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 13:59:19.080693 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6a42a3-1528-40bd-9f3e-91bf98d89827 None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:19.115609 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770fa653-13b3-4ef4-923e-6570ee4381b4 None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:19.147170 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f66069-b8e0-4171-8eb2-da5d76661ce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:19.148354 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f66069-b8e0-4171-8eb2-da5d76661ce6 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:19.148638 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f66069-b8e0-4171-8eb2-da5d76661ce6 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:19.148905 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f66069-b8e0-4171-8eb2-da5d76661ce6 None admin] PATH_INFO: `/v3/users/4c8fd303f8604f889f687980e2f7ff7a` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:19.163165 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f66069-b8e0-4171-8eb2-da5d76661ce6 None admin] RBAC: Authorizing `identity:get_user(user_id=4c8fd303f8604f889f687980e2f7ff7a)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:19.164694 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f66069-b8e0-4171-8eb2-da5d76661ce6 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:19.171106 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 115/226] 10.222.0.36 () {56 vars in 1177 bytes} [Tue May 3 13:59:19 2022] GET /identity/v3/users/4c8fd303f8604f889f687980e2f7ff7a => generated 297 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 13:59:19.171106 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f66069-b8e0-4171-8eb2-da5d76661ce6 None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:19.182663 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6a42a3-1528-40bd-9f3e-91bf98d89827 None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:19.214516 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f383190b-7308-4f13-9738-2d65360b5ac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:19.215185 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f383190b-7308-4f13-9738-2d65360b5ac9 None admin] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:19.215463 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f383190b-7308-4f13-9738-2d65360b5ac9 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:19.215731 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f383190b-7308-4f13-9738-2d65360b5ac9 None admin] PATH_INFO: `/v3/users` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:19.216427 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f383190b-7308-4f13-9738-2d65360b5ac9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:19.217940 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f383190b-7308-4f13-9738-2d65360b5ac9 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:19.253410 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 112/227] 10.222.0.36 () {60 vars in 1132 bytes} [Tue May 3 13:59:19 2022] POST /identity/v3/users => generated 297 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 13:59:19.253410 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f383190b-7308-4f13-9738-2d65360b5ac9 None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:19.261065 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f66069-b8e0-4171-8eb2-da5d76661ce6 None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:19.297535 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3876066e-1f99-43a6-abd0-b4817047b97e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:19.298335 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3876066e-1f99-43a6-abd0-b4817047b97e None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:19.298654 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3876066e-1f99-43a6-abd0-b4817047b97e None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:19.298933 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3876066e-1f99-43a6-abd0-b4817047b97e None admin] PATH_INFO: `/v3/roles` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:19.299751 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3876066e-1f99-43a6-abd0-b4817047b97e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80012) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 13:59:19.300054 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3876066e-1f99-43a6-abd0-b4817047b97e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:19.301543 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3876066e-1f99-43a6-abd0-b4817047b97e None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:19.315901 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 116/228] 10.222.0.36 () {56 vars in 1111 bytes} [Tue May 3 13:59:19 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 13:59:19.316915 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3876066e-1f99-43a6-abd0-b4817047b97e None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:19.378354 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f383190b-7308-4f13-9738-2d65360b5ac9 None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:19.423508 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f619806-c9fd-450a-9a0f-68bcf3380acf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:19.424251 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f619806-c9fd-450a-9a0f-68bcf3380acf None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:19.424532 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f619806-c9fd-450a-9a0f-68bcf3380acf None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:19.424695 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3876066e-1f99-43a6-abd0-b4817047b97e None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:19.424846 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f619806-c9fd-450a-9a0f-68bcf3380acf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:19.468002 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f783ce-9ec9-46aa-b95d-5ddd04d5df5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:19.468889 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f783ce-9ec9-46aa-b95d-5ddd04d5df5a None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:19.469176 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f783ce-9ec9-46aa-b95d-5ddd04d5df5a None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:19.469497 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f783ce-9ec9-46aa-b95d-5ddd04d5df5a None admin] PATH_INFO: `/v3/users/b8b1e0fcb00a456ca08ac64d408e47a0` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:19.470864 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f783ce-9ec9-46aa-b95d-5ddd04d5df5a None admin] RBAC: Authorizing `identity:get_user(user_id=b8b1e0fcb00a456ca08ac64d408e47a0)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:19.472649 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f783ce-9ec9-46aa-b95d-5ddd04d5df5a None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:19.475339 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 117/229] 10.222.0.36 () {56 vars in 1177 bytes} [Tue May 3 13:59:19 2022] GET /identity/v3/users/b8b1e0fcb00a456ca08ac64d408e47a0 => generated 283 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 13:59:19.481244 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f783ce-9ec9-46aa-b95d-5ddd04d5df5a None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:19.506801 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f619806-c9fd-450a-9a0f-68bcf3380acf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:19.508193 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f619806-c9fd-450a-9a0f-68bcf3380acf None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:19.591433 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f783ce-9ec9-46aa-b95d-5ddd04d5df5a None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:19.615283 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 113/230] 10.222.0.36 () {58 vars in 1282 bytes} [Tue May 3 13:59:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 03 13:59:19.621862 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f619806-c9fd-450a-9a0f-68bcf3380acf None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:19.635612 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e3f2af-fab6-4d63-a979-f6cf1a8a872e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:19.637100 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e3f2af-fab6-4d63-a979-f6cf1a8a872e None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:19.637743 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e3f2af-fab6-4d63-a979-f6cf1a8a872e None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:19.638212 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e3f2af-fab6-4d63-a979-f6cf1a8a872e None admin] PATH_INFO: `/v3/projects/446967649a7d47af8f0eb54b376ac1fa` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:19.640241 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e3f2af-fab6-4d63-a979-f6cf1a8a872e None admin] RBAC: Authorizing `identity:get_project(project_id=446967649a7d47af8f0eb54b376ac1fa)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:19.642356 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e3f2af-fab6-4d63-a979-f6cf1a8a872e None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:19.644658 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 118/231] 10.222.0.36 () {56 vars in 1186 bytes} [Tue May 3 13:59:19 2022] GET /identity/v3/projects/446967649a7d47af8f0eb54b376ac1fa => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 13:59:19.651587 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e3f2af-fab6-4d63-a979-f6cf1a8a872e None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:19.743290 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f619806-c9fd-450a-9a0f-68bcf3380acf None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:19.769703 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e3f2af-fab6-4d63-a979-f6cf1a8a872e None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:19.778030 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7b4353-82ef-4917-8bab-7c85ea07ef38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:19.779223 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7b4353-82ef-4917-8bab-7c85ea07ef38 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:19.779691 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7b4353-82ef-4917-8bab-7c85ea07ef38 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:19.780237 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7b4353-82ef-4917-8bab-7c85ea07ef38 None admin] PATH_INFO: `/v3/projects/446967649a7d47af8f0eb54b376ac1fa` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:19.781646 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7b4353-82ef-4917-8bab-7c85ea07ef38 None admin] RBAC: Authorizing `identity:get_project(project_id=446967649a7d47af8f0eb54b376ac1fa)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:19.783368 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7b4353-82ef-4917-8bab-7c85ea07ef38 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:19.789386 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 114/232] 10.222.0.36 () {56 vars in 1186 bytes} [Tue May 3 13:59:19 2022] GET /identity/v3/projects/446967649a7d47af8f0eb54b376ac1fa => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 13:59:19.791797 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7b4353-82ef-4917-8bab-7c85ea07ef38 None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:19.802717 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e5daa2-8ec9-4fab-89f0-b3d2920dcd4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:19.803620 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e5daa2-8ec9-4fab-89f0-b3d2920dcd4d None admin] REQUEST_METHOD: `PUT` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:19.804184 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e5daa2-8ec9-4fab-89f0-b3d2920dcd4d None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:19.804184 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e5daa2-8ec9-4fab-89f0-b3d2920dcd4d None admin] PATH_INFO: `/v3/projects/446967649a7d47af8f0eb54b376ac1fa/users/b8b1e0fcb00a456ca08ac64d408e47a0/roles/bd29d35ea39b4ba293ffbf1ffbf4b940` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:19.806445 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e5daa2-8ec9-4fab-89f0-b3d2920dcd4d None admin] RBAC: Authorizing `identity:create_grant(project_id=446967649a7d47af8f0eb54b376ac1fa, user_id=b8b1e0fcb00a456ca08ac64d408e47a0, role_id=bd29d35ea39b4ba293ffbf1ffbf4b940)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:19.807909 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e5daa2-8ec9-4fab-89f0-b3d2920dcd4d None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:19.825258 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 119/233] 10.222.0.36 () {58 vars in 1439 bytes} [Tue May 3 13:59:19 2022] PUT /identity/v3/projects/446967649a7d47af8f0eb54b376ac1fa/users/b8b1e0fcb00a456ca08ac64d408e47a0/roles/bd29d35ea39b4ba293ffbf1ffbf4b940 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 13:59:19.909208 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7b4353-82ef-4917-8bab-7c85ea07ef38 None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:19.944099 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f451fde-086c-4187-bacc-700795113082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:19.944774 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f451fde-086c-4187-bacc-700795113082 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:19.945106 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f451fde-086c-4187-bacc-700795113082 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:19.945422 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f451fde-086c-4187-bacc-700795113082 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:19.946323 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f451fde-086c-4187-bacc-700795113082 None admin] RBAC: Adding query filter params (role.id=441fdc11e95b47f4813f72610e39018b, scope.project.id=446967649a7d47af8f0eb54b376ac1fa, user.id=4c8fd303f8604f889f687980e2f7ff7a) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 13:59:19.946633 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f451fde-086c-4187-bacc-700795113082 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:19.948111 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f451fde-086c-4187-bacc-700795113082 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:19.954787 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 115/234] 10.222.0.36 () {56 vars in 1374 bytes} [Tue May 3 13:59:19 2022] GET /identity/v3/role_assignments?user.id=4c8fd303f8604f889f687980e2f7ff7a&scope.project.id=446967649a7d47af8f0eb54b376ac1fa&role.id=441fdc11e95b47f4813f72610e39018b => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 13:59:21.242981 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a98e652-3f93-4905-adc7-6728b89d6512 None None] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:21.243496 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a98e652-3f93-4905-adc7-6728b89d6512 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:21.243570 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a98e652-3f93-4905-adc7-6728b89d6512 None None] PATH_INFO: `/` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:21.245169 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 120/235] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 3 13:59:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 13:59:21.250192 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153efd72-8aa6-4ca5-be52-67df2104221d None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:21.250727 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153efd72-8aa6-4ca5-be52-67df2104221d None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:21.250727 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153efd72-8aa6-4ca5-be52-67df2104221d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:21.267598 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-153efd72-8aa6-4ca5-be52-67df2104221d None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 13:59:21.268769 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-153efd72-8aa6-4ca5-be52-67df2104221d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 13:59:21.337264 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 116/236] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 3 13:59:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 13:59:21.360979 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a98e652-3f93-4905-adc7-6728b89d6512 None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:21.465756 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a98e652-3f93-4905-adc7-6728b89d6512 None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:21.499572 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85962acf-b26e-4983-8632-8bdc26037af2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:21.500395 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85962acf-b26e-4983-8632-8bdc26037af2 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:21.500671 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85962acf-b26e-4983-8632-8bdc26037af2 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:21.500941 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85962acf-b26e-4983-8632-8bdc26037af2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:21.512749 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85962acf-b26e-4983-8632-8bdc26037af2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 13:59:21.520495 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application [None req-85962acf-b26e-4983-8632-8bdc26037af2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 03 13:59:21.520495 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 13:59:21.520495 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 13:59:21.520495 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 13:59:21.520495 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 13:59:21.520495 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 13:59:21.520495 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 13:59:21.520495 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 13:59:21.520495 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 13:59:21.520495 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 13:59:21.520495 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 13:59:21.520495 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 13:59:21.520495 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 13:59:21.520495 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 13:59:21.520495 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 13:59:21.520495 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 13:59:21.522593 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 13:59:21.522593 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 13:59:21.522593 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 13:59:21.522593 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 13:59:21.522593 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 13:59:21.522593 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 13:59:21.522593 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 13:59:21.522593 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 13:59:21.522593 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 13:59:21.522593 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.get_or_create( May 03 13:59:21.522593 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 13:59:21.522593 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application with Lock( May 03 13:59:21.522593 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 13:59:21.522593 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._enter() May 03 13:59:21.522593 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 13:59:21.522593 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 13:59:21.524527 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 13:59:21.524527 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.creator() May 03 13:59:21.524527 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 13:59:21.524527 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application created_value = creator( May 03 13:59:21.524527 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 13:59:21.524527 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 13:59:21.524527 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 13:59:21.524527 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 13:59:21.524527 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 13:59:21.524527 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 13:59:21.524527 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 03 13:59:21.524527 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application May 03 13:59:21.524527 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 121/237] 10.222.0.36 () {56 vars in 1096 bytes} [Tue May 3 13:59:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 13:59:21.533306 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153efd72-8aa6-4ca5-be52-67df2104221d None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:21.625050 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153efd72-8aa6-4ca5-be52-67df2104221d None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:21.659617 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa518b95-10f5-4e62-95fb-982d93a5a575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:21.660290 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa518b95-10f5-4e62-95fb-982d93a5a575 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:21.660567 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa518b95-10f5-4e62-95fb-982d93a5a575 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:21.660840 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa518b95-10f5-4e62-95fb-982d93a5a575 None admin] PATH_INFO: `/v3/roles` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:21.661632 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa518b95-10f5-4e62-95fb-982d93a5a575 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 13:59:21.661940 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa518b95-10f5-4e62-95fb-982d93a5a575 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:21.663314 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa518b95-10f5-4e62-95fb-982d93a5a575 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:21.671846 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 117/238] 10.222.0.36 () {56 vars in 1099 bytes} [Tue May 3 13:59:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 13:59:21.677446 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85962acf-b26e-4983-8632-8bdc26037af2 None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:21.776243 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85962acf-b26e-4983-8632-8bdc26037af2 None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:21.809438 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb623c1-3b7b-4a82-9814-a894de7b3f93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:21.810316 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb623c1-3b7b-4a82-9814-a894de7b3f93 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:21.810593 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb623c1-3b7b-4a82-9814-a894de7b3f93 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:21.810864 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb623c1-3b7b-4a82-9814-a894de7b3f93 None admin] PATH_INFO: `/v3/users/b8b1e0fcb00a456ca08ac64d408e47a0` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:21.812123 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb623c1-3b7b-4a82-9814-a894de7b3f93 None admin] RBAC: Authorizing `identity:get_user(user_id=b8b1e0fcb00a456ca08ac64d408e47a0)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:21.813632 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb623c1-3b7b-4a82-9814-a894de7b3f93 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:21.815596 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 122/239] 10.222.0.36 () {56 vars in 1177 bytes} [Tue May 3 13:59:21 2022] GET /identity/v3/users/b8b1e0fcb00a456ca08ac64d408e47a0 => generated 283 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 13:59:21.821244 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa518b95-10f5-4e62-95fb-982d93a5a575 None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:21.927844 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa518b95-10f5-4e62-95fb-982d93a5a575 None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:21.961451 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d5a4bf-dbed-4e05-bf06-f4318b7df27b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:21.962100 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d5a4bf-dbed-4e05-bf06-f4318b7df27b None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:21.962435 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d5a4bf-dbed-4e05-bf06-f4318b7df27b None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:21.962709 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d5a4bf-dbed-4e05-bf06-f4318b7df27b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:22.030197 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d5a4bf-dbed-4e05-bf06-f4318b7df27b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:22.031678 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d5a4bf-dbed-4e05-bf06-f4318b7df27b None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:22.129641 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 118/240] 10.222.0.36 () {58 vars in 1282 bytes} [Tue May 3 13:59:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 03 13:59:22.135226 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb623c1-3b7b-4a82-9814-a894de7b3f93 None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:22.238274 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb623c1-3b7b-4a82-9814-a894de7b3f93 None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:22.254246 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada6c4da-b678-4785-a3fa-ad69ebfd76d4 None None] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:22.254770 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada6c4da-b678-4785-a3fa-ad69ebfd76d4 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:22.254770 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada6c4da-b678-4785-a3fa-ad69ebfd76d4 None None] PATH_INFO: `/` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:22.256146 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 119/241] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 3 13:59:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 13:59:22.261419 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bbc89a-b014-45a0-8622-73f822ecf719 None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:22.261704 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bbc89a-b014-45a0-8622-73f822ecf719 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:22.261975 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bbc89a-b014-45a0-8622-73f822ecf719 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:22.277239 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34d7fe2-98ed-47d3-8c85-ccc70e710473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:22.278140 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34d7fe2-98ed-47d3-8c85-ccc70e710473 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:22.278355 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-49bbc89a-b014-45a0-8622-73f822ecf719 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 13:59:22.278457 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34d7fe2-98ed-47d3-8c85-ccc70e710473 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:22.278676 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34d7fe2-98ed-47d3-8c85-ccc70e710473 None admin] PATH_INFO: `/v3/projects/446967649a7d47af8f0eb54b376ac1fa` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:22.279514 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-49bbc89a-b014-45a0-8622-73f822ecf719 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 13:59:22.279867 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34d7fe2-98ed-47d3-8c85-ccc70e710473 None admin] RBAC: Authorizing `identity:get_project(project_id=446967649a7d47af8f0eb54b376ac1fa)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:22.281774 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34d7fe2-98ed-47d3-8c85-ccc70e710473 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:22.283520 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 123/242] 10.222.0.36 () {56 vars in 1186 bytes} [Tue May 3 13:59:22 2022] GET /identity/v3/projects/446967649a7d47af8f0eb54b376ac1fa => generated 302 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 13:59:22.289195 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34d7fe2-98ed-47d3-8c85-ccc70e710473 None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:22.396536 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34d7fe2-98ed-47d3-8c85-ccc70e710473 None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:22.417412 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 120/243] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 3 13:59:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 03 13:59:22.418936 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763c815e-e75a-45a6-a297-34218f171bc9 None None] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:22.419291 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763c815e-e75a-45a6-a297-34218f171bc9 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:22.419641 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763c815e-e75a-45a6-a297-34218f171bc9 None None] PATH_INFO: `/` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:22.421345 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 121/244] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 3 13:59:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 13:59:22.426647 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2f9819-2db8-4f3c-8dcd-b7856198701c None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:22.427004 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2f9819-2db8-4f3c-8dcd-b7856198701c None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:22.427343 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2f9819-2db8-4f3c-8dcd-b7856198701c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:22.432687 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b065cd7f-f287-4ac4-9b4d-68363db623af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:22.433539 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b065cd7f-f287-4ac4-9b4d-68363db623af None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:22.433826 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b065cd7f-f287-4ac4-9b4d-68363db623af None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:22.434103 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b065cd7f-f287-4ac4-9b4d-68363db623af None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:22.434940 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b065cd7f-f287-4ac4-9b4d-68363db623af None admin] RBAC: Adding query filter params (role.id=36abe9b50fd8479c86c4f8f70fd85aa3, scope.project.id=446967649a7d47af8f0eb54b376ac1fa, user.id=b8b1e0fcb00a456ca08ac64d408e47a0) {{(pid=80012) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 13:59:22.435248 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b065cd7f-f287-4ac4-9b4d-68363db623af None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:22.436751 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b065cd7f-f287-4ac4-9b4d-68363db623af None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:22.444121 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 124/245] 10.222.0.36 () {56 vars in 1374 bytes} [Tue May 3 13:59:22 2022] GET /identity/v3/role_assignments?user.id=b8b1e0fcb00a456ca08ac64d408e47a0&scope.project.id=446967649a7d47af8f0eb54b376ac1fa&role.id=36abe9b50fd8479c86c4f8f70fd85aa3 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 13:59:22.451176 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-aa2f9819-2db8-4f3c-8dcd-b7856198701c None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 13:59:22.452408 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-aa2f9819-2db8-4f3c-8dcd-b7856198701c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 13:59:22.460175 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b065cd7f-f287-4ac4-9b4d-68363db623af None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:22.560137 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 122/246] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 3 13:59:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 03 13:59:22.596018 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2f9819-2db8-4f3c-8dcd-b7856198701c None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:22.682449 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b065cd7f-f287-4ac4-9b4d-68363db623af None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:22.705595 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2f9819-2db8-4f3c-8dcd-b7856198701c None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:22.722774 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f504f7dc-ffd5-4761-bbf6-4d43d45a6993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:22.723574 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f504f7dc-ffd5-4761-bbf6-4d43d45a6993 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:22.723849 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f504f7dc-ffd5-4761-bbf6-4d43d45a6993 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:22.724119 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f504f7dc-ffd5-4761-bbf6-4d43d45a6993 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:22.740111 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f504f7dc-ffd5-4761-bbf6-4d43d45a6993 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 13:59:22.744151 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e76fa2-5fef-4992-951f-d045a9c17e83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:22.744960 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e76fa2-5fef-4992-951f-d045a9c17e83 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:22.745239 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e76fa2-5fef-4992-951f-d045a9c17e83 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:22.745535 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e76fa2-5fef-4992-951f-d045a9c17e83 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:22.749168 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application [None req-f504f7dc-ffd5-4761-bbf6-4d43d45a6993 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 03 13:59:22.749168 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 13:59:22.749168 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 13:59:22.749168 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 13:59:22.749168 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 13:59:22.749168 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 13:59:22.749168 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 13:59:22.749168 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 13:59:22.749168 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 13:59:22.749168 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 13:59:22.749168 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 13:59:22.749168 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 13:59:22.749168 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 13:59:22.749168 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 13:59:22.749168 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 13:59:22.749168 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 13:59:22.750105 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 13:59:22.750105 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 13:59:22.750105 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 13:59:22.750105 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 13:59:22.750105 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 13:59:22.750105 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 13:59:22.750105 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 13:59:22.750105 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 13:59:22.750105 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 13:59:22.750105 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.get_or_create( May 03 13:59:22.750105 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 13:59:22.750105 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application with Lock( May 03 13:59:22.750105 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 13:59:22.750105 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._enter() May 03 13:59:22.750105 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 13:59:22.750105 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 13:59:22.755843 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 13:59:22.755843 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.creator() May 03 13:59:22.755843 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 13:59:22.755843 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application created_value = creator( May 03 13:59:22.755843 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 13:59:22.755843 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 13:59:22.755843 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 13:59:22.755843 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 13:59:22.755843 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 13:59:22.755843 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 13:59:22.755843 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 03 13:59:22.755843 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application May 03 13:59:22.755843 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 125/247] 10.222.0.36 () {56 vars in 1099 bytes} [Tue May 3 13:59:22 2022] GET /identity/v3/roles/reader => generated 84 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 13:59:22.755843 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4cf9b8-c360-46eb-b96a-841c13a5f3b2 None None] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:22.756585 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4cf9b8-c360-46eb-b96a-841c13a5f3b2 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:22.756585 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4cf9b8-c360-46eb-b96a-841c13a5f3b2 None None] PATH_INFO: `/` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:22.756585 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 126/248] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 3 13:59:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 13:59:22.758532 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4cf9b8-c360-46eb-b96a-841c13a5f3b2 None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:22.768043 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e76fa2-5fef-4992-951f-d045a9c17e83 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 13:59:22.775793 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application [None req-02e76fa2-5fef-4992-951f-d045a9c17e83 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 03 13:59:22.775793 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 13:59:22.775793 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 13:59:22.775793 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 13:59:22.775793 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 13:59:22.775793 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 13:59:22.775793 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 13:59:22.775793 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 13:59:22.775793 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 13:59:22.775793 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 13:59:22.775793 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 13:59:22.775793 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 13:59:22.775793 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 13:59:22.775793 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 13:59:22.775793 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 13:59:22.775793 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 13:59:22.776694 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 13:59:22.776694 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 13:59:22.776694 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 13:59:22.776694 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 13:59:22.776694 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 13:59:22.776694 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 13:59:22.776694 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 13:59:22.776694 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 13:59:22.776694 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 13:59:22.776694 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.get_or_create( May 03 13:59:22.776694 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 13:59:22.776694 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application with Lock( May 03 13:59:22.776694 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 13:59:22.776694 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._enter() May 03 13:59:22.776694 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 13:59:22.776694 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 13:59:22.777675 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 13:59:22.777675 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.creator() May 03 13:59:22.777675 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 13:59:22.777675 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application created_value = creator( May 03 13:59:22.777675 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 13:59:22.777675 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 13:59:22.777675 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 13:59:22.777675 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 13:59:22.777675 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 13:59:22.777675 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 13:59:22.777675 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 03 13:59:22.777675 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application May 03 13:59:22.777675 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 123/249] 10.222.0.36 () {56 vars in 1099 bytes} [Tue May 3 13:59:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 13:59:22.779726 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4c47ff-0b94-45f5-8134-c2b4c6019d95 None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:22.779726 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4c47ff-0b94-45f5-8134-c2b4c6019d95 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:22.779726 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4c47ff-0b94-45f5-8134-c2b4c6019d95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:22.796402 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-1b4c47ff-0b94-45f5-8134-c2b4c6019d95 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 13:59:22.797570 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-1b4c47ff-0b94-45f5-8134-c2b4c6019d95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 13:59:22.866748 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4cf9b8-c360-46eb-b96a-841c13a5f3b2 None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:22.868778 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 124/250] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 3 13:59:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 13:59:22.870824 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4c47ff-0b94-45f5-8134-c2b4c6019d95 None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:22.905035 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0265e2b-dbb1-431a-a49a-7afe20e006ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:22.906415 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0265e2b-dbb1-431a-a49a-7afe20e006ba None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:22.906699 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0265e2b-dbb1-431a-a49a-7afe20e006ba None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:22.906975 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0265e2b-dbb1-431a-a49a-7afe20e006ba None admin] PATH_INFO: `/v3/roles` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:22.907732 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0265e2b-dbb1-431a-a49a-7afe20e006ba None admin] RBAC: Adding query filter params (name=reader) {{(pid=80012) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 13:59:22.908039 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0265e2b-dbb1-431a-a49a-7afe20e006ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:22.909458 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0265e2b-dbb1-431a-a49a-7afe20e006ba None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:22.918264 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 127/251] 10.222.0.36 () {56 vars in 1101 bytes} [Tue May 3 13:59:22 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 13:59:22.919065 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0265e2b-dbb1-431a-a49a-7afe20e006ba None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:23.001749 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4c47ff-0b94-45f5-8134-c2b4c6019d95 None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:23.018281 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0265e2b-dbb1-431a-a49a-7afe20e006ba None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:23.039037 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c42b117-4bde-4122-87d6-c468506dd237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:23.039704 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c42b117-4bde-4122-87d6-c468506dd237 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:23.039979 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c42b117-4bde-4122-87d6-c468506dd237 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:23.040248 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c42b117-4bde-4122-87d6-c468506dd237 None admin] PATH_INFO: `/v3/roles` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:23.040986 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c42b117-4bde-4122-87d6-c468506dd237 None admin] RBAC: Adding query filter params (name=member) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 13:59:23.041294 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c42b117-4bde-4122-87d6-c468506dd237 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:23.043117 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c42b117-4bde-4122-87d6-c468506dd237 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:23.051761 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 125/252] 10.222.0.36 () {56 vars in 1101 bytes} [Tue May 3 13:59:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 13:59:23.052843 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c42b117-4bde-4122-87d6-c468506dd237 None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:23.062713 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4235709b-9dd0-4209-a5ac-507b9fcede0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:23.063936 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4235709b-9dd0-4209-a5ac-507b9fcede0b None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:23.063936 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4235709b-9dd0-4209-a5ac-507b9fcede0b None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:23.064269 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4235709b-9dd0-4209-a5ac-507b9fcede0b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:23.065221 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4235709b-9dd0-4209-a5ac-507b9fcede0b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:23.066692 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4235709b-9dd0-4209-a5ac-507b9fcede0b None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:23.068494 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 128/253] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 3 13:59:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 13:59:23.069049 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4235709b-9dd0-4209-a5ac-507b9fcede0b None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:23.149311 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c42b117-4bde-4122-87d6-c468506dd237 None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:23.167776 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4235709b-9dd0-4209-a5ac-507b9fcede0b None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:23.180945 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3e3cf4-a909-46ac-91f9-77ec90c6e45d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:23.181856 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3e3cf4-a909-46ac-91f9-77ec90c6e45d None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:23.182121 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3e3cf4-a909-46ac-91f9-77ec90c6e45d None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:23.182348 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3e3cf4-a909-46ac-91f9-77ec90c6e45d None admin] PATH_INFO: `/v3/users/99497a4e446f473ebd259b3bbc6a7722` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:23.194819 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3e3cf4-a909-46ac-91f9-77ec90c6e45d None admin] RBAC: Authorizing `identity:get_user(user_id=99497a4e446f473ebd259b3bbc6a7722)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:23.196242 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3e3cf4-a909-46ac-91f9-77ec90c6e45d None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:23.197912 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 126/254] 10.222.0.36 () {56 vars in 1177 bytes} [Tue May 3 13:59:23 2022] GET /identity/v3/users/99497a4e446f473ebd259b3bbc6a7722 => generated 297 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 13:59:23.199253 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df698192-f206-4cbe-a132-cff8ab09fc5b None None] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:23.199507 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df698192-f206-4cbe-a132-cff8ab09fc5b None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:23.199779 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df698192-f206-4cbe-a132-cff8ab09fc5b None None] PATH_INFO: `/` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:23.200981 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 127/255] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 3 13:59:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 13:59:23.204422 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108eaf90-dc12-421c-b7fa-1808154c1d81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:23.205515 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108eaf90-dc12-421c-b7fa-1808154c1d81 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:23.205793 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108eaf90-dc12-421c-b7fa-1808154c1d81 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:23.205899 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df698192-f206-4cbe-a132-cff8ab09fc5b None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:23.206066 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108eaf90-dc12-421c-b7fa-1808154c1d81 None admin] PATH_INFO: `/v3/users/4c8fd303f8604f889f687980e2f7ff7a` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:23.207257 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108eaf90-dc12-421c-b7fa-1808154c1d81 None admin] RBAC: Authorizing `identity:get_user(user_id=4c8fd303f8604f889f687980e2f7ff7a)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:23.208697 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108eaf90-dc12-421c-b7fa-1808154c1d81 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:23.210356 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 129/256] 10.222.0.36 () {56 vars in 1177 bytes} [Tue May 3 13:59:23 2022] GET /identity/v3/users/4c8fd303f8604f889f687980e2f7ff7a => generated 297 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 13:59:23.211097 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108eaf90-dc12-421c-b7fa-1808154c1d81 None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:23.301646 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df698192-f206-4cbe-a132-cff8ab09fc5b None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:23.306120 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108eaf90-dc12-421c-b7fa-1808154c1d81 None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:23.335336 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a7be83-a3a3-48d2-b7db-5144ae2ccc87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:23.335997 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a7be83-a3a3-48d2-b7db-5144ae2ccc87 None admin] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:23.336275 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a7be83-a3a3-48d2-b7db-5144ae2ccc87 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:23.336547 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a7be83-a3a3-48d2-b7db-5144ae2ccc87 None admin] PATH_INFO: `/v3/users` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:23.337250 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a7be83-a3a3-48d2-b7db-5144ae2ccc87 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:23.337569 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4039bb8f-fe75-4cd4-9505-9570200f35b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:23.338204 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4039bb8f-fe75-4cd4-9505-9570200f35b1 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:23.338478 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4039bb8f-fe75-4cd4-9505-9570200f35b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:23.338742 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4039bb8f-fe75-4cd4-9505-9570200f35b1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:23.338831 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a7be83-a3a3-48d2-b7db-5144ae2ccc87 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:23.358873 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 128/257] 10.222.0.36 () {60 vars in 1132 bytes} [Tue May 3 13:59:23 2022] POST /identity/v3/users => generated 293 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 13:59:23.362770 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f714b005-05a7-485b-b73d-b9990b318589 None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:23.363064 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f714b005-05a7-485b-b73d-b9990b318589 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:23.363335 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f714b005-05a7-485b-b73d-b9990b318589 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:23.381215 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-f714b005-05a7-485b-b73d-b9990b318589 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 13:59:23.382498 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-f714b005-05a7-485b-b73d-b9990b318589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 13:59:23.407037 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4039bb8f-fe75-4cd4-9505-9570200f35b1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:23.408424 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4039bb8f-fe75-4cd4-9505-9570200f35b1 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:23.454469 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 129/258] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 3 13:59:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 13:59:23.455362 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f714b005-05a7-485b-b73d-b9990b318589 None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:23.516397 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 130/259] 10.222.0.36 () {58 vars in 1282 bytes} [Tue May 3 13:59:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 03 13:59:23.516397 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4039bb8f-fe75-4cd4-9505-9570200f35b1 None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:23.570358 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f714b005-05a7-485b-b73d-b9990b318589 None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:23.604992 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a386cdca-1c10-498f-8ec3-2dc5080f60e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:23.605892 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a386cdca-1c10-498f-8ec3-2dc5080f60e7 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:23.606166 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a386cdca-1c10-498f-8ec3-2dc5080f60e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:23.606428 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a386cdca-1c10-498f-8ec3-2dc5080f60e7 None admin] PATH_INFO: `/v3/projects/446967649a7d47af8f0eb54b376ac1fa` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:23.607595 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a386cdca-1c10-498f-8ec3-2dc5080f60e7 None admin] RBAC: Authorizing `identity:get_project(project_id=446967649a7d47af8f0eb54b376ac1fa)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:23.609415 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a386cdca-1c10-498f-8ec3-2dc5080f60e7 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:23.611128 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 130/260] 10.222.0.36 () {56 vars in 1186 bytes} [Tue May 3 13:59:23 2022] GET /identity/v3/projects/446967649a7d47af8f0eb54b376ac1fa => generated 302 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 13:59:23.611901 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a386cdca-1c10-498f-8ec3-2dc5080f60e7 None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:23.619221 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4039bb8f-fe75-4cd4-9505-9570200f35b1 None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:23.660423 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec38ce70-34fc-4953-bf11-bc5a63a834c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:23.661170 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec38ce70-34fc-4953-bf11-bc5a63a834c2 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:23.661486 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec38ce70-34fc-4953-bf11-bc5a63a834c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:23.661765 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec38ce70-34fc-4953-bf11-bc5a63a834c2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:23.676218 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec38ce70-34fc-4953-bf11-bc5a63a834c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 13:59:23.685368 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application [None req-ec38ce70-34fc-4953-bf11-bc5a63a834c2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 03 13:59:23.685368 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 13:59:23.685368 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 13:59:23.685368 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 13:59:23.685368 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 13:59:23.685368 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 13:59:23.685368 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 13:59:23.685368 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 13:59:23.685368 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 13:59:23.685368 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 13:59:23.685368 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 13:59:23.685368 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 13:59:23.685368 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 13:59:23.685368 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 13:59:23.685368 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 13:59:23.685368 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 13:59:23.686324 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 13:59:23.686324 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 13:59:23.686324 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 13:59:23.686324 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 13:59:23.686324 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 13:59:23.686324 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 13:59:23.686324 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 13:59:23.686324 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 13:59:23.686324 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 13:59:23.686324 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.get_or_create( May 03 13:59:23.686324 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 13:59:23.686324 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application with Lock( May 03 13:59:23.686324 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 13:59:23.686324 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._enter() May 03 13:59:23.686324 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 13:59:23.686324 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 13:59:23.687134 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 13:59:23.687134 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.creator() May 03 13:59:23.687134 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 13:59:23.687134 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application created_value = creator( May 03 13:59:23.687134 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 13:59:23.687134 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 13:59:23.687134 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 13:59:23.687134 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 13:59:23.687134 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 13:59:23.687134 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 13:59:23.687134 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 03 13:59:23.687134 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application May 03 13:59:23.687134 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 131/261] 10.222.0.36 () {56 vars in 1114 bytes} [Tue May 3 13:59:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 13:59:23.687800 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec38ce70-34fc-4953-bf11-bc5a63a834c2 None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:23.737872 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a386cdca-1c10-498f-8ec3-2dc5080f60e7 None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:23.771584 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244273e4-f9ac-4009-bc47-779cf7700f55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:23.772454 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244273e4-f9ac-4009-bc47-779cf7700f55 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:23.772731 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244273e4-f9ac-4009-bc47-779cf7700f55 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:23.772998 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244273e4-f9ac-4009-bc47-779cf7700f55 None admin] PATH_INFO: `/v3/projects/446967649a7d47af8f0eb54b376ac1fa` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:23.774274 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244273e4-f9ac-4009-bc47-779cf7700f55 None admin] RBAC: Authorizing `identity:get_project(project_id=446967649a7d47af8f0eb54b376ac1fa)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:23.775779 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244273e4-f9ac-4009-bc47-779cf7700f55 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:23.777696 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 131/262] 10.222.0.36 () {56 vars in 1186 bytes} [Tue May 3 13:59:23 2022] GET /identity/v3/projects/446967649a7d47af8f0eb54b376ac1fa => generated 302 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 13:59:23.778281 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244273e4-f9ac-4009-bc47-779cf7700f55 None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:23.810422 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec38ce70-34fc-4953-bf11-bc5a63a834c2 None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:23.851483 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51abd3c3-9e0e-4b83-8956-1758187ab2bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:23.852813 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51abd3c3-9e0e-4b83-8956-1758187ab2bb None admin] REQUEST_METHOD: `PUT` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:23.853376 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51abd3c3-9e0e-4b83-8956-1758187ab2bb None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:23.853659 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51abd3c3-9e0e-4b83-8956-1758187ab2bb None admin] PATH_INFO: `/v3/projects/446967649a7d47af8f0eb54b376ac1fa/users/4c8fd303f8604f889f687980e2f7ff7a/roles/441fdc11e95b47f4813f72610e39018b` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:23.856706 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51abd3c3-9e0e-4b83-8956-1758187ab2bb None admin] RBAC: Authorizing `identity:create_grant(project_id=446967649a7d47af8f0eb54b376ac1fa, user_id=4c8fd303f8604f889f687980e2f7ff7a, role_id=441fdc11e95b47f4813f72610e39018b)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:23.858325 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51abd3c3-9e0e-4b83-8956-1758187ab2bb None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:23.876507 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 132/263] 10.222.0.36 () {58 vars in 1439 bytes} [Tue May 3 13:59:23 2022] PUT /identity/v3/projects/446967649a7d47af8f0eb54b376ac1fa/users/4c8fd303f8604f889f687980e2f7ff7a/roles/441fdc11e95b47f4813f72610e39018b => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 13:59:23.877804 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51abd3c3-9e0e-4b83-8956-1758187ab2bb None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:23.923945 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244273e4-f9ac-4009-bc47-779cf7700f55 None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:24.001259 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2045b43f-771e-4c62-be2e-99d0c6a0bf76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:24.002125 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2045b43f-771e-4c62-be2e-99d0c6a0bf76 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:24.002404 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2045b43f-771e-4c62-be2e-99d0c6a0bf76 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:24.002676 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2045b43f-771e-4c62-be2e-99d0c6a0bf76 None admin] PATH_INFO: `/v3/roles` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:24.003581 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2045b43f-771e-4c62-be2e-99d0c6a0bf76 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 13:59:24.003890 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2045b43f-771e-4c62-be2e-99d0c6a0bf76 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:24.005481 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2045b43f-771e-4c62-be2e-99d0c6a0bf76 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:24.015319 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 132/264] 10.222.0.36 () {56 vars in 1111 bytes} [Tue May 3 13:59:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 13:59:24.020848 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2045b43f-771e-4c62-be2e-99d0c6a0bf76 None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:24.106188 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51abd3c3-9e0e-4b83-8956-1758187ab2bb None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:24.135479 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2045b43f-771e-4c62-be2e-99d0c6a0bf76 None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:24.155812 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467d8b3e-8f1d-4ef0-b7ad-26c9221c0fc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:24.156474 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467d8b3e-8f1d-4ef0-b7ad-26c9221c0fc6 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:24.156748 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467d8b3e-8f1d-4ef0-b7ad-26c9221c0fc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:24.157018 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467d8b3e-8f1d-4ef0-b7ad-26c9221c0fc6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:24.157967 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467d8b3e-8f1d-4ef0-b7ad-26c9221c0fc6 None admin] RBAC: Adding query filter params (role.id=881b929165074739a253b35012fbc4fb, scope.project.id=446967649a7d47af8f0eb54b376ac1fa, user.id=99497a4e446f473ebd259b3bbc6a7722) {{(pid=80012) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 13:59:24.158273 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467d8b3e-8f1d-4ef0-b7ad-26c9221c0fc6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:24.159767 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467d8b3e-8f1d-4ef0-b7ad-26c9221c0fc6 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:24.166666 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 133/265] 10.222.0.36 () {56 vars in 1374 bytes} [Tue May 3 13:59:23 2022] GET /identity/v3/role_assignments?user.id=99497a4e446f473ebd259b3bbc6a7722&scope.project.id=446967649a7d47af8f0eb54b376ac1fa&role.id=881b929165074739a253b35012fbc4fb => generated 259 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 13:59:24.180615 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47056b60-ad59-4481-89dc-5359fb60de12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:24.181476 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47056b60-ad59-4481-89dc-5359fb60de12 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:24.181759 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47056b60-ad59-4481-89dc-5359fb60de12 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:24.182030 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47056b60-ad59-4481-89dc-5359fb60de12 None admin] PATH_INFO: `/v3/users/b8b1e0fcb00a456ca08ac64d408e47a0` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:24.184220 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47056b60-ad59-4481-89dc-5359fb60de12 None admin] RBAC: Authorizing `identity:get_user(user_id=b8b1e0fcb00a456ca08ac64d408e47a0)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:24.185773 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47056b60-ad59-4481-89dc-5359fb60de12 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:24.188385 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 133/266] 10.222.0.36 () {56 vars in 1177 bytes} [Tue May 3 13:59:24 2022] GET /identity/v3/users/b8b1e0fcb00a456ca08ac64d408e47a0 => generated 283 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 13:59:24.194686 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467d8b3e-8f1d-4ef0-b7ad-26c9221c0fc6 None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:24.323380 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467d8b3e-8f1d-4ef0-b7ad-26c9221c0fc6 None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:24.359052 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544016b7-8e2b-4f57-a223-f5e3d36f70cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:24.360094 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544016b7-8e2b-4f57-a223-f5e3d36f70cd None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:24.360565 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544016b7-8e2b-4f57-a223-f5e3d36f70cd None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:24.361029 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544016b7-8e2b-4f57-a223-f5e3d36f70cd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:24.430031 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544016b7-8e2b-4f57-a223-f5e3d36f70cd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:24.432008 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544016b7-8e2b-4f57-a223-f5e3d36f70cd None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:24.533391 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 134/267] 10.222.0.36 () {58 vars in 1282 bytes} [Tue May 3 13:59:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 03 13:59:24.538397 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47056b60-ad59-4481-89dc-5359fb60de12 None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:24.642177 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47056b60-ad59-4481-89dc-5359fb60de12 None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:24.684860 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361fbc28-3059-4510-85c8-3a66d0938422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:24.685681 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361fbc28-3059-4510-85c8-3a66d0938422 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:24.685962 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361fbc28-3059-4510-85c8-3a66d0938422 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:24.686398 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361fbc28-3059-4510-85c8-3a66d0938422 None admin] PATH_INFO: `/v3/projects/446967649a7d47af8f0eb54b376ac1fa` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:24.687795 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361fbc28-3059-4510-85c8-3a66d0938422 None admin] RBAC: Authorizing `identity:get_project(project_id=446967649a7d47af8f0eb54b376ac1fa)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:24.689266 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361fbc28-3059-4510-85c8-3a66d0938422 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:24.691215 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 134/268] 10.222.0.36 () {56 vars in 1186 bytes} [Tue May 3 13:59:24 2022] GET /identity/v3/projects/446967649a7d47af8f0eb54b376ac1fa => generated 302 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 13:59:24.697221 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544016b7-8e2b-4f57-a223-f5e3d36f70cd None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:24.856520 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544016b7-8e2b-4f57-a223-f5e3d36f70cd None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:24.906843 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755df4b5-e36e-4f5b-98a1-dbeff2635e54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:24.907495 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755df4b5-e36e-4f5b-98a1-dbeff2635e54 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:24.907771 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755df4b5-e36e-4f5b-98a1-dbeff2635e54 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:24.908041 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755df4b5-e36e-4f5b-98a1-dbeff2635e54 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:24.908870 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755df4b5-e36e-4f5b-98a1-dbeff2635e54 None admin] RBAC: Adding query filter params (role.id=bd29d35ea39b4ba293ffbf1ffbf4b940, scope.project.id=446967649a7d47af8f0eb54b376ac1fa, user.id=b8b1e0fcb00a456ca08ac64d408e47a0) {{(pid=80012) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 13:59:24.909177 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755df4b5-e36e-4f5b-98a1-dbeff2635e54 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:24.910691 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755df4b5-e36e-4f5b-98a1-dbeff2635e54 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:24.917911 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 135/269] 10.222.0.36 () {56 vars in 1374 bytes} [Tue May 3 13:59:24 2022] GET /identity/v3/role_assignments?user.id=b8b1e0fcb00a456ca08ac64d408e47a0&scope.project.id=446967649a7d47af8f0eb54b376ac1fa&role.id=bd29d35ea39b4ba293ffbf1ffbf4b940 => generated 608 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 13:59:25.974580 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1c660a-a24c-463f-a031-3880dd557665 None None] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:25.975109 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1c660a-a24c-463f-a031-3880dd557665 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:25.975109 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1c660a-a24c-463f-a031-3880dd557665 None None] PATH_INFO: `/` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:25.976498 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 135/270] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 3 13:59:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 13:59:25.981849 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe103a04-1b8a-4189-9600-45cf8ed17cf3 None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:25.982250 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe103a04-1b8a-4189-9600-45cf8ed17cf3 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:25.982436 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe103a04-1b8a-4189-9600-45cf8ed17cf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:25.990901 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0839a82e-69b0-470a-9676-678c02efacc9 None None] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:25.991179 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0839a82e-69b0-470a-9676-678c02efacc9 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:25.991455 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0839a82e-69b0-470a-9676-678c02efacc9 None None] PATH_INFO: `/` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:25.993049 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 136/271] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 3 13:59:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 13:59:25.998145 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b40c14-2e44-47e3-9ed1-6d73ce64cbaf None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:25.998428 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b40c14-2e44-47e3-9ed1-6d73ce64cbaf None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:25.998776 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b40c14-2e44-47e3-9ed1-6d73ce64cbaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:26.000337 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-fe103a04-1b8a-4189-9600-45cf8ed17cf3 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 13:59:26.001568 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-fe103a04-1b8a-4189-9600-45cf8ed17cf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 13:59:26.018833 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-f1b40c14-2e44-47e3-9ed1-6d73ce64cbaf None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 13:59:26.020469 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-f1b40c14-2e44-47e3-9ed1-6d73ce64cbaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 13:59:26.074513 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 136/272] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 3 13:59:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 13:59:26.099637 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe103a04-1b8a-4189-9600-45cf8ed17cf3 None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:26.103095 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 137/273] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 3 13:59:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 03 13:59:26.125979 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b40c14-2e44-47e3-9ed1-6d73ce64cbaf None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:26.201971 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe103a04-1b8a-4189-9600-45cf8ed17cf3 None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:26.234354 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a15845-452b-4cf1-be71-57c474871c87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:26.235094 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a15845-452b-4cf1-be71-57c474871c87 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:26.235351 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a15845-452b-4cf1-be71-57c474871c87 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:26.235684 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a15845-452b-4cf1-be71-57c474871c87 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:26.236797 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a15845-452b-4cf1-be71-57c474871c87 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:26.238278 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a15845-452b-4cf1-be71-57c474871c87 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:26.239915 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 137/274] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 3 13:59:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 13:59:26.245205 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a15845-452b-4cf1-be71-57c474871c87 None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:26.247060 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b40c14-2e44-47e3-9ed1-6d73ce64cbaf None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:26.288577 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8582d0-98f2-4302-99e4-6f707878d3cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:26.290322 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8582d0-98f2-4302-99e4-6f707878d3cf None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:26.291046 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8582d0-98f2-4302-99e4-6f707878d3cf None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:26.291508 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8582d0-98f2-4302-99e4-6f707878d3cf None admin] PATH_INFO: `/v3/roles/member` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:26.304600 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8582d0-98f2-4302-99e4-6f707878d3cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 13:59:26.312384 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application [None req-7d8582d0-98f2-4302-99e4-6f707878d3cf None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 03 13:59:26.312384 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 13:59:26.312384 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 13:59:26.312384 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 13:59:26.312384 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 13:59:26.312384 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 13:59:26.312384 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 13:59:26.312384 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 13:59:26.312384 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 13:59:26.312384 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 13:59:26.312384 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 13:59:26.312384 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 13:59:26.312384 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 13:59:26.312384 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 13:59:26.312384 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 13:59:26.312384 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 13:59:26.313325 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 13:59:26.313325 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 13:59:26.313325 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 13:59:26.313325 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 13:59:26.313325 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 13:59:26.313325 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 13:59:26.313325 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 13:59:26.313325 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 13:59:26.313325 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 13:59:26.313325 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.get_or_create( May 03 13:59:26.313325 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 13:59:26.313325 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application with Lock( May 03 13:59:26.313325 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 13:59:26.313325 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._enter() May 03 13:59:26.313325 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 13:59:26.313325 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 13:59:26.314153 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 13:59:26.314153 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.creator() May 03 13:59:26.314153 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 13:59:26.314153 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application created_value = creator( May 03 13:59:26.314153 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 13:59:26.314153 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 13:59:26.314153 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 13:59:26.314153 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 13:59:26.314153 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 13:59:26.314153 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 13:59:26.314153 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 03 13:59:26.314153 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application May 03 13:59:26.318487 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 138/275] 10.222.0.36 () {56 vars in 1099 bytes} [Tue May 3 13:59:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 13:59:26.319595 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8582d0-98f2-4302-99e4-6f707878d3cf None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:26.360475 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a15845-452b-4cf1-be71-57c474871c87 None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:26.403509 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7ce063-6ec4-4327-b0be-470bd74dfe6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:26.405046 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7ce063-6ec4-4327-b0be-470bd74dfe6f None admin] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:26.405569 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7ce063-6ec4-4327-b0be-470bd74dfe6f None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:26.406035 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7ce063-6ec4-4327-b0be-470bd74dfe6f None admin] PATH_INFO: `/v3/users` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:26.406946 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7ce063-6ec4-4327-b0be-470bd74dfe6f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:26.409007 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7ce063-6ec4-4327-b0be-470bd74dfe6f None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:26.419382 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8582d0-98f2-4302-99e4-6f707878d3cf None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:26.436387 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 138/276] 10.222.0.36 () {60 vars in 1132 bytes} [Tue May 3 13:59:26 2022] POST /identity/v3/users => generated 293 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 13:59:26.466695 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67a16e1-be9a-45ad-9bab-b960d93de0b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:26.467792 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67a16e1-be9a-45ad-9bab-b960d93de0b5 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:26.468270 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67a16e1-be9a-45ad-9bab-b960d93de0b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:26.468739 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67a16e1-be9a-45ad-9bab-b960d93de0b5 None admin] PATH_INFO: `/v3/roles` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:26.469716 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67a16e1-be9a-45ad-9bab-b960d93de0b5 None admin] RBAC: Adding query filter params (name=member) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 13:59:26.470255 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67a16e1-be9a-45ad-9bab-b960d93de0b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:26.471900 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67a16e1-be9a-45ad-9bab-b960d93de0b5 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:26.482399 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 139/277] 10.222.0.36 () {56 vars in 1101 bytes} [Tue May 3 13:59:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 13:59:26.493040 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7ce063-6ec4-4327-b0be-470bd74dfe6f None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:26.530754 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d234e82f-1bbc-434f-b9b8-dea7553fe0bd None None] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:26.531393 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d234e82f-1bbc-434f-b9b8-dea7553fe0bd None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:26.531913 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d234e82f-1bbc-434f-b9b8-dea7553fe0bd None None] PATH_INFO: `/` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:26.533927 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 140/278] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 3 13:59:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 13:59:26.540865 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8f4c38-6bbc-4ad3-8386-beaace3d0fac None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:26.540865 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8f4c38-6bbc-4ad3-8386-beaace3d0fac None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:26.540865 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8f4c38-6bbc-4ad3-8386-beaace3d0fac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:26.565117 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-5b8f4c38-6bbc-4ad3-8386-beaace3d0fac None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 13:59:26.567380 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-5b8f4c38-6bbc-4ad3-8386-beaace3d0fac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 13:59:26.605491 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7ce063-6ec4-4327-b0be-470bd74dfe6f None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:26.645174 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e964fe09-7566-4761-9f41-1562dc1901ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:26.646440 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e964fe09-7566-4761-9f41-1562dc1901ff None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:26.646683 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e964fe09-7566-4761-9f41-1562dc1901ff None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:26.646961 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e964fe09-7566-4761-9f41-1562dc1901ff None admin] PATH_INFO: `/v3/users/184634a6a66d4adeabf2e13e2765c86e` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:26.659363 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 141/279] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 3 13:59:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 03 13:59:26.667850 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e964fe09-7566-4761-9f41-1562dc1901ff None admin] RBAC: Authorizing `identity:get_user(user_id=184634a6a66d4adeabf2e13e2765c86e)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:26.669622 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e964fe09-7566-4761-9f41-1562dc1901ff None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:26.671647 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 139/280] 10.222.0.36 () {56 vars in 1177 bytes} [Tue May 3 13:59:26 2022] GET /identity/v3/users/184634a6a66d4adeabf2e13e2765c86e => generated 293 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 13:59:26.677532 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8f4c38-6bbc-4ad3-8386-beaace3d0fac None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:26.682964 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e964fe09-7566-4761-9f41-1562dc1901ff None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:26.797043 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8f4c38-6bbc-4ad3-8386-beaace3d0fac None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:26.809124 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e964fe09-7566-4761-9f41-1562dc1901ff None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:26.832550 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ee5b03-c7c3-43ec-87c4-c0ac839a2e4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:26.833223 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ee5b03-c7c3-43ec-87c4-c0ac839a2e4d None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:26.833539 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ee5b03-c7c3-43ec-87c4-c0ac839a2e4d None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:26.833817 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ee5b03-c7c3-43ec-87c4-c0ac839a2e4d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:26.834649 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ee5b03-c7c3-43ec-87c4-c0ac839a2e4d None admin] RBAC: Adding query filter params (role.id=441fdc11e95b47f4813f72610e39018b, user.id=184634a6a66d4adeabf2e13e2765c86e, scope.system=all) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 13:59:26.834956 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ee5b03-c7c3-43ec-87c4-c0ac839a2e4d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:26.836420 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ee5b03-c7c3-43ec-87c4-c0ac839a2e4d None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:26.843204 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 142/281] 10.222.0.36 () {56 vars in 1308 bytes} [Tue May 3 13:59:26 2022] GET /identity/v3/role_assignments?user.id=184634a6a66d4adeabf2e13e2765c86e&scope.system=all&role.id=441fdc11e95b47f4813f72610e39018b => generated 226 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 13:59:26.844495 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eeefa2-422c-4c46-980f-01a5c2226788 None None] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:26.844776 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eeefa2-422c-4c46-980f-01a5c2226788 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:26.845047 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eeefa2-422c-4c46-980f-01a5c2226788 None None] PATH_INFO: `/` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:26.846590 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 143/282] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 3 13:59:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 13:59:26.849497 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e681feca-aa86-4866-ae63-3a0ab2c61cc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:26.850605 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e681feca-aa86-4866-ae63-3a0ab2c61cc3 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:26.851091 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e681feca-aa86-4866-ae63-3a0ab2c61cc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:26.851556 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e681feca-aa86-4866-ae63-3a0ab2c61cc3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:26.852328 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbf8a09-1bfe-4c5d-bc12-11ab0136f8c9 None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:26.852702 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbf8a09-1bfe-4c5d-bc12-11ab0136f8c9 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:26.852968 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbf8a09-1bfe-4c5d-bc12-11ab0136f8c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:26.865854 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e681feca-aa86-4866-ae63-3a0ab2c61cc3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 13:59:26.872860 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-ecbf8a09-1bfe-4c5d-bc12-11ab0136f8c9 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 13:59:26.874126 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-ecbf8a09-1bfe-4c5d-bc12-11ab0136f8c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 13:59:26.875619 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application [None req-e681feca-aa86-4866-ae63-3a0ab2c61cc3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 03 13:59:26.875619 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 13:59:26.875619 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 13:59:26.875619 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 13:59:26.875619 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 13:59:26.875619 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 13:59:26.875619 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 13:59:26.875619 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 13:59:26.875619 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 13:59:26.875619 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 13:59:26.875619 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 13:59:26.875619 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 13:59:26.875619 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 13:59:26.875619 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 13:59:26.875619 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 13:59:26.875619 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 13:59:26.876500 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 13:59:26.876500 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 13:59:26.876500 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 13:59:26.876500 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 13:59:26.876500 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 13:59:26.876500 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 13:59:26.876500 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 13:59:26.876500 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 13:59:26.876500 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 13:59:26.876500 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.get_or_create( May 03 13:59:26.876500 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 13:59:26.876500 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application with Lock( May 03 13:59:26.876500 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 13:59:26.876500 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._enter() May 03 13:59:26.876500 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 13:59:26.876500 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 13:59:26.877377 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 13:59:26.877377 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.creator() May 03 13:59:26.877377 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 13:59:26.877377 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application created_value = creator( May 03 13:59:26.877377 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 13:59:26.877377 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 13:59:26.877377 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 13:59:26.877377 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 13:59:26.877377 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 13:59:26.877377 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 13:59:26.877377 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 03 13:59:26.877377 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application May 03 13:59:26.880731 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 140/283] 10.222.0.36 () {56 vars in 1099 bytes} [Tue May 3 13:59:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 13:59:26.887830 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e681feca-aa86-4866-ae63-3a0ab2c61cc3 None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:26.957842 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 144/284] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 3 13:59:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 03 13:59:26.983132 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbf8a09-1bfe-4c5d-bc12-11ab0136f8c9 None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:27.093788 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e681feca-aa86-4866-ae63-3a0ab2c61cc3 None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:27.129658 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae1f081-804f-498b-8a68-360f83ba4a74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:27.130474 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae1f081-804f-498b-8a68-360f83ba4a74 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:27.130843 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae1f081-804f-498b-8a68-360f83ba4a74 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:27.131211 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae1f081-804f-498b-8a68-360f83ba4a74 None admin] PATH_INFO: `/v3/roles` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:27.132050 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae1f081-804f-498b-8a68-360f83ba4a74 None admin] RBAC: Adding query filter params (name=member) {{(pid=80012) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 13:59:27.132444 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae1f081-804f-498b-8a68-360f83ba4a74 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:27.133945 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae1f081-804f-498b-8a68-360f83ba4a74 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:27.144488 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 141/285] 10.222.0.36 () {56 vars in 1101 bytes} [Tue May 3 13:59:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 13:59:27.149253 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae1f081-804f-498b-8a68-360f83ba4a74 None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:27.161442 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbf8a09-1bfe-4c5d-bc12-11ab0136f8c9 None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:27.218565 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daccba28-85b6-4a39-bac8-b1e3554903d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:27.219366 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daccba28-85b6-4a39-bac8-b1e3554903d6 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:27.219687 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daccba28-85b6-4a39-bac8-b1e3554903d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:27.220136 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daccba28-85b6-4a39-bac8-b1e3554903d6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:27.230625 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daccba28-85b6-4a39-bac8-b1e3554903d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 13:59:27.238484 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application [None req-daccba28-85b6-4a39-bac8-b1e3554903d6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 03 13:59:27.238484 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 13:59:27.238484 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 13:59:27.238484 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 13:59:27.238484 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 13:59:27.238484 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 13:59:27.238484 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 13:59:27.238484 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 13:59:27.238484 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 13:59:27.238484 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 13:59:27.238484 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 13:59:27.238484 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 13:59:27.238484 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 13:59:27.238484 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 13:59:27.238484 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 13:59:27.238484 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 13:59:27.239397 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 13:59:27.239397 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 13:59:27.239397 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 13:59:27.239397 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 13:59:27.239397 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 13:59:27.239397 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 13:59:27.239397 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 13:59:27.239397 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 13:59:27.239397 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 13:59:27.239397 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.get_or_create( May 03 13:59:27.239397 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 13:59:27.239397 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application with Lock( May 03 13:59:27.239397 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 13:59:27.239397 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._enter() May 03 13:59:27.239397 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 13:59:27.239397 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 13:59:27.240202 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 13:59:27.240202 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.creator() May 03 13:59:27.240202 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 13:59:27.240202 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application created_value = creator( May 03 13:59:27.240202 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 13:59:27.240202 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 13:59:27.240202 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 13:59:27.240202 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 13:59:27.240202 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 13:59:27.240202 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 13:59:27.240202 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 03 13:59:27.240202 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application May 03 13:59:27.240202 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 145/286] 10.222.0.36 () {56 vars in 1099 bytes} [Tue May 3 13:59:26 2022] GET /identity/v3/roles/reader => generated 84 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 13:59:27.245665 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daccba28-85b6-4a39-bac8-b1e3554903d6 None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:27.353920 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae1f081-804f-498b-8a68-360f83ba4a74 None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:27.384290 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daccba28-85b6-4a39-bac8-b1e3554903d6 None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:27.420803 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee11a35-e6b4-4451-ae12-dadf8ef886b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:27.423397 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee11a35-e6b4-4451-ae12-dadf8ef886b5 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:27.423397 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee11a35-e6b4-4451-ae12-dadf8ef886b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:27.423397 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee11a35-e6b4-4451-ae12-dadf8ef886b5 None admin] PATH_INFO: `/v3/roles` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:27.423397 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee11a35-e6b4-4451-ae12-dadf8ef886b5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 13:59:27.423397 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee11a35-e6b4-4451-ae12-dadf8ef886b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:27.424458 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee11a35-e6b4-4451-ae12-dadf8ef886b5 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:27.429078 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f893273-8369-488d-9e8e-f28b6cf9d1e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:27.430236 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f893273-8369-488d-9e8e-f28b6cf9d1e0 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:27.430711 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f893273-8369-488d-9e8e-f28b6cf9d1e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:27.431191 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f893273-8369-488d-9e8e-f28b6cf9d1e0 None admin] PATH_INFO: `/v3/users/4c8fd303f8604f889f687980e2f7ff7a` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:27.432586 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f893273-8369-488d-9e8e-f28b6cf9d1e0 None admin] RBAC: Authorizing `identity:get_user(user_id=4c8fd303f8604f889f687980e2f7ff7a)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:27.439185 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 146/287] 10.222.0.36 () {56 vars in 1101 bytes} [Tue May 3 13:59:27 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 13:59:27.439185 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee11a35-e6b4-4451-ae12-dadf8ef886b5 None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:27.441136 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f893273-8369-488d-9e8e-f28b6cf9d1e0 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:27.443123 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 142/288] 10.222.0.36 () {56 vars in 1177 bytes} [Tue May 3 13:59:27 2022] GET /identity/v3/users/4c8fd303f8604f889f687980e2f7ff7a => generated 297 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 13:59:27.448488 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f893273-8369-488d-9e8e-f28b6cf9d1e0 None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:27.550069 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee11a35-e6b4-4451-ae12-dadf8ef886b5 None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:27.592307 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdc6fe9-ce0c-4de0-a771-1ad84c1d14f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:27.593281 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdc6fe9-ce0c-4de0-a771-1ad84c1d14f6 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:27.593503 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdc6fe9-ce0c-4de0-a771-1ad84c1d14f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:27.593757 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdc6fe9-ce0c-4de0-a771-1ad84c1d14f6 None admin] PATH_INFO: `/v3/users/99497a4e446f473ebd259b3bbc6a7722` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:27.597977 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdc6fe9-ce0c-4de0-a771-1ad84c1d14f6 None admin] RBAC: Authorizing `identity:get_user(user_id=99497a4e446f473ebd259b3bbc6a7722)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:27.599438 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdc6fe9-ce0c-4de0-a771-1ad84c1d14f6 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:27.601454 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 147/289] 10.222.0.36 () {56 vars in 1177 bytes} [Tue May 3 13:59:27 2022] GET /identity/v3/users/99497a4e446f473ebd259b3bbc6a7722 => generated 297 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 13:59:27.606416 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdc6fe9-ce0c-4de0-a771-1ad84c1d14f6 None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:27.626191 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f893273-8369-488d-9e8e-f28b6cf9d1e0 None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:27.670002 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab367acf-296a-4a66-bd1e-58ff94b1562e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:27.670700 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab367acf-296a-4a66-bd1e-58ff94b1562e None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:27.670974 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab367acf-296a-4a66-bd1e-58ff94b1562e None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:27.671244 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab367acf-296a-4a66-bd1e-58ff94b1562e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:27.772689 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab367acf-296a-4a66-bd1e-58ff94b1562e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:27.774156 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab367acf-296a-4a66-bd1e-58ff94b1562e None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:27.792230 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdc6fe9-ce0c-4de0-a771-1ad84c1d14f6 None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:27.843289 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513c9f8a-e85c-4244-a121-a5a7419b8222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:27.844198 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513c9f8a-e85c-4244-a121-a5a7419b8222 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:27.844474 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513c9f8a-e85c-4244-a121-a5a7419b8222 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:27.844748 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513c9f8a-e85c-4244-a121-a5a7419b8222 None admin] PATH_INFO: `/v3/projects/446967649a7d47af8f0eb54b376ac1fa` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:27.845986 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513c9f8a-e85c-4244-a121-a5a7419b8222 None admin] RBAC: Authorizing `identity:get_project(project_id=446967649a7d47af8f0eb54b376ac1fa)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:27.847453 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513c9f8a-e85c-4244-a121-a5a7419b8222 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:27.849161 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 148/290] 10.222.0.36 () {56 vars in 1186 bytes} [Tue May 3 13:59:27 2022] GET /identity/v3/projects/446967649a7d47af8f0eb54b376ac1fa => generated 302 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 13:59:27.876099 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513c9f8a-e85c-4244-a121-a5a7419b8222 None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:27.942931 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 143/291] 10.222.0.36 () {58 vars in 1282 bytes} [Tue May 3 13:59:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 495 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 03 13:59:27.948335 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab367acf-296a-4a66-bd1e-58ff94b1562e None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:28.000617 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513c9f8a-e85c-4244-a121-a5a7419b8222 None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:28.033681 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6220aec9-6589-4208-854f-b731915f66fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:28.034573 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6220aec9-6589-4208-854f-b731915f66fd None admin] REQUEST_METHOD: `PUT` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:28.034847 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6220aec9-6589-4208-854f-b731915f66fd None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:28.035119 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6220aec9-6589-4208-854f-b731915f66fd None admin] PATH_INFO: `/v3/projects/446967649a7d47af8f0eb54b376ac1fa/users/99497a4e446f473ebd259b3bbc6a7722/roles/881b929165074739a253b35012fbc4fb` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:28.039793 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6220aec9-6589-4208-854f-b731915f66fd None admin] RBAC: Authorizing `identity:create_grant(project_id=446967649a7d47af8f0eb54b376ac1fa, user_id=99497a4e446f473ebd259b3bbc6a7722, role_id=881b929165074739a253b35012fbc4fb)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:28.041249 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6220aec9-6589-4208-854f-b731915f66fd None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:28.095273 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 149/292] 10.222.0.36 () {58 vars in 1439 bytes} [Tue May 3 13:59:27 2022] PUT /identity/v3/projects/446967649a7d47af8f0eb54b376ac1fa/users/99497a4e446f473ebd259b3bbc6a7722/roles/881b929165074739a253b35012fbc4fb => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 13:59:28.130836 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab367acf-296a-4a66-bd1e-58ff94b1562e None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:28.179964 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa5bfe1-b338-4f50-9cf6-743c5342342a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:28.180840 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa5bfe1-b338-4f50-9cf6-743c5342342a None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:28.181113 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa5bfe1-b338-4f50-9cf6-743c5342342a None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:28.181405 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa5bfe1-b338-4f50-9cf6-743c5342342a None admin] PATH_INFO: `/v3/projects/446967649a7d47af8f0eb54b376ac1fa` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:28.184851 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa5bfe1-b338-4f50-9cf6-743c5342342a None admin] RBAC: Authorizing `identity:get_project(project_id=446967649a7d47af8f0eb54b376ac1fa)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:28.186357 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa5bfe1-b338-4f50-9cf6-743c5342342a None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:28.188305 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 144/293] 10.222.0.36 () {56 vars in 1186 bytes} [Tue May 3 13:59:27 2022] GET /identity/v3/projects/446967649a7d47af8f0eb54b376ac1fa => generated 302 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 13:59:28.194236 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6220aec9-6589-4208-854f-b731915f66fd None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:28.312068 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6220aec9-6589-4208-854f-b731915f66fd None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:28.359917 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5d3709-f1df-4d2f-bdf1-a6185b06f429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:28.360594 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5d3709-f1df-4d2f-bdf1-a6185b06f429 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:28.360870 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5d3709-f1df-4d2f-bdf1-a6185b06f429 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:28.361139 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5d3709-f1df-4d2f-bdf1-a6185b06f429 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:28.362008 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5d3709-f1df-4d2f-bdf1-a6185b06f429 None admin] RBAC: Adding query filter params (role.id=441fdc11e95b47f4813f72610e39018b, scope.project.id=446967649a7d47af8f0eb54b376ac1fa, user.id=4c8fd303f8604f889f687980e2f7ff7a) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 13:59:28.362329 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5d3709-f1df-4d2f-bdf1-a6185b06f429 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:28.363781 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5d3709-f1df-4d2f-bdf1-a6185b06f429 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:28.374834 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 150/294] 10.222.0.36 () {56 vars in 1374 bytes} [Tue May 3 13:59:28 2022] GET /identity/v3/role_assignments?user.id=4c8fd303f8604f889f687980e2f7ff7a&scope.project.id=446967649a7d47af8f0eb54b376ac1fa&role.id=441fdc11e95b47f4813f72610e39018b => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 13:59:29.175220 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae238705-1ff9-4555-b7dc-fc3db02a0f60 None None] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:29.176223 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae238705-1ff9-4555-b7dc-fc3db02a0f60 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:29.176725 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae238705-1ff9-4555-b7dc-fc3db02a0f60 None None] PATH_INFO: `/` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:29.178371 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 145/295] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 3 13:59:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 13:59:29.183851 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6412f3ce-1b80-4188-814b-e0277268c093 None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:29.184651 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6412f3ce-1b80-4188-814b-e0277268c093 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:29.185123 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6412f3ce-1b80-4188-814b-e0277268c093 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:29.201985 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-6412f3ce-1b80-4188-814b-e0277268c093 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 13:59:29.203513 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-6412f3ce-1b80-4188-814b-e0277268c093 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 13:59:29.264256 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335072f2-c1ab-4e66-86c2-dd1278f7f50d None None] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:29.264535 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335072f2-c1ab-4e66-86c2-dd1278f7f50d None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:29.265054 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335072f2-c1ab-4e66-86c2-dd1278f7f50d None None] PATH_INFO: `/` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:29.266538 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 146/296] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 3 13:59:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 13:59:29.274661 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c267be4-1a16-4f55-88d1-8fac379981bc None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:29.275194 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c267be4-1a16-4f55-88d1-8fac379981bc None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:29.275781 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c267be4-1a16-4f55-88d1-8fac379981bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:29.278047 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 151/297] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 3 13:59:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 13:59:29.295035 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-9c267be4-1a16-4f55-88d1-8fac379981bc None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 13:59:29.296600 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-9c267be4-1a16-4f55-88d1-8fac379981bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 13:59:29.300962 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6412f3ce-1b80-4188-814b-e0277268c093 None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:29.389389 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 147/298] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 3 13:59:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 13:59:29.406429 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c267be4-1a16-4f55-88d1-8fac379981bc None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:29.408293 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6412f3ce-1b80-4188-814b-e0277268c093 None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:29.441875 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffc87d9-35d9-42af-90cd-d56524cbf833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:29.442682 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffc87d9-35d9-42af-90cd-d56524cbf833 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:29.442958 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffc87d9-35d9-42af-90cd-d56524cbf833 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:29.443226 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffc87d9-35d9-42af-90cd-d56524cbf833 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:29.454254 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffc87d9-35d9-42af-90cd-d56524cbf833 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 13:59:29.461938 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application [None req-fffc87d9-35d9-42af-90cd-d56524cbf833 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 03 13:59:29.461938 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 13:59:29.461938 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 13:59:29.461938 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 13:59:29.461938 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 13:59:29.461938 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 13:59:29.461938 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 13:59:29.461938 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 13:59:29.461938 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 13:59:29.461938 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 13:59:29.461938 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 13:59:29.461938 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 13:59:29.461938 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 13:59:29.461938 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 13:59:29.461938 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 13:59:29.461938 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 13:59:29.463024 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 13:59:29.463024 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 13:59:29.463024 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 13:59:29.463024 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 13:59:29.463024 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 13:59:29.463024 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 13:59:29.463024 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 13:59:29.463024 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 13:59:29.463024 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 13:59:29.463024 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.get_or_create( May 03 13:59:29.463024 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 13:59:29.463024 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application with Lock( May 03 13:59:29.463024 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 13:59:29.463024 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._enter() May 03 13:59:29.463024 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 13:59:29.463024 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 13:59:29.464792 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 13:59:29.464792 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.creator() May 03 13:59:29.464792 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 13:59:29.464792 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application created_value = creator( May 03 13:59:29.464792 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 13:59:29.464792 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 13:59:29.464792 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 13:59:29.464792 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 13:59:29.464792 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 13:59:29.464792 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 13:59:29.464792 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 03 13:59:29.464792 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application May 03 13:59:29.468418 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 152/299] 10.222.0.36 () {56 vars in 1099 bytes} [Tue May 3 13:59:29 2022] GET /identity/v3/roles/reader => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 13:59:29.469569 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffc87d9-35d9-42af-90cd-d56524cbf833 None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:29.529356 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c267be4-1a16-4f55-88d1-8fac379981bc None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:29.566634 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffc87d9-35d9-42af-90cd-d56524cbf833 None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:29.567801 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fcb4a4-eff5-45d9-a1f5-e1f0f514d643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:29.569611 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fcb4a4-eff5-45d9-a1f5-e1f0f514d643 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:29.569893 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fcb4a4-eff5-45d9-a1f5-e1f0f514d643 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:29.570159 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fcb4a4-eff5-45d9-a1f5-e1f0f514d643 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:29.571340 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fcb4a4-eff5-45d9-a1f5-e1f0f514d643 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:29.572765 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fcb4a4-eff5-45d9-a1f5-e1f0f514d643 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:29.574575 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 148/300] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 3 13:59:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 13:59:29.575706 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6720e1-06d0-4345-b9f7-1d9ef842e8d4 None None] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:29.575987 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6720e1-06d0-4345-b9f7-1d9ef842e8d4 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:29.576259 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6720e1-06d0-4345-b9f7-1d9ef842e8d4 None None] PATH_INFO: `/` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:29.577745 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 149/301] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 3 13:59:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 13:59:29.582502 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6720e1-06d0-4345-b9f7-1d9ef842e8d4 None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:29.604202 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52c2da6-14d4-4dad-9dc4-7cbfef99be0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:29.604870 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52c2da6-14d4-4dad-9dc4-7cbfef99be0c None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:29.605147 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52c2da6-14d4-4dad-9dc4-7cbfef99be0c None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:29.605447 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52c2da6-14d4-4dad-9dc4-7cbfef99be0c None admin] PATH_INFO: `/v3/roles` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:29.606183 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52c2da6-14d4-4dad-9dc4-7cbfef99be0c None admin] RBAC: Adding query filter params (name=reader) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 13:59:29.606485 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52c2da6-14d4-4dad-9dc4-7cbfef99be0c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:29.607895 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52c2da6-14d4-4dad-9dc4-7cbfef99be0c None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:29.615887 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 153/302] 10.222.0.36 () {56 vars in 1101 bytes} [Tue May 3 13:59:29 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 13:59:29.617154 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09e6b28-32ab-4118-8425-83f2bce0a334 None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:29.617465 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09e6b28-32ab-4118-8425-83f2bce0a334 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:29.617740 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09e6b28-32ab-4118-8425-83f2bce0a334 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:29.633469 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-a09e6b28-32ab-4118-8425-83f2bce0a334 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 13:59:29.634643 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-a09e6b28-32ab-4118-8425-83f2bce0a334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 13:59:29.685505 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6720e1-06d0-4345-b9f7-1d9ef842e8d4 None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:29.694966 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 154/303] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 3 13:59:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 13:59:29.702370 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09e6b28-32ab-4118-8425-83f2bce0a334 None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:29.722704 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec06042e-83b2-4866-a45e-37b3b7c99fcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:29.723375 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec06042e-83b2-4866-a45e-37b3b7c99fcf None admin] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:29.724088 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec06042e-83b2-4866-a45e-37b3b7c99fcf None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:29.724370 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec06042e-83b2-4866-a45e-37b3b7c99fcf None admin] PATH_INFO: `/v3/groups` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:29.725354 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec06042e-83b2-4866-a45e-37b3b7c99fcf None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:29.727258 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec06042e-83b2-4866-a45e-37b3b7c99fcf None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:29.745438 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 150/304] 10.222.0.36 () {60 vars in 1134 bytes} [Tue May 3 13:59:29 2022] POST /identity/v3/groups => generated 229 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 13:59:29.746429 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec06042e-83b2-4866-a45e-37b3b7c99fcf None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:29.832577 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09e6b28-32ab-4118-8425-83f2bce0a334 None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:29.863628 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec06042e-83b2-4866-a45e-37b3b7c99fcf None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:29.873924 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f86faf8-6c6a-49db-baac-c7c64cc7ee03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:29.875654 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f86faf8-6c6a-49db-baac-c7c64cc7ee03 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:29.875937 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f86faf8-6c6a-49db-baac-c7c64cc7ee03 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:29.876211 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f86faf8-6c6a-49db-baac-c7c64cc7ee03 None admin] PATH_INFO: `/v3/users/2acfd51d411a4f4a8c24ead3a40f0f6e` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:29.893421 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f86faf8-6c6a-49db-baac-c7c64cc7ee03 None admin] RBAC: Authorizing `identity:get_user(user_id=2acfd51d411a4f4a8c24ead3a40f0f6e)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:29.895260 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f86faf8-6c6a-49db-baac-c7c64cc7ee03 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:29.897400 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 155/305] 10.222.0.36 () {56 vars in 1177 bytes} [Tue May 3 13:59:29 2022] GET /identity/v3/users/2acfd51d411a4f4a8c24ead3a40f0f6e => generated 293 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 13:59:29.903001 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f86faf8-6c6a-49db-baac-c7c64cc7ee03 None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:29.912180 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a44e63-ffa9-4d22-b9ca-a1fa7a5ec2f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:29.913438 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a44e63-ffa9-4d22-b9ca-a1fa7a5ec2f2 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:29.914338 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a44e63-ffa9-4d22-b9ca-a1fa7a5ec2f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:29.914845 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a44e63-ffa9-4d22-b9ca-a1fa7a5ec2f2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:29.930622 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a44e63-ffa9-4d22-b9ca-a1fa7a5ec2f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 13:59:29.941931 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application [None req-f9a44e63-ffa9-4d22-b9ca-a1fa7a5ec2f2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 03 13:59:29.941931 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 13:59:29.941931 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 13:59:29.941931 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 13:59:29.941931 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 13:59:29.941931 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 13:59:29.941931 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 13:59:29.941931 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 13:59:29.941931 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 13:59:29.941931 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 13:59:29.941931 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 13:59:29.941931 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 13:59:29.941931 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 13:59:29.941931 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 13:59:29.941931 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 13:59:29.941931 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 13:59:29.942886 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 13:59:29.942886 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 13:59:29.942886 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 13:59:29.942886 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 13:59:29.942886 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 13:59:29.942886 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 13:59:29.942886 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 13:59:29.942886 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 13:59:29.942886 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 13:59:29.942886 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.get_or_create( May 03 13:59:29.942886 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 13:59:29.942886 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application with Lock( May 03 13:59:29.942886 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 13:59:29.942886 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._enter() May 03 13:59:29.942886 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 13:59:29.942886 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 13:59:29.943708 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 13:59:29.943708 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.creator() May 03 13:59:29.943708 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 13:59:29.943708 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application created_value = creator( May 03 13:59:29.943708 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 13:59:29.943708 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 13:59:29.943708 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 13:59:29.943708 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 13:59:29.943708 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 13:59:29.943708 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 13:59:29.943708 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 03 13:59:29.943708 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application May 03 13:59:29.946777 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 151/306] 10.222.0.36 () {56 vars in 1099 bytes} [Tue May 3 13:59:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 13:59:29.953576 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a44e63-ffa9-4d22-b9ca-a1fa7a5ec2f2 None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:30.020463 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f86faf8-6c6a-49db-baac-c7c64cc7ee03 None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:30.068629 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a44e63-ffa9-4d22-b9ca-a1fa7a5ec2f2 None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:30.069800 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032939de-c767-4589-bad8-6625a797004a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:30.070848 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032939de-c767-4589-bad8-6625a797004a None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:30.072090 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032939de-c767-4589-bad8-6625a797004a None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:30.072547 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032939de-c767-4589-bad8-6625a797004a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:30.073622 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032939de-c767-4589-bad8-6625a797004a None admin] RBAC: Adding query filter params (role.id=881b929165074739a253b35012fbc4fb, user.id=2acfd51d411a4f4a8c24ead3a40f0f6e, scope.system=all) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 13:59:30.074105 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032939de-c767-4589-bad8-6625a797004a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:30.075736 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032939de-c767-4589-bad8-6625a797004a None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:30.082947 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 156/307] 10.222.0.36 () {56 vars in 1308 bytes} [Tue May 3 13:59:29 2022] GET /identity/v3/role_assignments?user.id=2acfd51d411a4f4a8c24ead3a40f0f6e&scope.system=all&role.id=881b929165074739a253b35012fbc4fb => generated 226 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 13:59:30.109134 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60de722-7503-43fe-823e-3d319364b590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:30.109855 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60de722-7503-43fe-823e-3d319364b590 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:30.110132 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60de722-7503-43fe-823e-3d319364b590 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:30.110402 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60de722-7503-43fe-823e-3d319364b590 None admin] PATH_INFO: `/v3/roles` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:30.111229 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60de722-7503-43fe-823e-3d319364b590 None admin] RBAC: Adding query filter params (name=member) {{(pid=80012) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 13:59:30.111537 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60de722-7503-43fe-823e-3d319364b590 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:30.112964 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60de722-7503-43fe-823e-3d319364b590 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:30.127993 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 152/308] 10.222.0.36 () {56 vars in 1101 bytes} [Tue May 3 13:59:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 13:59:30.129523 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032939de-c767-4589-bad8-6625a797004a None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:30.246337 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032939de-c767-4589-bad8-6625a797004a None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:30.289313 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6712eb9-d111-4782-89fb-ff9abd45e8ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:30.289313 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6712eb9-d111-4782-89fb-ff9abd45e8ca None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:30.289313 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6712eb9-d111-4782-89fb-ff9abd45e8ca None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:30.289313 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6712eb9-d111-4782-89fb-ff9abd45e8ca None admin] PATH_INFO: `/v3/users/184634a6a66d4adeabf2e13e2765c86e` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:30.290011 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6712eb9-d111-4782-89fb-ff9abd45e8ca None admin] RBAC: Authorizing `identity:get_user(user_id=184634a6a66d4adeabf2e13e2765c86e)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:30.291521 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6712eb9-d111-4782-89fb-ff9abd45e8ca None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:30.293523 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 157/309] 10.222.0.36 () {56 vars in 1177 bytes} [Tue May 3 13:59:30 2022] GET /identity/v3/users/184634a6a66d4adeabf2e13e2765c86e => generated 293 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 13:59:30.299287 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60de722-7503-43fe-823e-3d319364b590 None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:30.396117 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60de722-7503-43fe-823e-3d319364b590 None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:30.428700 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a963a1a-9b42-4fa1-9292-03b657e02df9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:30.429929 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a963a1a-9b42-4fa1-9292-03b657e02df9 None admin] REQUEST_METHOD: `PUT` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:30.430407 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a963a1a-9b42-4fa1-9292-03b657e02df9 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:30.430921 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a963a1a-9b42-4fa1-9292-03b657e02df9 None admin] PATH_INFO: `/v3/system/users/184634a6a66d4adeabf2e13e2765c86e/roles/441fdc11e95b47f4813f72610e39018b` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:30.432598 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a963a1a-9b42-4fa1-9292-03b657e02df9 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=184634a6a66d4adeabf2e13e2765c86e, role_id=441fdc11e95b47f4813f72610e39018b)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:30.434191 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a963a1a-9b42-4fa1-9292-03b657e02df9 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:30.446069 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 153/310] 10.222.0.36 () {58 vars in 1334 bytes} [Tue May 3 13:59:30 2022] PUT /identity/v3/system/users/184634a6a66d4adeabf2e13e2765c86e/roles/441fdc11e95b47f4813f72610e39018b => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 13:59:30.671662 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60d06e3-ca33-44c1-9d0a-ed3c9ffd25b1 None None] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:30.671863 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60d06e3-ca33-44c1-9d0a-ed3c9ffd25b1 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:30.672144 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60d06e3-ca33-44c1-9d0a-ed3c9ffd25b1 None None] PATH_INFO: `/` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:30.673734 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 158/311] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 3 13:59:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 13:59:30.679096 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac973d2-5f15-42fa-9279-dc9c45cfda5a None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:30.679390 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac973d2-5f15-42fa-9279-dc9c45cfda5a None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:30.679674 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac973d2-5f15-42fa-9279-dc9c45cfda5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:30.696866 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-3ac973d2-5f15-42fa-9279-dc9c45cfda5a None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 13:59:30.698154 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-3ac973d2-5f15-42fa-9279-dc9c45cfda5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 13:59:30.764912 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 154/312] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 3 13:59:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 13:59:30.788092 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60d06e3-ca33-44c1-9d0a-ed3c9ffd25b1 None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:30.887367 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60d06e3-ca33-44c1-9d0a-ed3c9ffd25b1 None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:30.921895 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3527efe6-16ca-421a-a53f-6a7933bce035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:30.922742 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3527efe6-16ca-421a-a53f-6a7933bce035 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:30.923023 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3527efe6-16ca-421a-a53f-6a7933bce035 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:30.923296 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3527efe6-16ca-421a-a53f-6a7933bce035 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:30.933646 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3527efe6-16ca-421a-a53f-6a7933bce035 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 13:59:30.941892 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application [None req-3527efe6-16ca-421a-a53f-6a7933bce035 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 03 13:59:30.941892 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 13:59:30.941892 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 13:59:30.941892 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 13:59:30.941892 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 13:59:30.941892 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 13:59:30.941892 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 13:59:30.941892 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 13:59:30.941892 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 13:59:30.941892 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 13:59:30.941892 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 13:59:30.941892 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 13:59:30.941892 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 13:59:30.941892 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 13:59:30.941892 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 13:59:30.941892 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 13:59:30.942787 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 13:59:30.942787 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 13:59:30.942787 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 13:59:30.942787 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 13:59:30.942787 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 13:59:30.942787 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 13:59:30.942787 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 13:59:30.942787 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 13:59:30.942787 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 13:59:30.942787 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.get_or_create( May 03 13:59:30.942787 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 13:59:30.942787 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application with Lock( May 03 13:59:30.942787 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 13:59:30.942787 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._enter() May 03 13:59:30.942787 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 13:59:30.942787 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 13:59:30.943609 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 13:59:30.943609 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.creator() May 03 13:59:30.943609 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 13:59:30.943609 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application created_value = creator( May 03 13:59:30.943609 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 13:59:30.943609 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 13:59:30.943609 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 13:59:30.943609 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 13:59:30.943609 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 13:59:30.943609 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 13:59:30.943609 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 03 13:59:30.943609 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application May 03 13:59:30.943609 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 159/313] 10.222.0.36 () {56 vars in 1099 bytes} [Tue May 3 13:59:30 2022] GET /identity/v3/roles/reader => generated 84 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 13:59:30.950333 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac973d2-5f15-42fa-9279-dc9c45cfda5a None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:31.049600 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac973d2-5f15-42fa-9279-dc9c45cfda5a None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:31.084536 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43128a1d-5fbe-4bf4-9f17-7d00a45a21b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:31.085219 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43128a1d-5fbe-4bf4-9f17-7d00a45a21b4 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:31.085526 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43128a1d-5fbe-4bf4-9f17-7d00a45a21b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:31.085803 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43128a1d-5fbe-4bf4-9f17-7d00a45a21b4 None admin] PATH_INFO: `/v3/roles` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:31.086563 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43128a1d-5fbe-4bf4-9f17-7d00a45a21b4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80012) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 13:59:31.086867 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43128a1d-5fbe-4bf4-9f17-7d00a45a21b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:31.088243 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43128a1d-5fbe-4bf4-9f17-7d00a45a21b4 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:31.097457 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 155/314] 10.222.0.36 () {56 vars in 1101 bytes} [Tue May 3 13:59:30 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 13:59:31.103107 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3527efe6-16ca-421a-a53f-6a7933bce035 None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:31.205210 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3527efe6-16ca-421a-a53f-6a7933bce035 None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:31.239917 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9aaf3f2-5064-4296-a60e-cacc46447026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:31.240861 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aaf3f2-5064-4296-a60e-cacc46447026 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:31.241141 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aaf3f2-5064-4296-a60e-cacc46447026 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:31.241493 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aaf3f2-5064-4296-a60e-cacc46447026 None admin] PATH_INFO: `/v3/users/99497a4e446f473ebd259b3bbc6a7722` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:31.242808 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9aaf3f2-5064-4296-a60e-cacc46447026 None admin] RBAC: Authorizing `identity:get_user(user_id=99497a4e446f473ebd259b3bbc6a7722)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:31.244288 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9aaf3f2-5064-4296-a60e-cacc46447026 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:31.246059 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 160/315] 10.222.0.36 () {56 vars in 1177 bytes} [Tue May 3 13:59:31 2022] GET /identity/v3/users/99497a4e446f473ebd259b3bbc6a7722 => generated 297 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 13:59:31.252320 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43128a1d-5fbe-4bf4-9f17-7d00a45a21b4 None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:31.350802 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43128a1d-5fbe-4bf4-9f17-7d00a45a21b4 None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:31.383787 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874c7fd9-296c-4d77-8728-3deba3f7faeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:31.384445 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874c7fd9-296c-4d77-8728-3deba3f7faeb None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:31.384729 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874c7fd9-296c-4d77-8728-3deba3f7faeb None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:31.385008 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874c7fd9-296c-4d77-8728-3deba3f7faeb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:31.451857 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874c7fd9-296c-4d77-8728-3deba3f7faeb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:31.453348 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874c7fd9-296c-4d77-8728-3deba3f7faeb None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:31.551348 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 156/316] 10.222.0.36 () {58 vars in 1282 bytes} [Tue May 3 13:59:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 03 13:59:31.557004 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9aaf3f2-5064-4296-a60e-cacc46447026 None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:31.666960 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9aaf3f2-5064-4296-a60e-cacc46447026 None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:31.699779 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429dc954-52c0-450e-91c4-dd3ef270a1f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:31.700648 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429dc954-52c0-450e-91c4-dd3ef270a1f6 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:31.700928 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429dc954-52c0-450e-91c4-dd3ef270a1f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:31.701205 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429dc954-52c0-450e-91c4-dd3ef270a1f6 None admin] PATH_INFO: `/v3/projects/446967649a7d47af8f0eb54b376ac1fa` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:31.702576 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429dc954-52c0-450e-91c4-dd3ef270a1f6 None admin] RBAC: Authorizing `identity:get_project(project_id=446967649a7d47af8f0eb54b376ac1fa)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:31.704035 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429dc954-52c0-450e-91c4-dd3ef270a1f6 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:31.706197 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 161/317] 10.222.0.36 () {56 vars in 1186 bytes} [Tue May 3 13:59:31 2022] GET /identity/v3/projects/446967649a7d47af8f0eb54b376ac1fa => generated 302 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 13:59:31.712015 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874c7fd9-296c-4d77-8728-3deba3f7faeb None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:31.809692 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874c7fd9-296c-4d77-8728-3deba3f7faeb None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:31.844278 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c63f493-8a3e-4eef-9864-2e04b6e07c6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:31.844954 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c63f493-8a3e-4eef-9864-2e04b6e07c6a None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:31.845236 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c63f493-8a3e-4eef-9864-2e04b6e07c6a None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:31.845544 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c63f493-8a3e-4eef-9864-2e04b6e07c6a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:31.846380 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c63f493-8a3e-4eef-9864-2e04b6e07c6a None admin] RBAC: Adding query filter params (role.id=881b929165074739a253b35012fbc4fb, scope.project.id=446967649a7d47af8f0eb54b376ac1fa, user.id=99497a4e446f473ebd259b3bbc6a7722) {{(pid=80012) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 13:59:31.846691 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c63f493-8a3e-4eef-9864-2e04b6e07c6a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:31.848186 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c63f493-8a3e-4eef-9864-2e04b6e07c6a None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:31.854434 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 157/318] 10.222.0.36 () {56 vars in 1374 bytes} [Tue May 3 13:59:31 2022] GET /identity/v3/role_assignments?user.id=99497a4e446f473ebd259b3bbc6a7722&scope.project.id=446967649a7d47af8f0eb54b376ac1fa&role.id=881b929165074739a253b35012fbc4fb => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 13:59:32.210388 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37ed3fe-b901-4150-88ca-91d4989bb0cc None None] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:32.210784 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37ed3fe-b901-4150-88ca-91d4989bb0cc None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:32.210906 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37ed3fe-b901-4150-88ca-91d4989bb0cc None None] PATH_INFO: `/` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:32.212442 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 162/319] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 3 13:59:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 13:59:32.218436 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d156c8d1-cebb-4710-af26-14b49a477e04 None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:32.218753 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d156c8d1-cebb-4710-af26-14b49a477e04 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:32.218995 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d156c8d1-cebb-4710-af26-14b49a477e04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:32.237345 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-d156c8d1-cebb-4710-af26-14b49a477e04 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 13:59:32.238592 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-d156c8d1-cebb-4710-af26-14b49a477e04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 13:59:32.306511 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 158/320] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 3 13:59:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 13:59:32.329239 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37ed3fe-b901-4150-88ca-91d4989bb0cc None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:32.432258 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37ed3fe-b901-4150-88ca-91d4989bb0cc None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:32.432494 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c9b4cf-92d4-43c1-818e-637e24a7de4e None None] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:32.432906 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c9b4cf-92d4-43c1-818e-637e24a7de4e None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:32.432906 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c9b4cf-92d4-43c1-818e-637e24a7de4e None None] PATH_INFO: `/` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:32.434320 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 159/321] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 3 13:59:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 13:59:32.439718 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6b2121-cac6-4c1e-8b16-cba7bd8d6c97 None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:32.439998 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6b2121-cac6-4c1e-8b16-cba7bd8d6c97 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:32.440494 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6b2121-cac6-4c1e-8b16-cba7bd8d6c97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:32.456984 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-ad6b2121-cac6-4c1e-8b16-cba7bd8d6c97 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 13:59:32.458198 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-ad6b2121-cac6-4c1e-8b16-cba7bd8d6c97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 13:59:32.465388 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8763bad7-364e-416e-8199-945ade7f93b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:32.466182 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8763bad7-364e-416e-8199-945ade7f93b9 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:32.466466 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8763bad7-364e-416e-8199-945ade7f93b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:32.466736 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8763bad7-364e-416e-8199-945ade7f93b9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:32.467992 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8763bad7-364e-416e-8199-945ade7f93b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:32.469445 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8763bad7-364e-416e-8199-945ade7f93b9 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:32.471224 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 163/322] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 3 13:59:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 13:59:32.476601 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8763bad7-364e-416e-8199-945ade7f93b9 None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:32.527191 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 160/323] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 3 13:59:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 03 13:59:32.549692 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6b2121-cac6-4c1e-8b16-cba7bd8d6c97 None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:32.581684 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8763bad7-364e-416e-8199-945ade7f93b9 None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:32.616127 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8babe6b4-17b6-451f-b763-9dcf1a2fe75f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:32.616791 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8babe6b4-17b6-451f-b763-9dcf1a2fe75f None admin] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:32.617075 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8babe6b4-17b6-451f-b763-9dcf1a2fe75f None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:32.618030 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8babe6b4-17b6-451f-b763-9dcf1a2fe75f None admin] PATH_INFO: `/v3/groups` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:32.618030 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8babe6b4-17b6-451f-b763-9dcf1a2fe75f None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:32.619489 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8babe6b4-17b6-451f-b763-9dcf1a2fe75f None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:32.637370 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 164/324] 10.222.0.36 () {60 vars in 1134 bytes} [Tue May 3 13:59:32 2022] POST /identity/v3/groups => generated 226 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 13:59:32.648285 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6b2121-cac6-4c1e-8b16-cba7bd8d6c97 None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:32.684855 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce233fb-5841-482e-863c-6fbc652101f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:32.686096 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce233fb-5841-482e-863c-6fbc652101f6 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:32.686637 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce233fb-5841-482e-863c-6fbc652101f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:32.687096 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce233fb-5841-482e-863c-6fbc652101f6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:32.699272 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce233fb-5841-482e-863c-6fbc652101f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 13:59:32.708034 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57966b6-1af2-4bf3-b232-7f41b3eec8bf None None] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:32.708319 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57966b6-1af2-4bf3-b232-7f41b3eec8bf None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:32.708455 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application [None req-1ce233fb-5841-482e-863c-6fbc652101f6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 03 13:59:32.708455 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 13:59:32.708455 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 13:59:32.708455 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 13:59:32.708455 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 13:59:32.708455 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 13:59:32.708455 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 13:59:32.708455 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 13:59:32.708455 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 13:59:32.708455 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 13:59:32.708455 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 13:59:32.708455 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 13:59:32.708455 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 13:59:32.708455 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 13:59:32.708455 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 13:59:32.708455 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 13:59:32.709533 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 13:59:32.709533 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 13:59:32.709533 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 13:59:32.709533 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 13:59:32.709533 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 13:59:32.709533 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 13:59:32.709533 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 13:59:32.709533 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 13:59:32.709533 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 13:59:32.709533 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.get_or_create( May 03 13:59:32.709533 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 13:59:32.709533 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application with Lock( May 03 13:59:32.709533 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 13:59:32.709533 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._enter() May 03 13:59:32.709533 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 13:59:32.709533 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 13:59:32.710543 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 13:59:32.710543 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.creator() May 03 13:59:32.710543 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 13:59:32.710543 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application created_value = creator( May 03 13:59:32.710543 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 13:59:32.710543 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 13:59:32.710543 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 13:59:32.710543 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 13:59:32.710543 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 13:59:32.710543 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 13:59:32.710543 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 03 13:59:32.710543 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application May 03 13:59:32.711277 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57966b6-1af2-4bf3-b232-7f41b3eec8bf None None] PATH_INFO: `/` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:32.711277 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 165/325] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 3 13:59:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 13:59:32.712870 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 161/326] 10.222.0.36 () {56 vars in 1099 bytes} [Tue May 3 13:59:32 2022] GET /identity/v3/roles/reader => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 13:59:32.715997 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594197d4-11be-4846-931d-b7f966d69555 None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:32.716281 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594197d4-11be-4846-931d-b7f966d69555 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:32.716553 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594197d4-11be-4846-931d-b7f966d69555 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:32.719164 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce233fb-5841-482e-863c-6fbc652101f6 None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:32.736967 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-594197d4-11be-4846-931d-b7f966d69555 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 13:59:32.738230 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-594197d4-11be-4846-931d-b7f966d69555 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 13:59:32.808843 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 166/327] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 3 13:59:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 13:59:32.822610 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce233fb-5841-482e-863c-6fbc652101f6 None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:32.832060 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594197d4-11be-4846-931d-b7f966d69555 None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:32.858266 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d446848-8683-4217-8277-12c9eee2f277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:32.858939 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d446848-8683-4217-8277-12c9eee2f277 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:32.859218 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d446848-8683-4217-8277-12c9eee2f277 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:32.859519 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d446848-8683-4217-8277-12c9eee2f277 None admin] PATH_INFO: `/v3/roles` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:32.860235 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d446848-8683-4217-8277-12c9eee2f277 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80012) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 13:59:32.860557 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d446848-8683-4217-8277-12c9eee2f277 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:32.861979 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d446848-8683-4217-8277-12c9eee2f277 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:32.875296 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 162/328] 10.222.0.36 () {56 vars in 1101 bytes} [Tue May 3 13:59:32 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 13:59:32.877581 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d446848-8683-4217-8277-12c9eee2f277 None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:32.945417 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594197d4-11be-4846-931d-b7f966d69555 None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:32.986461 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68341a9-de6f-4e00-ad27-631487782542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:32.987031 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68341a9-de6f-4e00-ad27-631487782542 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:32.987310 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68341a9-de6f-4e00-ad27-631487782542 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:32.987578 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68341a9-de6f-4e00-ad27-631487782542 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:33.002860 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d446848-8683-4217-8277-12c9eee2f277 None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:33.003626 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68341a9-de6f-4e00-ad27-631487782542 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 13:59:33.013187 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application [None req-c68341a9-de6f-4e00-ad27-631487782542 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 03 13:59:33.013187 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 13:59:33.013187 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 13:59:33.013187 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 13:59:33.013187 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 13:59:33.013187 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 13:59:33.013187 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 13:59:33.013187 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 13:59:33.013187 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 13:59:33.013187 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 13:59:33.013187 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 13:59:33.013187 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 13:59:33.013187 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 13:59:33.013187 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 13:59:33.013187 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 13:59:33.013187 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 13:59:33.014267 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 13:59:33.014267 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 13:59:33.014267 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 13:59:33.014267 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 13:59:33.014267 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 13:59:33.014267 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 13:59:33.014267 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 13:59:33.014267 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 13:59:33.014267 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 13:59:33.014267 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.get_or_create( May 03 13:59:33.014267 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 13:59:33.014267 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application with Lock( May 03 13:59:33.014267 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 13:59:33.014267 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._enter() May 03 13:59:33.014267 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 13:59:33.014267 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 13:59:33.015866 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 13:59:33.015866 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.creator() May 03 13:59:33.015866 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 13:59:33.015866 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application created_value = creator( May 03 13:59:33.015866 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 13:59:33.015866 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 13:59:33.015866 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 13:59:33.015866 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 13:59:33.015866 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 13:59:33.015866 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 13:59:33.015866 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 03 13:59:33.015866 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application May 03 13:59:33.015866 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 167/329] 10.222.0.36 () {56 vars in 1099 bytes} [Tue May 3 13:59:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 13:59:33.020773 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68341a9-de6f-4e00-ad27-631487782542 None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:33.051289 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb300a4d-a70c-40e3-bc40-24197082cd33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:33.053022 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb300a4d-a70c-40e3-bc40-24197082cd33 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:33.053521 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb300a4d-a70c-40e3-bc40-24197082cd33 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:33.053802 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb300a4d-a70c-40e3-bc40-24197082cd33 None admin] PATH_INFO: `/v3/users/2acfd51d411a4f4a8c24ead3a40f0f6e` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:33.055115 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb300a4d-a70c-40e3-bc40-24197082cd33 None admin] RBAC: Authorizing `identity:get_user(user_id=2acfd51d411a4f4a8c24ead3a40f0f6e)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:33.056945 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb300a4d-a70c-40e3-bc40-24197082cd33 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:33.059864 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 163/330] 10.222.0.36 () {56 vars in 1177 bytes} [Tue May 3 13:59:32 2022] GET /identity/v3/users/2acfd51d411a4f4a8c24ead3a40f0f6e => generated 293 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 13:59:33.069674 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb300a4d-a70c-40e3-bc40-24197082cd33 None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:33.136391 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68341a9-de6f-4e00-ad27-631487782542 None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:33.184258 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fa4d86-6c91-47b4-b3a0-6db39bece42c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:33.184936 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb300a4d-a70c-40e3-bc40-24197082cd33 None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:33.185573 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fa4d86-6c91-47b4-b3a0-6db39bece42c None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:33.186110 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fa4d86-6c91-47b4-b3a0-6db39bece42c None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:33.186739 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fa4d86-6c91-47b4-b3a0-6db39bece42c None admin] PATH_INFO: `/v3/roles` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:33.188493 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fa4d86-6c91-47b4-b3a0-6db39bece42c None admin] RBAC: Adding query filter params (name=member) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 13:59:33.188998 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fa4d86-6c91-47b4-b3a0-6db39bece42c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:33.190621 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fa4d86-6c91-47b4-b3a0-6db39bece42c None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:33.202384 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 168/331] 10.222.0.36 () {56 vars in 1101 bytes} [Tue May 3 13:59:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 13:59:33.207923 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fa4d86-6c91-47b4-b3a0-6db39bece42c None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:33.226659 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bda2ad0-9e27-47cc-a471-8686d15fa81e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:33.227531 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bda2ad0-9e27-47cc-a471-8686d15fa81e None admin] REQUEST_METHOD: `PUT` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:33.227810 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bda2ad0-9e27-47cc-a471-8686d15fa81e None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:33.228086 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bda2ad0-9e27-47cc-a471-8686d15fa81e None admin] PATH_INFO: `/v3/system/users/2acfd51d411a4f4a8c24ead3a40f0f6e/roles/881b929165074739a253b35012fbc4fb` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:33.229598 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bda2ad0-9e27-47cc-a471-8686d15fa81e None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=2acfd51d411a4f4a8c24ead3a40f0f6e, role_id=881b929165074739a253b35012fbc4fb)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:33.230979 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bda2ad0-9e27-47cc-a471-8686d15fa81e None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:33.243049 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 164/332] 10.222.0.36 () {58 vars in 1334 bytes} [Tue May 3 13:59:33 2022] PUT /identity/v3/system/users/2acfd51d411a4f4a8c24ead3a40f0f6e/roles/881b929165074739a253b35012fbc4fb => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 13:59:33.319287 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fa4d86-6c91-47b4-b3a0-6db39bece42c None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:33.355980 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5de19b-2711-4259-a366-2178a22da1ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:33.357121 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5de19b-2711-4259-a366-2178a22da1ae None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:33.357575 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5de19b-2711-4259-a366-2178a22da1ae None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:33.358086 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5de19b-2711-4259-a366-2178a22da1ae None admin] PATH_INFO: `/v3/users/184634a6a66d4adeabf2e13e2765c86e` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:33.359610 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5de19b-2711-4259-a366-2178a22da1ae None admin] RBAC: Authorizing `identity:get_user(user_id=184634a6a66d4adeabf2e13e2765c86e)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:33.361268 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5de19b-2711-4259-a366-2178a22da1ae None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:33.363540 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 169/333] 10.222.0.36 () {56 vars in 1177 bytes} [Tue May 3 13:59:33 2022] GET /identity/v3/users/184634a6a66d4adeabf2e13e2765c86e => generated 293 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 13:59:33.369211 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bda2ad0-9e27-47cc-a471-8686d15fa81e None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:33.489903 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bda2ad0-9e27-47cc-a471-8686d15fa81e None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:33.523351 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda21ff4-c9fe-4516-82a3-d836a87a0acb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:33.524027 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda21ff4-c9fe-4516-82a3-d836a87a0acb None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:33.524306 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda21ff4-c9fe-4516-82a3-d836a87a0acb None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:33.524580 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda21ff4-c9fe-4516-82a3-d836a87a0acb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:33.525510 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda21ff4-c9fe-4516-82a3-d836a87a0acb None admin] RBAC: Adding query filter params (role.id=441fdc11e95b47f4813f72610e39018b, user.id=184634a6a66d4adeabf2e13e2765c86e, scope.system=all) {{(pid=80012) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 13:59:33.525825 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda21ff4-c9fe-4516-82a3-d836a87a0acb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:33.527263 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda21ff4-c9fe-4516-82a3-d836a87a0acb None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:33.540001 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 165/334] 10.222.0.36 () {56 vars in 1308 bytes} [Tue May 3 13:59:33 2022] GET /identity/v3/role_assignments?user.id=184634a6a66d4adeabf2e13e2765c86e&scope.system=all&role.id=441fdc11e95b47f4813f72610e39018b => generated 510 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 13:59:35.382911 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d1907a-219a-4efc-a6d3-9b8c59d8b2cc None None] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:35.383926 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d1907a-219a-4efc-a6d3-9b8c59d8b2cc None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:35.384411 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d1907a-219a-4efc-a6d3-9b8c59d8b2cc None None] PATH_INFO: `/` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:35.386050 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 170/335] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 3 13:59:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 13:59:35.391838 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8973ef0-5c83-45ed-934b-cd694c0991f5 None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:35.392307 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8973ef0-5c83-45ed-934b-cd694c0991f5 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:35.392390 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8973ef0-5c83-45ed-934b-cd694c0991f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:35.417240 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-b8973ef0-5c83-45ed-934b-cd694c0991f5 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 13:59:35.418458 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-b8973ef0-5c83-45ed-934b-cd694c0991f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 13:59:35.507626 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 166/336] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 3 13:59:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 13:59:35.544550 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ee852a-4587-451a-955a-09d6d0e7e69e None None] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:35.545195 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ee852a-4587-451a-955a-09d6d0e7e69e None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:35.545746 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ee852a-4587-451a-955a-09d6d0e7e69e None None] PATH_INFO: `/` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:35.547729 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 171/337] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 3 13:59:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 13:59:35.552866 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c87839-fc2e-4a13-822d-e4bbfa561f71 None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:35.553165 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c87839-fc2e-4a13-822d-e4bbfa561f71 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:35.553474 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c87839-fc2e-4a13-822d-e4bbfa561f71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:35.554278 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ee852a-4587-451a-955a-09d6d0e7e69e None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:35.575324 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-e1c87839-fc2e-4a13-822d-e4bbfa561f71 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 13:59:35.577052 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-e1c87839-fc2e-4a13-822d-e4bbfa561f71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 13:59:35.700873 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 167/338] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 3 13:59:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 13:59:35.727729 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ee852a-4587-451a-955a-09d6d0e7e69e None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:35.736723 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c87839-fc2e-4a13-822d-e4bbfa561f71 None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:35.778078 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89465259-a4d0-482f-8a5e-3267970e246f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:35.779175 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89465259-a4d0-482f-8a5e-3267970e246f None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:35.779452 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89465259-a4d0-482f-8a5e-3267970e246f None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:35.779751 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89465259-a4d0-482f-8a5e-3267970e246f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:35.805918 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89465259-a4d0-482f-8a5e-3267970e246f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 13:59:35.815032 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application [None req-89465259-a4d0-482f-8a5e-3267970e246f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 03 13:59:35.815032 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 13:59:35.815032 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 13:59:35.815032 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 13:59:35.815032 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 13:59:35.815032 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 13:59:35.815032 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 13:59:35.815032 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 13:59:35.815032 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 13:59:35.815032 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 13:59:35.815032 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 13:59:35.815032 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 13:59:35.815032 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 13:59:35.815032 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 13:59:35.815032 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 13:59:35.815032 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 13:59:35.815996 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 13:59:35.815996 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 13:59:35.815996 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 13:59:35.815996 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 13:59:35.815996 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 13:59:35.815996 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 13:59:35.815996 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 13:59:35.815996 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 13:59:35.815996 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 13:59:35.815996 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.get_or_create( May 03 13:59:35.815996 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 13:59:35.815996 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application with Lock( May 03 13:59:35.815996 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 13:59:35.815996 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._enter() May 03 13:59:35.815996 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 13:59:35.815996 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 13:59:35.816830 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 13:59:35.816830 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.creator() May 03 13:59:35.816830 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 13:59:35.816830 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application created_value = creator( May 03 13:59:35.816830 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 13:59:35.816830 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 13:59:35.816830 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 13:59:35.816830 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 13:59:35.816830 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 13:59:35.816830 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 13:59:35.816830 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 03 13:59:35.816830 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application May 03 13:59:35.816830 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 172/339] 10.222.0.36 () {56 vars in 1099 bytes} [Tue May 3 13:59:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 13:59:35.823866 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89465259-a4d0-482f-8a5e-3267970e246f None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:35.940630 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c87839-fc2e-4a13-822d-e4bbfa561f71 None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:35.995181 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89465259-a4d0-482f-8a5e-3267970e246f None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:36.017015 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68f0833-73ae-480d-9aef-25c9fa2855a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:36.017905 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68f0833-73ae-480d-9aef-25c9fa2855a1 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:36.018187 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68f0833-73ae-480d-9aef-25c9fa2855a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:36.018459 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68f0833-73ae-480d-9aef-25c9fa2855a1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:36.046124 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68f0833-73ae-480d-9aef-25c9fa2855a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 13:59:36.056171 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application [None req-e68f0833-73ae-480d-9aef-25c9fa2855a1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 03 13:59:36.056171 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 13:59:36.056171 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 13:59:36.056171 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 13:59:36.056171 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 13:59:36.056171 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 13:59:36.056171 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 13:59:36.056171 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 13:59:36.056171 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 13:59:36.056171 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 13:59:36.056171 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 13:59:36.056171 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 13:59:36.056171 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 13:59:36.056171 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 13:59:36.056171 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 13:59:36.056171 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 13:59:36.057182 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 13:59:36.057182 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 13:59:36.057182 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 13:59:36.057182 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 13:59:36.057182 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 13:59:36.057182 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 13:59:36.057182 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 13:59:36.057182 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 13:59:36.057182 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 13:59:36.057182 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.get_or_create( May 03 13:59:36.057182 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 13:59:36.057182 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application with Lock( May 03 13:59:36.057182 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 13:59:36.057182 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._enter() May 03 13:59:36.057182 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 13:59:36.057182 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 13:59:36.058050 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 13:59:36.058050 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.creator() May 03 13:59:36.058050 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 13:59:36.058050 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application created_value = creator( May 03 13:59:36.058050 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 13:59:36.058050 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 13:59:36.058050 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 13:59:36.058050 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 13:59:36.058050 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 13:59:36.058050 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 13:59:36.058050 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 03 13:59:36.058050 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application May 03 13:59:36.058050 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 168/340] 10.222.0.36 () {56 vars in 1114 bytes} [Tue May 3 13:59:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 13:59:36.064160 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68f0833-73ae-480d-9aef-25c9fa2855a1 None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:36.090008 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e93049-1d96-4604-a7c1-e624b5e58a8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:36.090690 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e93049-1d96-4604-a7c1-e624b5e58a8a None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:36.090968 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e93049-1d96-4604-a7c1-e624b5e58a8a None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:36.091241 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e93049-1d96-4604-a7c1-e624b5e58a8a None admin] PATH_INFO: `/v3/roles` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:36.092001 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e93049-1d96-4604-a7c1-e624b5e58a8a None admin] RBAC: Adding query filter params (name=member) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 13:59:36.092364 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e93049-1d96-4604-a7c1-e624b5e58a8a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:36.093784 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e93049-1d96-4604-a7c1-e624b5e58a8a None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:36.105359 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 173/341] 10.222.0.36 () {56 vars in 1101 bytes} [Tue May 3 13:59:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 13:59:36.111601 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e93049-1d96-4604-a7c1-e624b5e58a8a None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:36.240909 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68f0833-73ae-480d-9aef-25c9fa2855a1 None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:36.297260 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e93049-1d96-4604-a7c1-e624b5e58a8a None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:36.307757 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e93e15f-2620-469f-b7ef-62c8e1aae61e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:36.308443 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e93e15f-2620-469f-b7ef-62c8e1aae61e None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:36.308726 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e93e15f-2620-469f-b7ef-62c8e1aae61e None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:36.308998 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e93e15f-2620-469f-b7ef-62c8e1aae61e None admin] PATH_INFO: `/v3/roles` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:36.309793 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e93e15f-2620-469f-b7ef-62c8e1aae61e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80012) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 13:59:36.310099 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e93e15f-2620-469f-b7ef-62c8e1aae61e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:36.311514 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e93e15f-2620-469f-b7ef-62c8e1aae61e None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:36.331424 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 169/342] 10.222.0.36 () {56 vars in 1111 bytes} [Tue May 3 13:59:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 13:59:36.332780 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2d6dab-4f19-4d83-9390-a7b1c8d3f666 None None] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:36.333067 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2d6dab-4f19-4d83-9390-a7b1c8d3f666 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:36.333366 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2d6dab-4f19-4d83-9390-a7b1c8d3f666 None None] PATH_INFO: `/` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:36.334602 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 170/343] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 3 13:59:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 13:59:36.340655 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2d6dab-4f19-4d83-9390-a7b1c8d3f666 None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:36.364227 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bccbe18-95f2-4d13-ba6e-a41112284675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:36.364889 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bccbe18-95f2-4d13-ba6e-a41112284675 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:36.365168 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bccbe18-95f2-4d13-ba6e-a41112284675 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:36.365467 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bccbe18-95f2-4d13-ba6e-a41112284675 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:36.458992 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bccbe18-95f2-4d13-ba6e-a41112284675 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:36.460460 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bccbe18-95f2-4d13-ba6e-a41112284675 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:36.494544 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2d6dab-4f19-4d83-9390-a7b1c8d3f666 None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:36.542873 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7c1548-fbe3-4712-a9d9-a898a39a6889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:36.543538 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7c1548-fbe3-4712-a9d9-a898a39a6889 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:36.543820 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7c1548-fbe3-4712-a9d9-a898a39a6889 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:36.544097 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7c1548-fbe3-4712-a9d9-a898a39a6889 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:36.565099 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 174/344] 10.222.0.36 () {58 vars in 1282 bytes} [Tue May 3 13:59:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 03 13:59:36.566417 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b62d13-2f55-4e7e-833a-fc3ac6f5d597 None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:36.566698 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b62d13-2f55-4e7e-833a-fc3ac6f5d597 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:36.567184 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b62d13-2f55-4e7e-833a-fc3ac6f5d597 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:36.585770 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-b1b62d13-2f55-4e7e-833a-fc3ac6f5d597 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 13:59:36.587285 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-b1b62d13-2f55-4e7e-833a-fc3ac6f5d597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 13:59:36.665416 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 175/345] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 3 13:59:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 13:59:36.666665 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b62d13-2f55-4e7e-833a-fc3ac6f5d597 None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:36.691451 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7c1548-fbe3-4712-a9d9-a898a39a6889 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:36.693180 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7c1548-fbe3-4712-a9d9-a898a39a6889 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:36.783408 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b62d13-2f55-4e7e-833a-fc3ac6f5d597 None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:36.815639 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a9d712-0d0f-430d-97a4-87ad610582a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:36.816473 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a9d712-0d0f-430d-97a4-87ad610582a1 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:36.816750 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a9d712-0d0f-430d-97a4-87ad610582a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:36.817019 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a9d712-0d0f-430d-97a4-87ad610582a1 None admin] PATH_INFO: `/v3/projects/3256bc7158894136b4937ecc0a8b3073` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:36.821257 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a9d712-0d0f-430d-97a4-87ad610582a1 None admin] RBAC: Authorizing `identity:get_project(project_id=3256bc7158894136b4937ecc0a8b3073)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:36.821257 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a9d712-0d0f-430d-97a4-87ad610582a1 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:36.821475 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 176/346] 10.222.0.36 () {56 vars in 1186 bytes} [Tue May 3 13:59:36 2022] GET /identity/v3/projects/3256bc7158894136b4937ecc0a8b3073 => generated 298 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 13:59:36.825881 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a9d712-0d0f-430d-97a4-87ad610582a1 None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:36.893602 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 171/347] 10.222.0.36 () {58 vars in 1282 bytes} [Tue May 3 13:59:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 553 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 03 13:59:36.894461 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7c1548-fbe3-4712-a9d9-a898a39a6889 None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:36.925583 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a9d712-0d0f-430d-97a4-87ad610582a1 None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:36.958837 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae06da22-3448-47b6-9600-93c09f02c647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:36.959633 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae06da22-3448-47b6-9600-93c09f02c647 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:36.959906 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae06da22-3448-47b6-9600-93c09f02c647 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:36.960173 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae06da22-3448-47b6-9600-93c09f02c647 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:36.971426 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae06da22-3448-47b6-9600-93c09f02c647 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 13:59:36.979213 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application [None req-ae06da22-3448-47b6-9600-93c09f02c647 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 03 13:59:36.979213 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 13:59:36.979213 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 13:59:36.979213 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 13:59:36.979213 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 13:59:36.979213 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 13:59:36.979213 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 13:59:36.979213 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 13:59:36.979213 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 13:59:36.979213 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 13:59:36.979213 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 13:59:36.979213 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 13:59:36.979213 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 13:59:36.979213 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 13:59:36.979213 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 13:59:36.979213 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 13:59:36.980154 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 13:59:36.980154 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 13:59:36.980154 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 13:59:36.980154 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 13:59:36.980154 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 13:59:36.980154 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 13:59:36.980154 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 13:59:36.980154 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 13:59:36.980154 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 13:59:36.980154 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.get_or_create( May 03 13:59:36.980154 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 13:59:36.980154 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application with Lock( May 03 13:59:36.980154 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 13:59:36.980154 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._enter() May 03 13:59:36.980154 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 13:59:36.980154 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 13:59:36.981005 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 13:59:36.981005 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.creator() May 03 13:59:36.981005 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 13:59:36.981005 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application created_value = creator( May 03 13:59:36.981005 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 13:59:36.981005 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 13:59:36.981005 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 13:59:36.981005 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 13:59:36.981005 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 13:59:36.981005 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 13:59:36.981005 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 03 13:59:36.981005 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application May 03 13:59:36.985377 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 177/348] 10.222.0.36 () {56 vars in 1099 bytes} [Tue May 3 13:59:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 13:59:36.986779 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb0ad20-374f-4707-965b-3ec42bfe0796 None None] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:36.987062 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb0ad20-374f-4707-965b-3ec42bfe0796 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:36.987338 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb0ad20-374f-4707-965b-3ec42bfe0796 None None] PATH_INFO: `/` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:36.988821 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 178/349] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 3 13:59:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 13:59:36.989416 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb0ad20-374f-4707-965b-3ec42bfe0796 None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:36.993384 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7c1548-fbe3-4712-a9d9-a898a39a6889 None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:37.030371 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d23be4b-1994-44ff-92d0-fc6524c32fac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:37.031265 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d23be4b-1994-44ff-92d0-fc6524c32fac None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:37.031544 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d23be4b-1994-44ff-92d0-fc6524c32fac None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:37.031867 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d23be4b-1994-44ff-92d0-fc6524c32fac None admin] PATH_INFO: `/v3/groups/e97c029b53dc4f44bea073c0a5d1568d` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:37.040810 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d23be4b-1994-44ff-92d0-fc6524c32fac None admin] RBAC: Authorizing `identity:get_group(group_id=e97c029b53dc4f44bea073c0a5d1568d)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:37.042324 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d23be4b-1994-44ff-92d0-fc6524c32fac None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:37.044392 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 172/350] 10.222.0.36 () {56 vars in 1180 bytes} [Tue May 3 13:59:36 2022] GET /identity/v3/groups/e97c029b53dc4f44bea073c0a5d1568d => generated 226 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 13:59:37.045537 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d23be4b-1994-44ff-92d0-fc6524c32fac None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:37.104580 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb0ad20-374f-4707-965b-3ec42bfe0796 None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:37.141912 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac7d425-f39b-4160-9d22-0623bbe9c7f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:37.142783 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac7d425-f39b-4160-9d22-0623bbe9c7f0 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:37.143056 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac7d425-f39b-4160-9d22-0623bbe9c7f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:37.143323 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac7d425-f39b-4160-9d22-0623bbe9c7f0 None admin] PATH_INFO: `/v3/projects/3256bc7158894136b4937ecc0a8b3073` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:37.144568 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac7d425-f39b-4160-9d22-0623bbe9c7f0 None admin] RBAC: Authorizing `identity:get_project(project_id=3256bc7158894136b4937ecc0a8b3073)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:37.146163 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac7d425-f39b-4160-9d22-0623bbe9c7f0 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:37.148080 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 179/351] 10.222.0.36 () {56 vars in 1186 bytes} [Tue May 3 13:59:36 2022] GET /identity/v3/projects/3256bc7158894136b4937ecc0a8b3073 => generated 298 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 13:59:37.149076 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f038e62-245b-4162-9d18-509046c0506b None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:37.149564 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f038e62-245b-4162-9d18-509046c0506b None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:37.150019 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f038e62-245b-4162-9d18-509046c0506b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:37.164295 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d23be4b-1994-44ff-92d0-fc6524c32fac None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:37.168375 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-5f038e62-245b-4162-9d18-509046c0506b None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 13:59:37.169839 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-5f038e62-245b-4162-9d18-509046c0506b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 13:59:37.197347 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae3e9d5-36bc-4da7-8ceb-ea5eabc52b49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:37.198288 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae3e9d5-36bc-4da7-8ceb-ea5eabc52b49 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:37.198713 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae3e9d5-36bc-4da7-8ceb-ea5eabc52b49 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:37.199121 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae3e9d5-36bc-4da7-8ceb-ea5eabc52b49 None admin] PATH_INFO: `/v3/roles` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:37.200025 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae3e9d5-36bc-4da7-8ceb-ea5eabc52b49 None admin] RBAC: Adding query filter params (name=member) {{(pid=80012) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 13:59:37.200466 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae3e9d5-36bc-4da7-8ceb-ea5eabc52b49 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:37.202092 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae3e9d5-36bc-4da7-8ceb-ea5eabc52b49 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:37.210783 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 173/352] 10.222.0.36 () {56 vars in 1101 bytes} [Tue May 3 13:59:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 13:59:37.215582 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae3e9d5-36bc-4da7-8ceb-ea5eabc52b49 None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:37.268102 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 180/353] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 3 13:59:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 13:59:37.268102 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f038e62-245b-4162-9d18-509046c0506b None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:37.337088 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae3e9d5-36bc-4da7-8ceb-ea5eabc52b49 None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:37.378837 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b445d258-8b32-465d-ad9a-1be92a570531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:37.379473 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b445d258-8b32-465d-ad9a-1be92a570531 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:37.379749 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b445d258-8b32-465d-ad9a-1be92a570531 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:37.380025 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b445d258-8b32-465d-ad9a-1be92a570531 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:37.380907 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b445d258-8b32-465d-ad9a-1be92a570531 None admin] RBAC: Adding query filter params (group.id=e97c029b53dc4f44bea073c0a5d1568d, role.id=441fdc11e95b47f4813f72610e39018b, scope.project.id=3256bc7158894136b4937ecc0a8b3073) {{(pid=80012) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 13:59:37.381339 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b445d258-8b32-465d-ad9a-1be92a570531 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:37.382671 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b445d258-8b32-465d-ad9a-1be92a570531 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:37.391469 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 174/354] 10.222.0.36 () {56 vars in 1376 bytes} [Tue May 3 13:59:37 2022] GET /identity/v3/role_assignments?group.id=e97c029b53dc4f44bea073c0a5d1568d&scope.project.id=3256bc7158894136b4937ecc0a8b3073&role.id=441fdc11e95b47f4813f72610e39018b => generated 260 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 13:59:37.391637 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f038e62-245b-4162-9d18-509046c0506b None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:37.393401 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b445d258-8b32-465d-ad9a-1be92a570531 None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:37.430552 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41dd16a-7280-4863-b1ee-0a1e7f517e66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:37.431426 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41dd16a-7280-4863-b1ee-0a1e7f517e66 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:37.431705 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41dd16a-7280-4863-b1ee-0a1e7f517e66 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:37.431972 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41dd16a-7280-4863-b1ee-0a1e7f517e66 None admin] PATH_INFO: `/v3/groups/e97c029b53dc4f44bea073c0a5d1568d` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:37.433192 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41dd16a-7280-4863-b1ee-0a1e7f517e66 None admin] RBAC: Authorizing `identity:get_group(group_id=e97c029b53dc4f44bea073c0a5d1568d)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:37.434699 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41dd16a-7280-4863-b1ee-0a1e7f517e66 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:37.436973 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 181/355] 10.222.0.36 () {56 vars in 1180 bytes} [Tue May 3 13:59:37 2022] GET /identity/v3/groups/e97c029b53dc4f44bea073c0a5d1568d => generated 226 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 13:59:37.439781 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41dd16a-7280-4863-b1ee-0a1e7f517e66 None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:37.532338 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b445d258-8b32-465d-ad9a-1be92a570531 None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:37.546818 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41dd16a-7280-4863-b1ee-0a1e7f517e66 None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:37.572917 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6538f8-a0d6-4c8e-8b45-c37ec1697598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:37.574544 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6538f8-a0d6-4c8e-8b45-c37ec1697598 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:37.574833 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6538f8-a0d6-4c8e-8b45-c37ec1697598 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:37.575111 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6538f8-a0d6-4c8e-8b45-c37ec1697598 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:37.594942 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6893c5f-45f2-4906-b13e-60044fb77f0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:37.595771 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6893c5f-45f2-4906-b13e-60044fb77f0c None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:37.596050 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6893c5f-45f2-4906-b13e-60044fb77f0c None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:37.596325 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6893c5f-45f2-4906-b13e-60044fb77f0c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:37.615284 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6893c5f-45f2-4906-b13e-60044fb77f0c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 13:59:37.625357 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application [None req-e6893c5f-45f2-4906-b13e-60044fb77f0c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 03 13:59:37.625357 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 13:59:37.625357 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 13:59:37.625357 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 13:59:37.625357 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 13:59:37.625357 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 13:59:37.625357 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 13:59:37.625357 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 13:59:37.625357 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 13:59:37.625357 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 13:59:37.625357 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 13:59:37.625357 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 13:59:37.625357 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 13:59:37.625357 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 13:59:37.625357 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 13:59:37.625357 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 13:59:37.626307 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 13:59:37.626307 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 13:59:37.626307 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 13:59:37.626307 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 13:59:37.626307 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 13:59:37.626307 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 13:59:37.626307 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 13:59:37.626307 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 13:59:37.626307 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 13:59:37.626307 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.get_or_create( May 03 13:59:37.626307 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 13:59:37.626307 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application with Lock( May 03 13:59:37.626307 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 13:59:37.626307 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._enter() May 03 13:59:37.626307 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 13:59:37.626307 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 13:59:37.627177 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 13:59:37.627177 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.creator() May 03 13:59:37.627177 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 13:59:37.627177 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application created_value = creator( May 03 13:59:37.627177 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 13:59:37.627177 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 13:59:37.627177 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 13:59:37.627177 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 13:59:37.627177 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 13:59:37.627177 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 13:59:37.627177 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 03 13:59:37.627177 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application May 03 13:59:37.627177 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 182/356] 10.222.0.36 () {56 vars in 1099 bytes} [Tue May 3 13:59:37 2022] GET /identity/v3/roles/reader => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 13:59:37.628372 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5fae64-9258-4f53-a447-e15749ef00e9 None None] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:37.628531 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5fae64-9258-4f53-a447-e15749ef00e9 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:37.628767 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5fae64-9258-4f53-a447-e15749ef00e9 None None] PATH_INFO: `/` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:37.630989 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 183/357] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 3 13:59:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 13:59:37.631804 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5fae64-9258-4f53-a447-e15749ef00e9 None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:37.667633 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6538f8-a0d6-4c8e-8b45-c37ec1697598 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:37.669626 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6538f8-a0d6-4c8e-8b45-c37ec1697598 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:37.754861 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5fae64-9258-4f53-a447-e15749ef00e9 None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:37.791550 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8e8781-a646-4a15-a424-c3f3551b2f93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:37.792207 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8e8781-a646-4a15-a424-c3f3551b2f93 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:37.792484 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8e8781-a646-4a15-a424-c3f3551b2f93 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:37.792760 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8e8781-a646-4a15-a424-c3f3551b2f93 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:37.793625 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8e8781-a646-4a15-a424-c3f3551b2f93 None admin] RBAC: Adding query filter params (group.id=e97c029b53dc4f44bea073c0a5d1568d, role.id=bd29d35ea39b4ba293ffbf1ffbf4b940, scope.project.id=3256bc7158894136b4937ecc0a8b3073) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 13:59:37.793933 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8e8781-a646-4a15-a424-c3f3551b2f93 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:37.795715 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8e8781-a646-4a15-a424-c3f3551b2f93 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:37.799623 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 175/358] 10.222.0.36 () {58 vars in 1282 bytes} [Tue May 3 13:59:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 03 13:59:37.800784 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6538f8-a0d6-4c8e-8b45-c37ec1697598 None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:37.803140 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 184/359] 10.222.0.36 () {56 vars in 1376 bytes} [Tue May 3 13:59:37 2022] GET /identity/v3/role_assignments?group.id=e97c029b53dc4f44bea073c0a5d1568d&scope.project.id=3256bc7158894136b4937ecc0a8b3073&role.id=bd29d35ea39b4ba293ffbf1ffbf4b940 => generated 260 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 13:59:37.804450 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab3d398-fa8e-43d0-bff6-b27252f6c839 None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:37.804738 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab3d398-fa8e-43d0-bff6-b27252f6c839 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:37.805010 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab3d398-fa8e-43d0-bff6-b27252f6c839 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:37.844857 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-3ab3d398-fa8e-43d0-bff6-b27252f6c839 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 13:59:37.846113 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-3ab3d398-fa8e-43d0-bff6-b27252f6c839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 13:59:37.926337 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6538f8-a0d6-4c8e-8b45-c37ec1697598 None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:37.942613 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 185/360] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 3 13:59:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 13:59:37.943572 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab3d398-fa8e-43d0-bff6-b27252f6c839 None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:37.963075 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa99eaa8-cf67-459a-bbad-702100dd9a02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:37.964180 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa99eaa8-cf67-459a-bbad-702100dd9a02 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:37.964467 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa99eaa8-cf67-459a-bbad-702100dd9a02 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:37.964900 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa99eaa8-cf67-459a-bbad-702100dd9a02 None admin] PATH_INFO: `/v3/roles` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:37.965979 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa99eaa8-cf67-459a-bbad-702100dd9a02 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80012) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 13:59:37.966286 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa99eaa8-cf67-459a-bbad-702100dd9a02 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:37.967730 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa99eaa8-cf67-459a-bbad-702100dd9a02 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:37.979111 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 176/361] 10.222.0.36 () {56 vars in 1101 bytes} [Tue May 3 13:59:37 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 13:59:37.980464 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76bf542-45c9-4bf0-9e44-1fcd4ea9e2da None None] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:37.980750 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76bf542-45c9-4bf0-9e44-1fcd4ea9e2da None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:37.981027 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76bf542-45c9-4bf0-9e44-1fcd4ea9e2da None None] PATH_INFO: `/` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:37.982880 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 177/362] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 3 13:59:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 13:59:37.983764 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76bf542-45c9-4bf0-9e44-1fcd4ea9e2da None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:38.082289 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab3d398-fa8e-43d0-bff6-b27252f6c839 None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:38.114517 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76bf542-45c9-4bf0-9e44-1fcd4ea9e2da None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:38.126488 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840c7609-4e25-45e8-8887-62c75e3aaae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:38.127639 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840c7609-4e25-45e8-8887-62c75e3aaae1 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:38.127918 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840c7609-4e25-45e8-8887-62c75e3aaae1 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:38.128196 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840c7609-4e25-45e8-8887-62c75e3aaae1 None admin] PATH_INFO: `/v3/projects/446967649a7d47af8f0eb54b376ac1fa` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:38.129952 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840c7609-4e25-45e8-8887-62c75e3aaae1 None admin] RBAC: Authorizing `identity:get_project(project_id=446967649a7d47af8f0eb54b376ac1fa)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:38.131832 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840c7609-4e25-45e8-8887-62c75e3aaae1 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:38.134257 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 186/363] 10.222.0.36 () {56 vars in 1186 bytes} [Tue May 3 13:59:37 2022] GET /identity/v3/projects/446967649a7d47af8f0eb54b376ac1fa => generated 302 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 13:59:38.135541 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840c7609-4e25-45e8-8887-62c75e3aaae1 None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:38.154198 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f10045-9800-4a61-a12c-290180f810e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:38.155134 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f10045-9800-4a61-a12c-290180f810e1 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:38.155418 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f10045-9800-4a61-a12c-290180f810e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:38.155690 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f10045-9800-4a61-a12c-290180f810e1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:38.166341 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f10045-9800-4a61-a12c-290180f810e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 13:59:38.174783 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application [None req-a8f10045-9800-4a61-a12c-290180f810e1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 03 13:59:38.174783 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 13:59:38.174783 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 13:59:38.174783 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 13:59:38.174783 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 13:59:38.174783 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 13:59:38.174783 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 13:59:38.174783 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 13:59:38.174783 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 13:59:38.174783 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 13:59:38.174783 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 13:59:38.174783 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 13:59:38.174783 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 13:59:38.174783 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 13:59:38.174783 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 13:59:38.174783 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 13:59:38.175703 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 13:59:38.175703 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 13:59:38.175703 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 13:59:38.175703 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 13:59:38.175703 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 13:59:38.175703 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 13:59:38.175703 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 13:59:38.175703 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 13:59:38.175703 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 13:59:38.175703 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.get_or_create( May 03 13:59:38.175703 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 13:59:38.175703 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application with Lock( May 03 13:59:38.175703 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 13:59:38.175703 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._enter() May 03 13:59:38.175703 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 13:59:38.175703 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 13:59:38.176587 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 13:59:38.176587 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.creator() May 03 13:59:38.176587 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 13:59:38.176587 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application created_value = creator( May 03 13:59:38.176587 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 13:59:38.176587 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 13:59:38.176587 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 13:59:38.176587 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 13:59:38.176587 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 13:59:38.176587 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 13:59:38.176587 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 03 13:59:38.176587 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application May 03 13:59:38.180457 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 178/364] 10.222.0.36 () {56 vars in 1114 bytes} [Tue May 3 13:59:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 13:59:38.181784 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05df6d5-eb75-4d67-9418-c3d1e6e57cd0 None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:38.182073 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05df6d5-eb75-4d67-9418-c3d1e6e57cd0 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:38.182351 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05df6d5-eb75-4d67-9418-c3d1e6e57cd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:38.203278 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-d05df6d5-eb75-4d67-9418-c3d1e6e57cd0 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 13:59:38.204538 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-d05df6d5-eb75-4d67-9418-c3d1e6e57cd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 13:59:38.247753 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840c7609-4e25-45e8-8887-62c75e3aaae1 None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:38.283585 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 179/365] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 3 13:59:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 13:59:38.284451 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05df6d5-eb75-4d67-9418-c3d1e6e57cd0 None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:38.306072 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7976b8-b363-4354-a72b-22f5e4c97336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:38.306975 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7976b8-b363-4354-a72b-22f5e4c97336 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:38.307253 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7976b8-b363-4354-a72b-22f5e4c97336 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:38.307570 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7976b8-b363-4354-a72b-22f5e4c97336 None admin] PATH_INFO: `/v3/users/2acfd51d411a4f4a8c24ead3a40f0f6e` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:38.308832 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7976b8-b363-4354-a72b-22f5e4c97336 None admin] RBAC: Authorizing `identity:get_user(user_id=2acfd51d411a4f4a8c24ead3a40f0f6e)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:38.310325 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7976b8-b363-4354-a72b-22f5e4c97336 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:38.312203 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 187/366] 10.222.0.36 () {56 vars in 1177 bytes} [Tue May 3 13:59:38 2022] GET /identity/v3/users/2acfd51d411a4f4a8c24ead3a40f0f6e => generated 293 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 13:59:38.312794 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7976b8-b363-4354-a72b-22f5e4c97336 None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:38.399609 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05df6d5-eb75-4d67-9418-c3d1e6e57cd0 None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:38.426445 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7976b8-b363-4354-a72b-22f5e4c97336 None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:38.439827 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbd6777-fc3f-4deb-9981-c5df23c61775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:38.440892 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbd6777-fc3f-4deb-9981-c5df23c61775 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:38.441172 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbd6777-fc3f-4deb-9981-c5df23c61775 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:38.441479 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbd6777-fc3f-4deb-9981-c5df23c61775 None admin] PATH_INFO: `/v3/groups/e97c029b53dc4f44bea073c0a5d1568d` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:38.443188 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbd6777-fc3f-4deb-9981-c5df23c61775 None admin] RBAC: Authorizing `identity:get_group(group_id=e97c029b53dc4f44bea073c0a5d1568d)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:38.445042 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbd6777-fc3f-4deb-9981-c5df23c61775 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:38.447300 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 180/367] 10.222.0.36 () {56 vars in 1180 bytes} [Tue May 3 13:59:38 2022] GET /identity/v3/groups/e97c029b53dc4f44bea073c0a5d1568d => generated 226 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 13:59:38.448069 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbd6777-fc3f-4deb-9981-c5df23c61775 None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:38.467981 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39136a91-77b6-4b63-bf0d-174dfedb1314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:38.468712 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39136a91-77b6-4b63-bf0d-174dfedb1314 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:38.468991 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39136a91-77b6-4b63-bf0d-174dfedb1314 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:38.469263 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39136a91-77b6-4b63-bf0d-174dfedb1314 None admin] PATH_INFO: `/v3/roles` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:38.470065 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39136a91-77b6-4b63-bf0d-174dfedb1314 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 13:59:38.470347 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39136a91-77b6-4b63-bf0d-174dfedb1314 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:38.471722 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39136a91-77b6-4b63-bf0d-174dfedb1314 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:38.482360 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 188/368] 10.222.0.36 () {56 vars in 1111 bytes} [Tue May 3 13:59:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 13:59:38.483251 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39136a91-77b6-4b63-bf0d-174dfedb1314 None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:38.564341 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbd6777-fc3f-4deb-9981-c5df23c61775 None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:38.596458 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39136a91-77b6-4b63-bf0d-174dfedb1314 None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:38.604706 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8df5c59-0279-4d28-b8c6-30d01c6fce65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:38.605393 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8df5c59-0279-4d28-b8c6-30d01c6fce65 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:38.605676 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8df5c59-0279-4d28-b8c6-30d01c6fce65 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:38.605948 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8df5c59-0279-4d28-b8c6-30d01c6fce65 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:38.606781 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8df5c59-0279-4d28-b8c6-30d01c6fce65 None admin] RBAC: Adding query filter params (role.id=881b929165074739a253b35012fbc4fb, user.id=2acfd51d411a4f4a8c24ead3a40f0f6e, scope.system=all) {{(pid=80012) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 13:59:38.607088 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8df5c59-0279-4d28-b8c6-30d01c6fce65 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:38.608958 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8df5c59-0279-4d28-b8c6-30d01c6fce65 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:38.623410 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 181/369] 10.222.0.36 () {56 vars in 1308 bytes} [Tue May 3 13:59:38 2022] GET /identity/v3/role_assignments?user.id=2acfd51d411a4f4a8c24ead3a40f0f6e&scope.system=all&role.id=881b929165074739a253b35012fbc4fb => generated 510 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 13:59:38.624272 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8df5c59-0279-4d28-b8c6-30d01c6fce65 None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:38.648414 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4831f711-ccd7-460a-9e85-c55cc8ac0d89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:38.649280 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4831f711-ccd7-460a-9e85-c55cc8ac0d89 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:38.649644 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4831f711-ccd7-460a-9e85-c55cc8ac0d89 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:38.649919 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4831f711-ccd7-460a-9e85-c55cc8ac0d89 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:38.673524 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4831f711-ccd7-460a-9e85-c55cc8ac0d89 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 13:59:38.684612 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application [None req-4831f711-ccd7-460a-9e85-c55cc8ac0d89 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 03 13:59:38.684612 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 13:59:38.684612 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 13:59:38.684612 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 13:59:38.684612 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 13:59:38.684612 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 13:59:38.684612 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 13:59:38.684612 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 13:59:38.684612 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 13:59:38.684612 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 13:59:38.684612 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 13:59:38.684612 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 13:59:38.684612 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 13:59:38.684612 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 13:59:38.684612 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 13:59:38.684612 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 13:59:38.686992 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 13:59:38.686992 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 13:59:38.686992 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 13:59:38.686992 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 13:59:38.686992 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 13:59:38.686992 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 13:59:38.686992 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 13:59:38.686992 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 13:59:38.686992 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 13:59:38.686992 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.get_or_create( May 03 13:59:38.686992 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 13:59:38.686992 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application with Lock( May 03 13:59:38.686992 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 13:59:38.686992 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._enter() May 03 13:59:38.686992 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 13:59:38.686992 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 13:59:38.688949 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 13:59:38.688949 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.creator() May 03 13:59:38.688949 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 13:59:38.688949 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application created_value = creator( May 03 13:59:38.688949 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 13:59:38.688949 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 13:59:38.688949 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 13:59:38.688949 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 13:59:38.688949 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 13:59:38.688949 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 13:59:38.688949 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 03 13:59:38.688949 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application May 03 13:59:38.690761 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 189/370] 10.222.0.36 () {56 vars in 1096 bytes} [Tue May 3 13:59:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 13:59:38.690911 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4831f711-ccd7-460a-9e85-c55cc8ac0d89 None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:38.823534 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8df5c59-0279-4d28-b8c6-30d01c6fce65 None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:38.877576 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0876cd-1a21-4e5b-855b-5eb503bf0940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:38.878233 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0876cd-1a21-4e5b-855b-5eb503bf0940 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:38.878503 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0876cd-1a21-4e5b-855b-5eb503bf0940 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:38.878776 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0876cd-1a21-4e5b-855b-5eb503bf0940 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:38.879607 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0876cd-1a21-4e5b-855b-5eb503bf0940 None admin] RBAC: Adding query filter params (group.id=e97c029b53dc4f44bea073c0a5d1568d, role.id=441fdc11e95b47f4813f72610e39018b, scope.project.id=446967649a7d47af8f0eb54b376ac1fa) {{(pid=80012) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 13:59:38.879910 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0876cd-1a21-4e5b-855b-5eb503bf0940 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:38.881374 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0876cd-1a21-4e5b-855b-5eb503bf0940 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:38.883372 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4831f711-ccd7-460a-9e85-c55cc8ac0d89 None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:38.888209 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 182/371] 10.222.0.36 () {56 vars in 1376 bytes} [Tue May 3 13:59:38 2022] GET /identity/v3/role_assignments?group.id=e97c029b53dc4f44bea073c0a5d1568d&scope.project.id=446967649a7d47af8f0eb54b376ac1fa&role.id=441fdc11e95b47f4813f72610e39018b => generated 260 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 13:59:38.889486 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0876cd-1a21-4e5b-855b-5eb503bf0940 None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:38.919628 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f9a37a-9cd2-47cc-8cd2-b152c5759f0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:38.920717 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f9a37a-9cd2-47cc-8cd2-b152c5759f0f None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:38.921217 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f9a37a-9cd2-47cc-8cd2-b152c5759f0f None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:38.921716 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f9a37a-9cd2-47cc-8cd2-b152c5759f0f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:39.036461 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f9a37a-9cd2-47cc-8cd2-b152c5759f0f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:39.039375 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f9a37a-9cd2-47cc-8cd2-b152c5759f0f None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:39.069155 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0876cd-1a21-4e5b-855b-5eb503bf0940 None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:39.111295 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b155ca-dae4-4c7f-8405-41cfd74b1930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:39.114905 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b155ca-dae4-4c7f-8405-41cfd74b1930 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:39.115442 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b155ca-dae4-4c7f-8405-41cfd74b1930 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:39.115905 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b155ca-dae4-4c7f-8405-41cfd74b1930 None admin] PATH_INFO: `/v3/roles` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:39.116875 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b155ca-dae4-4c7f-8405-41cfd74b1930 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80012) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 13:59:39.119137 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b155ca-dae4-4c7f-8405-41cfd74b1930 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:39.122901 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b155ca-dae4-4c7f-8405-41cfd74b1930 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:39.140552 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 183/372] 10.222.0.36 () {56 vars in 1099 bytes} [Tue May 3 13:59:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 13:59:39.146477 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b155ca-dae4-4c7f-8405-41cfd74b1930 None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:39.211750 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 190/373] 10.222.0.36 () {58 vars in 1282 bytes} [Tue May 3 13:59:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 521 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 03 13:59:39.217550 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f9a37a-9cd2-47cc-8cd2-b152c5759f0f None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:39.274218 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b155ca-dae4-4c7f-8405-41cfd74b1930 None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:39.312715 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f4834b-56af-4bba-95f7-5599cacd12d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:39.313992 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f4834b-56af-4bba-95f7-5599cacd12d4 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:39.314668 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f4834b-56af-4bba-95f7-5599cacd12d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:39.315154 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f4834b-56af-4bba-95f7-5599cacd12d4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:39.336589 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f9a37a-9cd2-47cc-8cd2-b152c5759f0f None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:39.376222 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4b960b-2fcf-415e-b89c-22d4d049cd64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:39.377488 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4b960b-2fcf-415e-b89c-22d4d049cd64 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:39.378055 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4b960b-2fcf-415e-b89c-22d4d049cd64 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:39.378489 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4b960b-2fcf-415e-b89c-22d4d049cd64 None admin] PATH_INFO: `/v3/projects/446967649a7d47af8f0eb54b376ac1fa` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:39.380333 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4b960b-2fcf-415e-b89c-22d4d049cd64 None admin] RBAC: Authorizing `identity:get_project(project_id=446967649a7d47af8f0eb54b376ac1fa)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:39.382661 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4b960b-2fcf-415e-b89c-22d4d049cd64 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:39.385542 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 191/374] 10.222.0.36 () {56 vars in 1186 bytes} [Tue May 3 13:59:39 2022] GET /identity/v3/projects/446967649a7d47af8f0eb54b376ac1fa => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 13:59:39.394269 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4b960b-2fcf-415e-b89c-22d4d049cd64 None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:39.394467 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f4834b-56af-4bba-95f7-5599cacd12d4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:39.395907 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f4834b-56af-4bba-95f7-5599cacd12d4 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:39.494337 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 184/375] 10.222.0.36 () {58 vars in 1282 bytes} [Tue May 3 13:59:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 03 13:59:39.494630 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4b960b-2fcf-415e-b89c-22d4d049cd64 None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:39.501569 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f4834b-56af-4bba-95f7-5599cacd12d4 None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:39.542925 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188a8031-f8eb-49c2-926c-df32d658cad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:39.543806 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188a8031-f8eb-49c2-926c-df32d658cad7 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:39.544084 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188a8031-f8eb-49c2-926c-df32d658cad7 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:39.544356 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188a8031-f8eb-49c2-926c-df32d658cad7 None admin] PATH_INFO: `/v3/groups/e97c029b53dc4f44bea073c0a5d1568d` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:39.549140 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188a8031-f8eb-49c2-926c-df32d658cad7 None admin] RBAC: Authorizing `identity:get_group(group_id=e97c029b53dc4f44bea073c0a5d1568d)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:39.550712 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188a8031-f8eb-49c2-926c-df32d658cad7 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:39.552403 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 192/376] 10.222.0.36 () {56 vars in 1180 bytes} [Tue May 3 13:59:39 2022] GET /identity/v3/groups/e97c029b53dc4f44bea073c0a5d1568d => generated 226 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 13:59:39.558413 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188a8031-f8eb-49c2-926c-df32d658cad7 None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:39.611301 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f4834b-56af-4bba-95f7-5599cacd12d4 None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:39.655336 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0267ff0f-dc9f-48ef-8c43-237b8fcacdc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:39.656543 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0267ff0f-dc9f-48ef-8c43-237b8fcacdc6 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:39.656995 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0267ff0f-dc9f-48ef-8c43-237b8fcacdc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:39.657472 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0267ff0f-dc9f-48ef-8c43-237b8fcacdc6 None admin] PATH_INFO: `/v3/projects/71795b2bf1064a2fb47b7b3b4817ce5c` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:39.659727 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0267ff0f-dc9f-48ef-8c43-237b8fcacdc6 None admin] RBAC: Authorizing `identity:get_project(project_id=71795b2bf1064a2fb47b7b3b4817ce5c)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:39.661386 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0267ff0f-dc9f-48ef-8c43-237b8fcacdc6 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:39.663692 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 185/377] 10.222.0.36 () {56 vars in 1186 bytes} [Tue May 3 13:59:39 2022] GET /identity/v3/projects/71795b2bf1064a2fb47b7b3b4817ce5c => generated 344 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 13:59:39.670998 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0267ff0f-dc9f-48ef-8c43-237b8fcacdc6 None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:39.767397 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188a8031-f8eb-49c2-926c-df32d658cad7 None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:39.789483 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0267ff0f-dc9f-48ef-8c43-237b8fcacdc6 None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:39.813699 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58c06ff-bed4-4d40-a602-1038e56e673c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:39.814405 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58c06ff-bed4-4d40-a602-1038e56e673c None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:39.814686 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58c06ff-bed4-4d40-a602-1038e56e673c None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:39.814959 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58c06ff-bed4-4d40-a602-1038e56e673c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:39.815793 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58c06ff-bed4-4d40-a602-1038e56e673c None admin] RBAC: Adding query filter params (group.id=e97c029b53dc4f44bea073c0a5d1568d, role.id=bd29d35ea39b4ba293ffbf1ffbf4b940, scope.project.id=446967649a7d47af8f0eb54b376ac1fa) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 13:59:39.816101 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58c06ff-bed4-4d40-a602-1038e56e673c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:39.817555 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58c06ff-bed4-4d40-a602-1038e56e673c None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:39.830753 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 193/378] 10.222.0.36 () {56 vars in 1376 bytes} [Tue May 3 13:59:39 2022] GET /identity/v3/role_assignments?group.id=e97c029b53dc4f44bea073c0a5d1568d&scope.project.id=446967649a7d47af8f0eb54b376ac1fa&role.id=bd29d35ea39b4ba293ffbf1ffbf4b940 => generated 260 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 13:59:39.873163 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355dab95-8aa7-42a2-b6d0-bf0d36a8484f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:39.874066 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355dab95-8aa7-42a2-b6d0-bf0d36a8484f None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:39.874348 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355dab95-8aa7-42a2-b6d0-bf0d36a8484f None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:39.874619 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355dab95-8aa7-42a2-b6d0-bf0d36a8484f None admin] PATH_INFO: `/v3/groups/5022b31559214460913f588bc58da60f` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:39.883021 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355dab95-8aa7-42a2-b6d0-bf0d36a8484f None admin] RBAC: Authorizing `identity:get_group(group_id=5022b31559214460913f588bc58da60f)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:39.884506 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355dab95-8aa7-42a2-b6d0-bf0d36a8484f None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:39.886543 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 186/379] 10.222.0.36 () {56 vars in 1180 bytes} [Tue May 3 13:59:39 2022] GET /identity/v3/groups/5022b31559214460913f588bc58da60f => generated 229 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 13:59:39.893017 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58c06ff-bed4-4d40-a602-1038e56e673c None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:40.033907 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58c06ff-bed4-4d40-a602-1038e56e673c None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:40.082024 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926a86ce-b54b-46bd-abbe-d8857c9fecb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:40.082704 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926a86ce-b54b-46bd-abbe-d8857c9fecb4 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:40.082986 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926a86ce-b54b-46bd-abbe-d8857c9fecb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:40.083260 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926a86ce-b54b-46bd-abbe-d8857c9fecb4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:40.084094 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926a86ce-b54b-46bd-abbe-d8857c9fecb4 None admin] RBAC: Adding query filter params (group.id=5022b31559214460913f588bc58da60f, role.id=36abe9b50fd8479c86c4f8f70fd85aa3, scope.project.id=71795b2bf1064a2fb47b7b3b4817ce5c) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 13:59:40.084398 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926a86ce-b54b-46bd-abbe-d8857c9fecb4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:40.085901 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926a86ce-b54b-46bd-abbe-d8857c9fecb4 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:40.092480 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 194/380] 10.222.0.36 () {56 vars in 1376 bytes} [Tue May 3 13:59:39 2022] GET /identity/v3/role_assignments?group.id=5022b31559214460913f588bc58da60f&scope.project.id=71795b2bf1064a2fb47b7b3b4817ce5c&role.id=36abe9b50fd8479c86c4f8f70fd85aa3 => generated 260 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 13:59:40.427619 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6456ff-755d-4dd2-9e7c-6b3e38506b5d None None] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:40.427895 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6456ff-755d-4dd2-9e7c-6b3e38506b5d None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:40.428423 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6456ff-755d-4dd2-9e7c-6b3e38506b5d None None] PATH_INFO: `/` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:40.430418 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 187/381] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 3 13:59:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 13:59:40.437010 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d158928e-a991-4506-835c-c02c1919afda None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:40.437636 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d158928e-a991-4506-835c-c02c1919afda None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:40.438121 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d158928e-a991-4506-835c-c02c1919afda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:40.458176 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-d158928e-a991-4506-835c-c02c1919afda None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 13:59:40.459360 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-d158928e-a991-4506-835c-c02c1919afda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 13:59:40.532006 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 195/382] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 3 13:59:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 03 13:59:40.555441 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6456ff-755d-4dd2-9e7c-6b3e38506b5d None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:40.654362 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6456ff-755d-4dd2-9e7c-6b3e38506b5d None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:40.687712 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1edad14-5a1e-49f3-9d3f-57453ead520b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:40.688428 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1edad14-5a1e-49f3-9d3f-57453ead520b None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:40.688704 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1edad14-5a1e-49f3-9d3f-57453ead520b None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:40.688972 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1edad14-5a1e-49f3-9d3f-57453ead520b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:40.699203 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1edad14-5a1e-49f3-9d3f-57453ead520b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 13:59:40.706983 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application [None req-f1edad14-5a1e-49f3-9d3f-57453ead520b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 03 13:59:40.706983 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 13:59:40.706983 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 13:59:40.706983 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 13:59:40.706983 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 13:59:40.706983 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 13:59:40.706983 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 13:59:40.706983 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 13:59:40.706983 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 13:59:40.706983 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 13:59:40.706983 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 13:59:40.706983 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 13:59:40.706983 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 13:59:40.706983 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 13:59:40.706983 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 13:59:40.706983 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 13:59:40.707928 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 13:59:40.707928 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 13:59:40.707928 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 13:59:40.707928 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 13:59:40.707928 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 13:59:40.707928 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 13:59:40.707928 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 13:59:40.707928 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 13:59:40.707928 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 13:59:40.707928 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.get_or_create( May 03 13:59:40.707928 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 13:59:40.707928 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application with Lock( May 03 13:59:40.707928 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 13:59:40.707928 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._enter() May 03 13:59:40.707928 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 13:59:40.707928 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 13:59:40.709167 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 13:59:40.709167 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.creator() May 03 13:59:40.709167 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 13:59:40.709167 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application created_value = creator( May 03 13:59:40.709167 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 13:59:40.709167 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 13:59:40.709167 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 13:59:40.709167 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 13:59:40.709167 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 13:59:40.709167 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 13:59:40.709167 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 03 13:59:40.709167 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application May 03 13:59:40.709167 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 188/383] 10.222.0.36 () {56 vars in 1099 bytes} [Tue May 3 13:59:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 13:59:40.714784 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d158928e-a991-4506-835c-c02c1919afda None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:40.812466 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d158928e-a991-4506-835c-c02c1919afda None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:40.823501 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187b44c2-1fcc-4b95-8147-dc64594ce1de None None] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:40.823790 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187b44c2-1fcc-4b95-8147-dc64594ce1de None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:40.824052 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187b44c2-1fcc-4b95-8147-dc64594ce1de None None] PATH_INFO: `/` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:40.825600 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 189/384] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 3 13:59:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 13:59:40.831377 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f6f8ba-5614-4d91-b34b-032a84534b96 None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:40.831661 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f6f8ba-5614-4d91-b34b-032a84534b96 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:40.831939 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f6f8ba-5614-4d91-b34b-032a84534b96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:40.856828 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-33f6f8ba-5614-4d91-b34b-032a84534b96 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 13:59:40.858546 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-33f6f8ba-5614-4d91-b34b-032a84534b96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 13:59:40.889175 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec0371c-3aa5-43b2-9b7e-5a613c38e89c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:40.890254 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec0371c-3aa5-43b2-9b7e-5a613c38e89c None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:40.890724 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec0371c-3aa5-43b2-9b7e-5a613c38e89c None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:40.891269 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec0371c-3aa5-43b2-9b7e-5a613c38e89c None admin] PATH_INFO: `/v3/roles` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:40.892211 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec0371c-3aa5-43b2-9b7e-5a613c38e89c None admin] RBAC: Adding query filter params (name=member) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 13:59:40.892702 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec0371c-3aa5-43b2-9b7e-5a613c38e89c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:40.894317 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec0371c-3aa5-43b2-9b7e-5a613c38e89c None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:40.903484 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 196/385] 10.222.0.36 () {56 vars in 1101 bytes} [Tue May 3 13:59:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 13:59:40.909866 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec0371c-3aa5-43b2-9b7e-5a613c38e89c None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:40.955484 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 190/386] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 3 13:59:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 03 13:59:40.990249 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f6f8ba-5614-4d91-b34b-032a84534b96 None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:41.046937 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec0371c-3aa5-43b2-9b7e-5a613c38e89c None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:41.100853 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d76168-9edb-416a-9be8-d91074c32b4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:41.101764 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d76168-9edb-416a-9be8-d91074c32b4e None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:41.102037 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d76168-9edb-416a-9be8-d91074c32b4e None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:41.102307 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d76168-9edb-416a-9be8-d91074c32b4e None admin] PATH_INFO: `/v3/groups/e97c029b53dc4f44bea073c0a5d1568d` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:41.106015 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d76168-9edb-416a-9be8-d91074c32b4e None admin] RBAC: Authorizing `identity:get_group(group_id=e97c029b53dc4f44bea073c0a5d1568d)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:41.107633 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d76168-9edb-416a-9be8-d91074c32b4e None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:41.109563 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 197/387] 10.222.0.36 () {56 vars in 1180 bytes} [Tue May 3 13:59:40 2022] GET /identity/v3/groups/e97c029b53dc4f44bea073c0a5d1568d => generated 226 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 13:59:41.116527 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d76168-9edb-416a-9be8-d91074c32b4e None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:41.176269 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f6f8ba-5614-4d91-b34b-032a84534b96 None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:41.220274 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57df0347-6fa5-4855-a470-6b40021340ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:41.221108 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57df0347-6fa5-4855-a470-6b40021340ac None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:41.221411 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57df0347-6fa5-4855-a470-6b40021340ac None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:41.221686 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57df0347-6fa5-4855-a470-6b40021340ac None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:41.243350 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57df0347-6fa5-4855-a470-6b40021340ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 13:59:41.259693 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application [None req-57df0347-6fa5-4855-a470-6b40021340ac None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 03 13:59:41.259693 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 13:59:41.259693 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 13:59:41.259693 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 13:59:41.259693 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 13:59:41.259693 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 13:59:41.259693 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 13:59:41.259693 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 13:59:41.259693 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 13:59:41.259693 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 13:59:41.259693 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 13:59:41.259693 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 13:59:41.259693 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 13:59:41.259693 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 13:59:41.259693 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 13:59:41.259693 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 13:59:41.260669 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 13:59:41.260669 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 13:59:41.260669 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 13:59:41.260669 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 13:59:41.260669 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 13:59:41.260669 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 13:59:41.260669 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 13:59:41.260669 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 13:59:41.260669 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 13:59:41.260669 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.get_or_create( May 03 13:59:41.260669 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 13:59:41.260669 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application with Lock( May 03 13:59:41.260669 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 13:59:41.260669 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._enter() May 03 13:59:41.260669 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 13:59:41.260669 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 13:59:41.261908 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 13:59:41.261908 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.creator() May 03 13:59:41.261908 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 13:59:41.261908 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application created_value = creator( May 03 13:59:41.261908 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 13:59:41.261908 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 13:59:41.261908 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 13:59:41.261908 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 13:59:41.261908 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 13:59:41.261908 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 13:59:41.261908 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 03 13:59:41.261908 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application May 03 13:59:41.261908 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 191/388] 10.222.0.36 () {56 vars in 1114 bytes} [Tue May 3 13:59:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 13:59:41.267024 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57df0347-6fa5-4855-a470-6b40021340ac None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:41.325200 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d76168-9edb-416a-9be8-d91074c32b4e None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:41.373968 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57df0347-6fa5-4855-a470-6b40021340ac None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:41.405410 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07d67b4-b26f-434b-83a8-a1d93c2bda60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:41.406538 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07d67b4-b26f-434b-83a8-a1d93c2bda60 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:41.406908 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07d67b4-b26f-434b-83a8-a1d93c2bda60 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:41.407274 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07d67b4-b26f-434b-83a8-a1d93c2bda60 None admin] PATH_INFO: `/v3/projects/3256bc7158894136b4937ecc0a8b3073` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:41.408361 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11304584-12ee-46e9-aa91-5cf163fd2f3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:41.408766 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07d67b4-b26f-434b-83a8-a1d93c2bda60 None admin] RBAC: Authorizing `identity:get_project(project_id=3256bc7158894136b4937ecc0a8b3073)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:41.409464 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11304584-12ee-46e9-aa91-5cf163fd2f3a None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:41.409896 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11304584-12ee-46e9-aa91-5cf163fd2f3a None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:41.410303 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11304584-12ee-46e9-aa91-5cf163fd2f3a None admin] PATH_INFO: `/v3/roles` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:41.410601 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07d67b4-b26f-434b-83a8-a1d93c2bda60 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:41.411339 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11304584-12ee-46e9-aa91-5cf163fd2f3a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80012) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 13:59:41.411792 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11304584-12ee-46e9-aa91-5cf163fd2f3a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:41.413271 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11304584-12ee-46e9-aa91-5cf163fd2f3a None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:41.413899 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 198/389] 10.222.0.36 () {56 vars in 1186 bytes} [Tue May 3 13:59:41 2022] GET /identity/v3/projects/3256bc7158894136b4937ecc0a8b3073 => generated 298 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 13:59:41.418541 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07d67b4-b26f-434b-83a8-a1d93c2bda60 None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:41.422680 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 192/390] 10.222.0.36 () {56 vars in 1111 bytes} [Tue May 3 13:59:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 13:59:41.430407 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11304584-12ee-46e9-aa91-5cf163fd2f3a None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:41.539282 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11304584-12ee-46e9-aa91-5cf163fd2f3a None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:41.575592 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7f0342-71e4-4f02-8de7-6f7e3a947c03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:41.576885 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7f0342-71e4-4f02-8de7-6f7e3a947c03 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:41.577585 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7f0342-71e4-4f02-8de7-6f7e3a947c03 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:41.578083 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7f0342-71e4-4f02-8de7-6f7e3a947c03 None admin] PATH_INFO: `/v3/groups/e97c029b53dc4f44bea073c0a5d1568d` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:41.579541 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7f0342-71e4-4f02-8de7-6f7e3a947c03 None admin] RBAC: Authorizing `identity:get_group(group_id=e97c029b53dc4f44bea073c0a5d1568d)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:41.581932 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7f0342-71e4-4f02-8de7-6f7e3a947c03 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:41.584167 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 193/391] 10.222.0.36 () {56 vars in 1180 bytes} [Tue May 3 13:59:41 2022] GET /identity/v3/groups/e97c029b53dc4f44bea073c0a5d1568d => generated 226 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 13:59:41.589591 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7f0342-71e4-4f02-8de7-6f7e3a947c03 None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:41.619391 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07d67b4-b26f-434b-83a8-a1d93c2bda60 None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:41.656194 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42ff7ed-41b5-456a-8b43-e2331985d6b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:41.657351 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42ff7ed-41b5-456a-8b43-e2331985d6b1 None admin] REQUEST_METHOD: `PUT` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:41.657766 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42ff7ed-41b5-456a-8b43-e2331985d6b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:41.658200 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42ff7ed-41b5-456a-8b43-e2331985d6b1 None admin] PATH_INFO: `/v3/projects/3256bc7158894136b4937ecc0a8b3073/groups/e97c029b53dc4f44bea073c0a5d1568d/roles/441fdc11e95b47f4813f72610e39018b` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:41.660292 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42ff7ed-41b5-456a-8b43-e2331985d6b1 None admin] RBAC: Authorizing `identity:create_grant(project_id=3256bc7158894136b4937ecc0a8b3073, group_id=e97c029b53dc4f44bea073c0a5d1568d, role_id=441fdc11e95b47f4813f72610e39018b)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:41.661895 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42ff7ed-41b5-456a-8b43-e2331985d6b1 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:41.689151 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7f0342-71e4-4f02-8de7-6f7e3a947c03 None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:41.689702 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 199/392] 10.222.0.36 () {58 vars in 1442 bytes} [Tue May 3 13:59:41 2022] PUT /identity/v3/projects/3256bc7158894136b4937ecc0a8b3073/groups/e97c029b53dc4f44bea073c0a5d1568d/roles/441fdc11e95b47f4813f72610e39018b => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 13:59:41.726388 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d27462-638e-4da3-8340-4f146a6a9251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:41.727630 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d27462-638e-4da3-8340-4f146a6a9251 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:41.728158 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d27462-638e-4da3-8340-4f146a6a9251 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:41.728630 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d27462-638e-4da3-8340-4f146a6a9251 None admin] PATH_INFO: `/v3/projects/3256bc7158894136b4937ecc0a8b3073` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:41.730218 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d27462-638e-4da3-8340-4f146a6a9251 None admin] RBAC: Authorizing `identity:get_project(project_id=3256bc7158894136b4937ecc0a8b3073)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:41.732071 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d27462-638e-4da3-8340-4f146a6a9251 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:41.734470 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 194/393] 10.222.0.36 () {56 vars in 1186 bytes} [Tue May 3 13:59:41 2022] GET /identity/v3/projects/3256bc7158894136b4937ecc0a8b3073 => generated 298 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 13:59:41.740441 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42ff7ed-41b5-456a-8b43-e2331985d6b1 None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:41.855488 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42ff7ed-41b5-456a-8b43-e2331985d6b1 None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:41.893668 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bd36c3-d9ac-4b19-a5dd-c36c833c637a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:41.894956 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bd36c3-d9ac-4b19-a5dd-c36c833c637a None admin] REQUEST_METHOD: `PUT` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:41.895430 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bd36c3-d9ac-4b19-a5dd-c36c833c637a None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:41.895893 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bd36c3-d9ac-4b19-a5dd-c36c833c637a None admin] PATH_INFO: `/v3/projects/3256bc7158894136b4937ecc0a8b3073/groups/e97c029b53dc4f44bea073c0a5d1568d/roles/bd29d35ea39b4ba293ffbf1ffbf4b940` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:41.899534 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bd36c3-d9ac-4b19-a5dd-c36c833c637a None admin] RBAC: Authorizing `identity:create_grant(project_id=3256bc7158894136b4937ecc0a8b3073, group_id=e97c029b53dc4f44bea073c0a5d1568d, role_id=bd29d35ea39b4ba293ffbf1ffbf4b940)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:41.901363 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bd36c3-d9ac-4b19-a5dd-c36c833c637a None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:41.926327 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 200/394] 10.222.0.36 () {58 vars in 1442 bytes} [Tue May 3 13:59:41 2022] PUT /identity/v3/projects/3256bc7158894136b4937ecc0a8b3073/groups/e97c029b53dc4f44bea073c0a5d1568d/roles/bd29d35ea39b4ba293ffbf1ffbf4b940 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 13:59:42.245992 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3991015-4633-44f2-8d30-2f4eb596fe84 None None] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:42.246680 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3991015-4633-44f2-8d30-2f4eb596fe84 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:42.247159 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3991015-4633-44f2-8d30-2f4eb596fe84 None None] PATH_INFO: `/` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:42.249123 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 195/395] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 3 13:59:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 13:59:42.256006 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdc9dd8-7205-41c1-a29e-17870475407a None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:42.256566 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdc9dd8-7205-41c1-a29e-17870475407a None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:42.257031 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdc9dd8-7205-41c1-a29e-17870475407a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:42.275936 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-3bdc9dd8-7205-41c1-a29e-17870475407a None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 13:59:42.277570 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-3bdc9dd8-7205-41c1-a29e-17870475407a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 13:59:42.353158 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 201/396] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 3 13:59:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 13:59:42.396637 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3991015-4633-44f2-8d30-2f4eb596fe84 None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:42.531352 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3991015-4633-44f2-8d30-2f4eb596fe84 None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:42.567755 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232d9cf5-17b4-47c0-8a47-db9b4ca4252a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:42.568843 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232d9cf5-17b4-47c0-8a47-db9b4ca4252a None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:42.569261 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232d9cf5-17b4-47c0-8a47-db9b4ca4252a None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:42.569707 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232d9cf5-17b4-47c0-8a47-db9b4ca4252a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:42.580346 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232d9cf5-17b4-47c0-8a47-db9b4ca4252a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 13:59:42.592620 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application [None req-232d9cf5-17b4-47c0-8a47-db9b4ca4252a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 03 13:59:42.592620 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 13:59:42.592620 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 13:59:42.592620 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 13:59:42.592620 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 13:59:42.592620 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 13:59:42.592620 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 13:59:42.592620 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 13:59:42.592620 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 13:59:42.592620 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 13:59:42.592620 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 13:59:42.592620 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 13:59:42.592620 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 13:59:42.592620 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 13:59:42.592620 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 13:59:42.592620 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 13:59:42.593802 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 13:59:42.593802 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 13:59:42.593802 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 13:59:42.593802 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 13:59:42.593802 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 13:59:42.593802 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 13:59:42.593802 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 13:59:42.593802 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 13:59:42.593802 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 13:59:42.593802 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.get_or_create( May 03 13:59:42.593802 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 13:59:42.593802 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application with Lock( May 03 13:59:42.593802 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 13:59:42.593802 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._enter() May 03 13:59:42.593802 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 13:59:42.593802 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 13:59:42.594806 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 13:59:42.594806 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.creator() May 03 13:59:42.594806 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 13:59:42.594806 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application created_value = creator( May 03 13:59:42.594806 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 13:59:42.594806 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 13:59:42.594806 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 13:59:42.594806 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 13:59:42.594806 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 13:59:42.594806 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 13:59:42.594806 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 03 13:59:42.594806 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application May 03 13:59:42.596867 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 196/397] 10.222.0.36 () {56 vars in 1099 bytes} [Tue May 3 13:59:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 13:59:42.604730 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdc9dd8-7205-41c1-a29e-17870475407a None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:42.629319 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d168bf8c-ba40-4a03-b7a3-a998e8de60b0 None None] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:42.630079 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d168bf8c-ba40-4a03-b7a3-a998e8de60b0 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:42.630545 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d168bf8c-ba40-4a03-b7a3-a998e8de60b0 None None] PATH_INFO: `/` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:42.632993 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 197/398] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 3 13:59:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 13:59:42.643593 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b664480-3a17-4e01-82cc-9194612a9431 None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:42.644079 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b664480-3a17-4e01-82cc-9194612a9431 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:42.644488 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b664480-3a17-4e01-82cc-9194612a9431 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:42.676462 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-1b664480-3a17-4e01-82cc-9194612a9431 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 13:59:42.677680 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-1b664480-3a17-4e01-82cc-9194612a9431 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 13:59:42.776193 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdc9dd8-7205-41c1-a29e-17870475407a None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:42.793744 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 198/399] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 3 13:59:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 13:59:42.821043 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28008b8-cd78-4743-be55-dda3a2335f85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:42.822084 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28008b8-cd78-4743-be55-dda3a2335f85 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:42.822521 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28008b8-cd78-4743-be55-dda3a2335f85 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:42.822936 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28008b8-cd78-4743-be55-dda3a2335f85 None admin] PATH_INFO: `/v3/roles` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:42.824144 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28008b8-cd78-4743-be55-dda3a2335f85 None admin] RBAC: Adding query filter params (name=member) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 13:59:42.824614 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28008b8-cd78-4743-be55-dda3a2335f85 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:42.826944 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28008b8-cd78-4743-be55-dda3a2335f85 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:42.848883 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 202/400] 10.222.0.36 () {56 vars in 1101 bytes} [Tue May 3 13:59:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 13:59:42.854553 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b664480-3a17-4e01-82cc-9194612a9431 None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:42.886548 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28008b8-cd78-4743-be55-dda3a2335f85 None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:43.006024 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b664480-3a17-4e01-82cc-9194612a9431 None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:43.052811 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c566660-acdc-4c3e-a33e-18098f58943a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:43.053637 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c566660-acdc-4c3e-a33e-18098f58943a None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:43.053909 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c566660-acdc-4c3e-a33e-18098f58943a None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:43.054175 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c566660-acdc-4c3e-a33e-18098f58943a None admin] PATH_INFO: `/v3/groups/e97c029b53dc4f44bea073c0a5d1568d` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:43.055349 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c566660-acdc-4c3e-a33e-18098f58943a None admin] RBAC: Authorizing `identity:get_group(group_id=e97c029b53dc4f44bea073c0a5d1568d)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:43.056781 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c566660-acdc-4c3e-a33e-18098f58943a None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:43.063462 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 199/401] 10.222.0.36 () {56 vars in 1180 bytes} [Tue May 3 13:59:42 2022] GET /identity/v3/groups/e97c029b53dc4f44bea073c0a5d1568d => generated 226 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 13:59:43.065905 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28008b8-cd78-4743-be55-dda3a2335f85 None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:43.067015 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c566660-acdc-4c3e-a33e-18098f58943a None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:43.115500 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6937c3-fd92-4e31-ad22-6ac1909c473e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:43.117193 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6937c3-fd92-4e31-ad22-6ac1909c473e None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:43.117991 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6937c3-fd92-4e31-ad22-6ac1909c473e None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:43.118468 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6937c3-fd92-4e31-ad22-6ac1909c473e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:43.133217 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6937c3-fd92-4e31-ad22-6ac1909c473e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 13:59:43.144192 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application [None req-cb6937c3-fd92-4e31-ad22-6ac1909c473e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 03 13:59:43.144192 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 13:59:43.144192 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 13:59:43.144192 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 13:59:43.144192 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 13:59:43.144192 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 13:59:43.144192 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 13:59:43.144192 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 13:59:43.144192 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 13:59:43.144192 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 13:59:43.144192 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 13:59:43.144192 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 13:59:43.144192 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 13:59:43.144192 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 13:59:43.144192 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 13:59:43.144192 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 13:59:43.145245 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 13:59:43.145245 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 13:59:43.145245 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 13:59:43.145245 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 13:59:43.145245 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 13:59:43.145245 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 13:59:43.145245 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 13:59:43.145245 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 13:59:43.145245 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 13:59:43.145245 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.get_or_create( May 03 13:59:43.145245 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 13:59:43.145245 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application with Lock( May 03 13:59:43.145245 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 13:59:43.145245 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._enter() May 03 13:59:43.145245 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 13:59:43.145245 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 13:59:43.146109 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 13:59:43.146109 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.creator() May 03 13:59:43.146109 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 13:59:43.146109 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application created_value = creator( May 03 13:59:43.146109 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 13:59:43.146109 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 13:59:43.146109 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 13:59:43.146109 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 13:59:43.146109 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 13:59:43.146109 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 13:59:43.146109 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 03 13:59:43.146109 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application May 03 13:59:43.153397 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 203/402] 10.222.0.36 () {56 vars in 1114 bytes} [Tue May 3 13:59:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 13:59:43.156036 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135787b1-200f-4164-88d1-5e05712e1452 None None] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:43.156795 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135787b1-200f-4164-88d1-5e05712e1452 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:43.157312 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135787b1-200f-4164-88d1-5e05712e1452 None None] PATH_INFO: `/` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:43.159720 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 204/403] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 3 13:59:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 13:59:43.160878 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135787b1-200f-4164-88d1-5e05712e1452 None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:43.181087 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c566660-acdc-4c3e-a33e-18098f58943a None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:43.219858 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8655354-f22d-412d-bcae-8522406291f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:43.220719 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8655354-f22d-412d-bcae-8522406291f2 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:43.221004 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8655354-f22d-412d-bcae-8522406291f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:43.221298 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8655354-f22d-412d-bcae-8522406291f2 None admin] PATH_INFO: `/v3/projects/446967649a7d47af8f0eb54b376ac1fa` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:43.222703 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8655354-f22d-412d-bcae-8522406291f2 None admin] RBAC: Authorizing `identity:get_project(project_id=446967649a7d47af8f0eb54b376ac1fa)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:43.224246 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8655354-f22d-412d-bcae-8522406291f2 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:43.230705 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 200/404] 10.222.0.36 () {56 vars in 1186 bytes} [Tue May 3 13:59:43 2022] GET /identity/v3/projects/446967649a7d47af8f0eb54b376ac1fa => generated 302 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 13:59:43.232021 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70297ae-4137-4a8e-8a5e-4c816149abca None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:43.232301 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70297ae-4137-4a8e-8a5e-4c816149abca None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:43.232630 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70297ae-4137-4a8e-8a5e-4c816149abca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:43.250459 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-b70297ae-4137-4a8e-8a5e-4c816149abca None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 13:59:43.251732 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-b70297ae-4137-4a8e-8a5e-4c816149abca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 13:59:43.292769 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135787b1-200f-4164-88d1-5e05712e1452 None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:43.335014 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 201/405] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 3 13:59:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 13:59:43.336701 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70297ae-4137-4a8e-8a5e-4c816149abca None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:43.340533 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3328664-51c1-41d3-854f-f5ed5f4745ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:43.341790 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3328664-51c1-41d3-854f-f5ed5f4745ca None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:43.341790 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3328664-51c1-41d3-854f-f5ed5f4745ca None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:43.341790 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3328664-51c1-41d3-854f-f5ed5f4745ca None admin] PATH_INFO: `/v3/roles` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:43.342591 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3328664-51c1-41d3-854f-f5ed5f4745ca None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 13:59:43.342857 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3328664-51c1-41d3-854f-f5ed5f4745ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:43.344227 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3328664-51c1-41d3-854f-f5ed5f4745ca None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:43.352170 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 205/406] 10.222.0.36 () {56 vars in 1111 bytes} [Tue May 3 13:59:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 13:59:43.357855 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3328664-51c1-41d3-854f-f5ed5f4745ca None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:43.455914 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70297ae-4137-4a8e-8a5e-4c816149abca None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:43.479768 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3328664-51c1-41d3-854f-f5ed5f4745ca None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:43.493955 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2b103c-912b-490c-99bf-966ea194b312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:43.494742 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2b103c-912b-490c-99bf-966ea194b312 None admin] REQUEST_METHOD: `PUT` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:43.495020 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2b103c-912b-490c-99bf-966ea194b312 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:43.495287 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2b103c-912b-490c-99bf-966ea194b312 None admin] PATH_INFO: `/v3/projects/446967649a7d47af8f0eb54b376ac1fa/groups/e97c029b53dc4f44bea073c0a5d1568d/roles/441fdc11e95b47f4813f72610e39018b` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:43.497223 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2b103c-912b-490c-99bf-966ea194b312 None admin] RBAC: Authorizing `identity:create_grant(project_id=446967649a7d47af8f0eb54b376ac1fa, group_id=e97c029b53dc4f44bea073c0a5d1568d, role_id=441fdc11e95b47f4813f72610e39018b)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:43.498952 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2b103c-912b-490c-99bf-966ea194b312 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:43.526180 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5590c2-9764-4457-81c4-957566e7ec9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:43.526385 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 202/407] 10.222.0.36 () {58 vars in 1442 bytes} [Tue May 3 13:59:43 2022] PUT /identity/v3/projects/446967649a7d47af8f0eb54b376ac1fa/groups/e97c029b53dc4f44bea073c0a5d1568d/roles/441fdc11e95b47f4813f72610e39018b => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 13:59:43.526772 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2b103c-912b-490c-99bf-966ea194b312 None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:43.528048 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5590c2-9764-4457-81c4-957566e7ec9e None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:43.528526 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5590c2-9764-4457-81c4-957566e7ec9e None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:43.529014 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5590c2-9764-4457-81c4-957566e7ec9e None admin] PATH_INFO: `/v3/groups/e97c029b53dc4f44bea073c0a5d1568d` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:43.531316 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5590c2-9764-4457-81c4-957566e7ec9e None admin] RBAC: Authorizing `identity:get_group(group_id=e97c029b53dc4f44bea073c0a5d1568d)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:43.534115 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5590c2-9764-4457-81c4-957566e7ec9e None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:43.537408 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 206/408] 10.222.0.36 () {56 vars in 1180 bytes} [Tue May 3 13:59:43 2022] GET /identity/v3/groups/e97c029b53dc4f44bea073c0a5d1568d => generated 226 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 13:59:43.545956 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5590c2-9764-4457-81c4-957566e7ec9e None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:43.669320 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5590c2-9764-4457-81c4-957566e7ec9e None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:43.672904 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2b103c-912b-490c-99bf-966ea194b312 None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:43.704829 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb2dee5-3f87-4174-a952-928936e4593b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:43.706100 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb2dee5-3f87-4174-a952-928936e4593b None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:43.706690 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb2dee5-3f87-4174-a952-928936e4593b None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:43.707260 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb2dee5-3f87-4174-a952-928936e4593b None admin] PATH_INFO: `/v3/projects/446967649a7d47af8f0eb54b376ac1fa` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:43.709090 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb2dee5-3f87-4174-a952-928936e4593b None admin] RBAC: Authorizing `identity:get_project(project_id=446967649a7d47af8f0eb54b376ac1fa)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:43.710072 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dc71b9-b283-437c-abca-67511677b06b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:43.710885 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dc71b9-b283-437c-abca-67511677b06b None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:43.711159 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dc71b9-b283-437c-abca-67511677b06b None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:43.711428 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dc71b9-b283-437c-abca-67511677b06b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:43.711730 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb2dee5-3f87-4174-a952-928936e4593b None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:43.714506 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 207/409] 10.222.0.36 () {56 vars in 1186 bytes} [Tue May 3 13:59:43 2022] GET /identity/v3/projects/446967649a7d47af8f0eb54b376ac1fa => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 13:59:43.721259 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb2dee5-3f87-4174-a952-928936e4593b None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:43.724522 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6dc71b9-b283-437c-abca-67511677b06b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 13:59:43.733354 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application [None req-d6dc71b9-b283-437c-abca-67511677b06b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 03 13:59:43.733354 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 13:59:43.733354 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 13:59:43.733354 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 13:59:43.733354 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 13:59:43.733354 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 13:59:43.733354 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 13:59:43.733354 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 13:59:43.733354 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 13:59:43.733354 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 13:59:43.733354 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 13:59:43.733354 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 13:59:43.733354 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 13:59:43.733354 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 13:59:43.733354 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 13:59:43.733354 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 13:59:43.734274 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 13:59:43.734274 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 13:59:43.734274 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 13:59:43.734274 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 13:59:43.734274 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 13:59:43.734274 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 13:59:43.734274 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 13:59:43.734274 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 13:59:43.734274 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 13:59:43.734274 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.get_or_create( May 03 13:59:43.734274 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 13:59:43.734274 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application with Lock( May 03 13:59:43.734274 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 13:59:43.734274 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._enter() May 03 13:59:43.734274 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 13:59:43.734274 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 13:59:43.735092 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 13:59:43.735092 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.creator() May 03 13:59:43.735092 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 13:59:43.735092 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application created_value = creator( May 03 13:59:43.735092 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 13:59:43.735092 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 13:59:43.735092 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 13:59:43.735092 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 13:59:43.735092 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 13:59:43.735092 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 13:59:43.735092 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 03 13:59:43.735092 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application May 03 13:59:43.735092 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 203/410] 10.222.0.36 () {56 vars in 1096 bytes} [Tue May 3 13:59:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 13:59:43.741567 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dc71b9-b283-437c-abca-67511677b06b None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:43.837441 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb2dee5-3f87-4174-a952-928936e4593b None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:43.876662 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7b36fe-785e-41c4-becf-30631c14a65a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:43.878334 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7b36fe-785e-41c4-becf-30631c14a65a None admin] REQUEST_METHOD: `PUT` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:43.878993 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7b36fe-785e-41c4-becf-30631c14a65a None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:43.879918 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7b36fe-785e-41c4-becf-30631c14a65a None admin] PATH_INFO: `/v3/projects/446967649a7d47af8f0eb54b376ac1fa/groups/e97c029b53dc4f44bea073c0a5d1568d/roles/bd29d35ea39b4ba293ffbf1ffbf4b940` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:43.884181 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7b36fe-785e-41c4-becf-30631c14a65a None admin] RBAC: Authorizing `identity:create_grant(project_id=446967649a7d47af8f0eb54b376ac1fa, group_id=e97c029b53dc4f44bea073c0a5d1568d, role_id=bd29d35ea39b4ba293ffbf1ffbf4b940)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:43.886993 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7b36fe-785e-41c4-becf-30631c14a65a None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:43.889930 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dc71b9-b283-437c-abca-67511677b06b None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:43.926395 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 208/411] 10.222.0.36 () {58 vars in 1442 bytes} [Tue May 3 13:59:43 2022] PUT /identity/v3/projects/446967649a7d47af8f0eb54b376ac1fa/groups/e97c029b53dc4f44bea073c0a5d1568d/roles/bd29d35ea39b4ba293ffbf1ffbf4b940 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 13:59:43.945343 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc45381-e01c-45f0-977c-c3d499e92797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:43.945343 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc45381-e01c-45f0-977c-c3d499e92797 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:43.945343 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc45381-e01c-45f0-977c-c3d499e92797 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:43.945343 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc45381-e01c-45f0-977c-c3d499e92797 None admin] PATH_INFO: `/v3/roles` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:43.945764 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc45381-e01c-45f0-977c-c3d499e92797 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80012) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 13:59:43.945764 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc45381-e01c-45f0-977c-c3d499e92797 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:43.947120 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc45381-e01c-45f0-977c-c3d499e92797 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:43.966873 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 204/412] 10.222.0.36 () {56 vars in 1099 bytes} [Tue May 3 13:59:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 13:59:43.974576 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7b36fe-785e-41c4-becf-30631c14a65a None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:44.117893 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7b36fe-785e-41c4-becf-30631c14a65a None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:44.154698 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ce1c7c-0517-4603-ade4-43d464fdcc6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:44.155879 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ce1c7c-0517-4603-ade4-43d464fdcc6d None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:44.156162 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ce1c7c-0517-4603-ade4-43d464fdcc6d None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:44.156436 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ce1c7c-0517-4603-ade4-43d464fdcc6d None admin] PATH_INFO: `/v3/groups/5022b31559214460913f588bc58da60f` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:44.157750 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ce1c7c-0517-4603-ade4-43d464fdcc6d None admin] RBAC: Authorizing `identity:get_group(group_id=5022b31559214460913f588bc58da60f)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:44.159235 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ce1c7c-0517-4603-ade4-43d464fdcc6d None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:44.161214 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 209/413] 10.222.0.36 () {56 vars in 1180 bytes} [Tue May 3 13:59:43 2022] GET /identity/v3/groups/5022b31559214460913f588bc58da60f => generated 229 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 13:59:44.167654 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc45381-e01c-45f0-977c-c3d499e92797 None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:44.356936 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc45381-e01c-45f0-977c-c3d499e92797 None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:44.427117 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4e5e5f-e8c4-4f33-8642-5bc887bc3787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:44.428005 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4e5e5f-e8c4-4f33-8642-5bc887bc3787 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:44.428286 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4e5e5f-e8c4-4f33-8642-5bc887bc3787 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:44.428555 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4e5e5f-e8c4-4f33-8642-5bc887bc3787 None admin] PATH_INFO: `/v3/projects/71795b2bf1064a2fb47b7b3b4817ce5c` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:44.437672 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4e5e5f-e8c4-4f33-8642-5bc887bc3787 None admin] RBAC: Authorizing `identity:get_project(project_id=71795b2bf1064a2fb47b7b3b4817ce5c)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:44.439158 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4e5e5f-e8c4-4f33-8642-5bc887bc3787 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:44.441731 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 205/414] 10.222.0.36 () {56 vars in 1186 bytes} [Tue May 3 13:59:44 2022] GET /identity/v3/projects/71795b2bf1064a2fb47b7b3b4817ce5c => generated 344 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 13:59:44.450426 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ce1c7c-0517-4603-ade4-43d464fdcc6d None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:44.584531 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ce1c7c-0517-4603-ade4-43d464fdcc6d None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:44.625088 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9338c10-067c-424b-8fb1-6b812893c3cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:44.625942 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9338c10-067c-424b-8fb1-6b812893c3cf None admin] REQUEST_METHOD: `PUT` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:44.626228 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9338c10-067c-424b-8fb1-6b812893c3cf None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:44.626505 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9338c10-067c-424b-8fb1-6b812893c3cf None admin] PATH_INFO: `/v3/projects/71795b2bf1064a2fb47b7b3b4817ce5c/groups/5022b31559214460913f588bc58da60f/roles/36abe9b50fd8479c86c4f8f70fd85aa3` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:44.628500 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9338c10-067c-424b-8fb1-6b812893c3cf None admin] RBAC: Authorizing `identity:create_grant(project_id=71795b2bf1064a2fb47b7b3b4817ce5c, group_id=5022b31559214460913f588bc58da60f, role_id=36abe9b50fd8479c86c4f8f70fd85aa3)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:44.629971 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9338c10-067c-424b-8fb1-6b812893c3cf None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:44.656653 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 210/415] 10.222.0.36 () {58 vars in 1442 bytes} [Tue May 3 13:59:44 2022] PUT /identity/v3/projects/71795b2bf1064a2fb47b7b3b4817ce5c/groups/5022b31559214460913f588bc58da60f/roles/36abe9b50fd8479c86c4f8f70fd85aa3 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 13:59:44.833959 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5720913f-8c5e-4bbc-a622-d436b68b058b None None] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:44.834333 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5720913f-8c5e-4bbc-a622-d436b68b058b None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:44.834509 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5720913f-8c5e-4bbc-a622-d436b68b058b None None] PATH_INFO: `/` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:44.836258 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 206/416] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 3 13:59:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 13:59:44.841836 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627a63e1-4d27-4358-914b-e9477f6a5b3d None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:44.842220 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627a63e1-4d27-4358-914b-e9477f6a5b3d None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:44.842507 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627a63e1-4d27-4358-914b-e9477f6a5b3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:44.865017 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-627a63e1-4d27-4358-914b-e9477f6a5b3d None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 13:59:44.866247 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-627a63e1-4d27-4358-914b-e9477f6a5b3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 13:59:44.942284 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363d87f8-e70e-41eb-a032-1809238aa978 None None] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:44.942916 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363d87f8-e70e-41eb-a032-1809238aa978 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:44.942916 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363d87f8-e70e-41eb-a032-1809238aa978 None None] PATH_INFO: `/` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:44.944354 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 207/417] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 3 13:59:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 13:59:44.953799 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370eb734-7786-42c0-8763-9293c53ded80 None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:44.954103 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370eb734-7786-42c0-8763-9293c53ded80 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:44.954367 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370eb734-7786-42c0-8763-9293c53ded80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:44.954679 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 211/418] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 3 13:59:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 13:59:44.978425 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627a63e1-4d27-4358-914b-e9477f6a5b3d None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:44.989612 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-370eb734-7786-42c0-8763-9293c53ded80 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 13:59:44.990825 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-370eb734-7786-42c0-8763-9293c53ded80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 13:59:45.097117 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627a63e1-4d27-4358-914b-e9477f6a5b3d None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:45.105522 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 208/419] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 3 13:59:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 03 13:59:45.129452 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370eb734-7786-42c0-8763-9293c53ded80 None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:45.152343 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf9d537-831f-4dac-a0f4-534b1a37cd70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:45.153510 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf9d537-831f-4dac-a0f4-534b1a37cd70 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:45.155097 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf9d537-831f-4dac-a0f4-534b1a37cd70 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:45.155722 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf9d537-831f-4dac-a0f4-534b1a37cd70 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:45.177177 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf9d537-831f-4dac-a0f4-534b1a37cd70 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 13:59:45.194229 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application [None req-ddf9d537-831f-4dac-a0f4-534b1a37cd70 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 03 13:59:45.194229 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 13:59:45.194229 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 13:59:45.194229 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 13:59:45.194229 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 13:59:45.194229 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 13:59:45.194229 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 13:59:45.194229 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 13:59:45.194229 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 13:59:45.194229 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 13:59:45.194229 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 13:59:45.194229 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 13:59:45.194229 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 13:59:45.194229 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 13:59:45.194229 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 13:59:45.194229 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 13:59:45.195217 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 13:59:45.195217 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 13:59:45.195217 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 13:59:45.195217 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 13:59:45.195217 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 13:59:45.195217 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 13:59:45.195217 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 13:59:45.195217 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 13:59:45.195217 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 13:59:45.195217 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.get_or_create( May 03 13:59:45.195217 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 13:59:45.195217 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application with Lock( May 03 13:59:45.195217 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 13:59:45.195217 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._enter() May 03 13:59:45.195217 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 13:59:45.195217 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 13:59:45.196061 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 13:59:45.196061 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.creator() May 03 13:59:45.196061 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 13:59:45.196061 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application created_value = creator( May 03 13:59:45.196061 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 13:59:45.196061 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 13:59:45.196061 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 13:59:45.196061 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 13:59:45.196061 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 13:59:45.196061 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 13:59:45.196061 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 03 13:59:45.196061 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application May 03 13:59:45.196061 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 212/420] 10.222.0.36 () {56 vars in 1099 bytes} [Tue May 3 13:59:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 13:59:45.206335 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf9d537-831f-4dac-a0f4-534b1a37cd70 None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:45.261748 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370eb734-7786-42c0-8763-9293c53ded80 None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:45.330197 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34705463-73b3-4be3-9d1b-5e53577366f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:45.331291 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34705463-73b3-4be3-9d1b-5e53577366f4 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:45.332354 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34705463-73b3-4be3-9d1b-5e53577366f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:45.333314 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34705463-73b3-4be3-9d1b-5e53577366f4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:45.355398 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34705463-73b3-4be3-9d1b-5e53577366f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 13:59:45.365825 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application [None req-34705463-73b3-4be3-9d1b-5e53577366f4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 03 13:59:45.365825 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 13:59:45.365825 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 13:59:45.365825 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 13:59:45.365825 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 13:59:45.365825 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 13:59:45.365825 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 13:59:45.365825 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 13:59:45.365825 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 13:59:45.365825 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 13:59:45.365825 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 13:59:45.365825 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 13:59:45.365825 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 13:59:45.365825 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 13:59:45.365825 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 13:59:45.365825 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 13:59:45.366803 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 13:59:45.366803 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 13:59:45.366803 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 13:59:45.366803 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 13:59:45.366803 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 13:59:45.366803 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 13:59:45.366803 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 13:59:45.366803 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 13:59:45.366803 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 13:59:45.366803 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.get_or_create( May 03 13:59:45.366803 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 13:59:45.366803 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application with Lock( May 03 13:59:45.366803 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 13:59:45.366803 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._enter() May 03 13:59:45.366803 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 13:59:45.366803 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 13:59:45.367628 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 13:59:45.367628 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.creator() May 03 13:59:45.367628 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 13:59:45.367628 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application created_value = creator( May 03 13:59:45.367628 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 13:59:45.367628 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 13:59:45.367628 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 13:59:45.367628 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 13:59:45.367628 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 13:59:45.367628 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 13:59:45.367628 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 03 13:59:45.367628 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application May 03 13:59:45.370438 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 209/421] 10.222.0.36 () {56 vars in 1114 bytes} [Tue May 3 13:59:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 13:59:45.376276 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34705463-73b3-4be3-9d1b-5e53577366f4 None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:45.408553 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf9d537-831f-4dac-a0f4-534b1a37cd70 None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:45.459871 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3595ef33-f782-4d48-b00d-61f0d9e942ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:45.460990 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3595ef33-f782-4d48-b00d-61f0d9e942ea None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:45.461480 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3595ef33-f782-4d48-b00d-61f0d9e942ea None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:45.461926 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3595ef33-f782-4d48-b00d-61f0d9e942ea None admin] PATH_INFO: `/v3/roles` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:45.462865 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3595ef33-f782-4d48-b00d-61f0d9e942ea None admin] RBAC: Adding query filter params (name=member) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 13:59:45.463393 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3595ef33-f782-4d48-b00d-61f0d9e942ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:45.465393 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3595ef33-f782-4d48-b00d-61f0d9e942ea None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:45.481919 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 213/422] 10.222.0.36 () {56 vars in 1101 bytes} [Tue May 3 13:59:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 13:59:45.491053 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3595ef33-f782-4d48-b00d-61f0d9e942ea None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:45.534445 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34705463-73b3-4be3-9d1b-5e53577366f4 None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:45.567406 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01de282c-04e1-4878-ae17-e288bdcabed7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:45.568451 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01de282c-04e1-4878-ae17-e288bdcabed7 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:45.568946 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01de282c-04e1-4878-ae17-e288bdcabed7 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:45.569496 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01de282c-04e1-4878-ae17-e288bdcabed7 None admin] PATH_INFO: `/v3/roles` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:45.570476 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01de282c-04e1-4878-ae17-e288bdcabed7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80012) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 13:59:45.570981 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01de282c-04e1-4878-ae17-e288bdcabed7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:45.572563 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01de282c-04e1-4878-ae17-e288bdcabed7 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:45.581277 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 210/423] 10.222.0.36 () {56 vars in 1111 bytes} [Tue May 3 13:59:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 13:59:45.587004 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01de282c-04e1-4878-ae17-e288bdcabed7 None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:45.687447 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01de282c-04e1-4878-ae17-e288bdcabed7 None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:45.723048 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3595ef33-f782-4d48-b00d-61f0d9e942ea None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:45.738470 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560908a4-7806-4e8d-acaa-8597806442f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:45.739468 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560908a4-7806-4e8d-acaa-8597806442f7 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:45.740003 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560908a4-7806-4e8d-acaa-8597806442f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:45.740568 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560908a4-7806-4e8d-acaa-8597806442f7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:45.766518 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2765596-374e-4991-9f0e-5130959d594a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:45.767182 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2765596-374e-4991-9f0e-5130959d594a None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:45.767462 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2765596-374e-4991-9f0e-5130959d594a None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:45.767737 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2765596-374e-4991-9f0e-5130959d594a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:45.848947 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560908a4-7806-4e8d-acaa-8597806442f7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:45.850435 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560908a4-7806-4e8d-acaa-8597806442f7 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:45.873722 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2765596-374e-4991-9f0e-5130959d594a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:45.875188 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2765596-374e-4991-9f0e-5130959d594a None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:45.974322 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 214/424] 10.222.0.36 () {58 vars in 1282 bytes} [Tue May 3 13:59:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 483 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 03 13:59:45.982821 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2765596-374e-4991-9f0e-5130959d594a None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:45.987384 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 211/425] 10.222.0.36 () {58 vars in 1282 bytes} [Tue May 3 13:59:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 03 13:59:45.994268 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560908a4-7806-4e8d-acaa-8597806442f7 None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:46.093478 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2765596-374e-4991-9f0e-5130959d594a None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:46.131381 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ca2273-691a-4b98-8fc1-7331d16a7158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:46.132257 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ca2273-691a-4b98-8fc1-7331d16a7158 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:46.132534 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ca2273-691a-4b98-8fc1-7331d16a7158 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:46.132809 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ca2273-691a-4b98-8fc1-7331d16a7158 None admin] PATH_INFO: `/v3/projects/3256bc7158894136b4937ecc0a8b3073` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:46.134973 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ca2273-691a-4b98-8fc1-7331d16a7158 None admin] RBAC: Authorizing `identity:get_project(project_id=3256bc7158894136b4937ecc0a8b3073)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:46.136427 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ca2273-691a-4b98-8fc1-7331d16a7158 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:46.138960 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 215/426] 10.222.0.36 () {56 vars in 1186 bytes} [Tue May 3 13:59:45 2022] GET /identity/v3/projects/3256bc7158894136b4937ecc0a8b3073 => generated 298 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 13:59:46.144433 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ca2273-691a-4b98-8fc1-7331d16a7158 None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:46.229075 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560908a4-7806-4e8d-acaa-8597806442f7 None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:46.246480 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ca2273-691a-4b98-8fc1-7331d16a7158 None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:46.280405 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501a4431-36b5-43d6-9872-b0aa933ba340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:46.281650 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501a4431-36b5-43d6-9872-b0aa933ba340 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:46.282120 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501a4431-36b5-43d6-9872-b0aa933ba340 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:46.282604 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501a4431-36b5-43d6-9872-b0aa933ba340 None admin] PATH_INFO: `/v3/groups/e97c029b53dc4f44bea073c0a5d1568d` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:46.283982 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501a4431-36b5-43d6-9872-b0aa933ba340 None admin] RBAC: Authorizing `identity:get_group(group_id=e97c029b53dc4f44bea073c0a5d1568d)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:46.285627 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501a4431-36b5-43d6-9872-b0aa933ba340 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:46.287729 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 216/427] 10.222.0.36 () {56 vars in 1180 bytes} [Tue May 3 13:59:46 2022] GET /identity/v3/groups/e97c029b53dc4f44bea073c0a5d1568d => generated 226 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 13:59:46.293510 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501a4431-36b5-43d6-9872-b0aa933ba340 None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:46.312131 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf91db4-ec08-4648-9ee3-0e6699e5fa79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:46.313016 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf91db4-ec08-4648-9ee3-0e6699e5fa79 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:46.313332 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf91db4-ec08-4648-9ee3-0e6699e5fa79 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:46.313600 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf91db4-ec08-4648-9ee3-0e6699e5fa79 None admin] PATH_INFO: `/v3/projects/3256bc7158894136b4937ecc0a8b3073` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:46.318036 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf91db4-ec08-4648-9ee3-0e6699e5fa79 None admin] RBAC: Authorizing `identity:get_project(project_id=3256bc7158894136b4937ecc0a8b3073)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:46.319508 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf91db4-ec08-4648-9ee3-0e6699e5fa79 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:46.321557 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 212/428] 10.222.0.36 () {56 vars in 1186 bytes} [Tue May 3 13:59:45 2022] GET /identity/v3/projects/3256bc7158894136b4937ecc0a8b3073 => generated 298 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 13:59:46.339419 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf91db4-ec08-4648-9ee3-0e6699e5fa79 None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:46.401482 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501a4431-36b5-43d6-9872-b0aa933ba340 None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:46.435873 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fb3a85-7e76-4697-ad84-1747393dbe03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:46.437126 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fb3a85-7e76-4697-ad84-1747393dbe03 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:46.437697 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fb3a85-7e76-4697-ad84-1747393dbe03 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:46.438156 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fb3a85-7e76-4697-ad84-1747393dbe03 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:46.439190 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fb3a85-7e76-4697-ad84-1747393dbe03 None admin] RBAC: Adding query filter params (group.id=e97c029b53dc4f44bea073c0a5d1568d, role.id=441fdc11e95b47f4813f72610e39018b, scope.project.id=3256bc7158894136b4937ecc0a8b3073) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 13:59:46.439776 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fb3a85-7e76-4697-ad84-1747393dbe03 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:46.441521 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fb3a85-7e76-4697-ad84-1747393dbe03 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:46.448813 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 217/429] 10.222.0.36 () {56 vars in 1376 bytes} [Tue May 3 13:59:46 2022] GET /identity/v3/role_assignments?group.id=e97c029b53dc4f44bea073c0a5d1568d&scope.project.id=3256bc7158894136b4937ecc0a8b3073&role.id=441fdc11e95b47f4813f72610e39018b => generated 611 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 13:59:46.558195 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf91db4-ec08-4648-9ee3-0e6699e5fa79 None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:46.612261 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4740eb7-899c-4a0e-9b64-fe55f81eebd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:46.613144 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4740eb7-899c-4a0e-9b64-fe55f81eebd3 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:46.613482 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4740eb7-899c-4a0e-9b64-fe55f81eebd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:46.613759 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4740eb7-899c-4a0e-9b64-fe55f81eebd3 None admin] PATH_INFO: `/v3/groups/e97c029b53dc4f44bea073c0a5d1568d` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:46.618079 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4740eb7-899c-4a0e-9b64-fe55f81eebd3 None admin] RBAC: Authorizing `identity:get_group(group_id=e97c029b53dc4f44bea073c0a5d1568d)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:46.619573 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4740eb7-899c-4a0e-9b64-fe55f81eebd3 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:46.621693 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 213/430] 10.222.0.36 () {56 vars in 1180 bytes} [Tue May 3 13:59:46 2022] GET /identity/v3/groups/e97c029b53dc4f44bea073c0a5d1568d => generated 226 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 13:59:46.627434 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fb3a85-7e76-4697-ad84-1747393dbe03 None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:46.735107 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21290ec5-7284-48b4-80a3-b0c2a03439d1 None None] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:46.735435 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21290ec5-7284-48b4-80a3-b0c2a03439d1 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:46.735667 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21290ec5-7284-48b4-80a3-b0c2a03439d1 None None] PATH_INFO: `/` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:46.737053 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 214/431] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 3 13:59:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 13:59:46.742452 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c684bf9-a5ea-4804-9d89-9d1a46c5a5ce None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:46.742730 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c684bf9-a5ea-4804-9d89-9d1a46c5a5ce None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:46.743010 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c684bf9-a5ea-4804-9d89-9d1a46c5a5ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:46.758848 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fb3a85-7e76-4697-ad84-1747393dbe03 None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:46.767282 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-2c684bf9-a5ea-4804-9d89-9d1a46c5a5ce None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 13:59:46.768359 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-2c684bf9-a5ea-4804-9d89-9d1a46c5a5ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 13:59:46.802094 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e38bd8-647a-41c6-b448-0fdd59219865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:46.802718 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e38bd8-647a-41c6-b448-0fdd59219865 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:46.803001 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e38bd8-647a-41c6-b448-0fdd59219865 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:46.803277 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e38bd8-647a-41c6-b448-0fdd59219865 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:46.804115 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e38bd8-647a-41c6-b448-0fdd59219865 None admin] RBAC: Adding query filter params (group.id=e97c029b53dc4f44bea073c0a5d1568d, role.id=bd29d35ea39b4ba293ffbf1ffbf4b940, scope.project.id=3256bc7158894136b4937ecc0a8b3073) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 13:59:46.804428 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e38bd8-647a-41c6-b448-0fdd59219865 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:46.805942 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e38bd8-647a-41c6-b448-0fdd59219865 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:46.812715 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 218/432] 10.222.0.36 () {56 vars in 1376 bytes} [Tue May 3 13:59:46 2022] GET /identity/v3/role_assignments?group.id=e97c029b53dc4f44bea073c0a5d1568d&scope.project.id=3256bc7158894136b4937ecc0a8b3073&role.id=bd29d35ea39b4ba293ffbf1ffbf4b940 => generated 611 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 13:59:46.814012 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddbc756-b0de-4be5-b87d-3f4a1b891e48 None None] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:46.814295 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddbc756-b0de-4be5-b87d-3f4a1b891e48 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:46.814570 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddbc756-b0de-4be5-b87d-3f4a1b891e48 None None] PATH_INFO: `/` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:46.817064 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 219/433] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 3 13:59:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 13:59:46.822743 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ec88f7-212e-425c-99ad-ab48adf79a6a None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:46.823054 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ec88f7-212e-425c-99ad-ab48adf79a6a None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:46.823341 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ec88f7-212e-425c-99ad-ab48adf79a6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:46.850650 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-33ec88f7-212e-425c-99ad-ab48adf79a6a None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 13:59:46.851885 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-33ec88f7-212e-425c-99ad-ab48adf79a6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 13:59:46.852686 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 215/434] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 3 13:59:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 13:59:46.877267 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c684bf9-a5ea-4804-9d89-9d1a46c5a5ce None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:46.930242 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 220/435] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 3 13:59:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 13:59:46.955882 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ec88f7-212e-425c-99ad-ab48adf79a6a None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:47.019976 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c684bf9-a5ea-4804-9d89-9d1a46c5a5ce None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:47.074299 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9550f6ee-3903-4d6d-84ab-10aea1d1d157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:47.075700 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9550f6ee-3903-4d6d-84ab-10aea1d1d157 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:47.076243 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9550f6ee-3903-4d6d-84ab-10aea1d1d157 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:47.077077 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9550f6ee-3903-4d6d-84ab-10aea1d1d157 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:47.079629 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ec88f7-212e-425c-99ad-ab48adf79a6a None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:47.101096 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9550f6ee-3903-4d6d-84ab-10aea1d1d157 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 13:59:47.112870 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application [None req-9550f6ee-3903-4d6d-84ab-10aea1d1d157 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 03 13:59:47.112870 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 13:59:47.112870 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 13:59:47.112870 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 13:59:47.112870 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 13:59:47.112870 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 13:59:47.112870 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 13:59:47.112870 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 13:59:47.112870 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 13:59:47.112870 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 13:59:47.112870 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 13:59:47.112870 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 13:59:47.112870 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 13:59:47.112870 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 13:59:47.112870 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 13:59:47.112870 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 13:59:47.113879 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 13:59:47.113879 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 13:59:47.113879 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 13:59:47.113879 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 13:59:47.113879 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 13:59:47.113879 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 13:59:47.113879 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 13:59:47.113879 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 13:59:47.113879 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 13:59:47.113879 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.get_or_create( May 03 13:59:47.113879 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 13:59:47.113879 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application with Lock( May 03 13:59:47.113879 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 13:59:47.113879 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._enter() May 03 13:59:47.113879 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 13:59:47.113879 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 13:59:47.114713 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 13:59:47.114713 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.creator() May 03 13:59:47.114713 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 13:59:47.114713 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application created_value = creator( May 03 13:59:47.114713 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 13:59:47.114713 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 13:59:47.114713 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 13:59:47.114713 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 13:59:47.114713 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 13:59:47.114713 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 13:59:47.114713 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 03 13:59:47.114713 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application May 03 13:59:47.117561 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 216/436] 10.222.0.36 () {56 vars in 1114 bytes} [Tue May 3 13:59:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 13:59:47.123655 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9550f6ee-3903-4d6d-84ab-10aea1d1d157 None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:47.128461 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ebdd93-4b8d-4fc6-b840-1730aeafc8b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:47.129567 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ebdd93-4b8d-4fc6-b840-1730aeafc8b8 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:47.130051 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ebdd93-4b8d-4fc6-b840-1730aeafc8b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:47.130522 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ebdd93-4b8d-4fc6-b840-1730aeafc8b8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:47.144602 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ebdd93-4b8d-4fc6-b840-1730aeafc8b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 13:59:47.152387 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application [None req-46ebdd93-4b8d-4fc6-b840-1730aeafc8b8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 03 13:59:47.152387 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 13:59:47.152387 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 13:59:47.152387 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 13:59:47.152387 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 13:59:47.152387 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 13:59:47.152387 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 13:59:47.152387 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 13:59:47.152387 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 13:59:47.152387 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 13:59:47.152387 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 13:59:47.152387 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 13:59:47.152387 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 13:59:47.152387 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 13:59:47.152387 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 13:59:47.152387 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 13:59:47.153347 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 13:59:47.153347 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 13:59:47.153347 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 13:59:47.153347 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 13:59:47.153347 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 13:59:47.153347 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 13:59:47.153347 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 13:59:47.153347 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 13:59:47.153347 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 13:59:47.153347 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.get_or_create( May 03 13:59:47.153347 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 13:59:47.153347 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application with Lock( May 03 13:59:47.153347 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 13:59:47.153347 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._enter() May 03 13:59:47.153347 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 13:59:47.153347 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 13:59:47.154820 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 13:59:47.154820 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.creator() May 03 13:59:47.154820 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 13:59:47.154820 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application created_value = creator( May 03 13:59:47.154820 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 13:59:47.154820 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 13:59:47.154820 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 13:59:47.154820 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 13:59:47.154820 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 13:59:47.154820 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 13:59:47.154820 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 03 13:59:47.154820 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application May 03 13:59:47.154820 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 221/437] 10.222.0.36 () {56 vars in 1099 bytes} [Tue May 3 13:59:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 13:59:47.159878 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ebdd93-4b8d-4fc6-b840-1730aeafc8b8 None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:47.259113 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9550f6ee-3903-4d6d-84ab-10aea1d1d157 None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:47.284158 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ebdd93-4b8d-4fc6-b840-1730aeafc8b8 None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:47.307043 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815d39a5-09a7-4df1-b305-36546a18e987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:47.307900 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815d39a5-09a7-4df1-b305-36546a18e987 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:47.308086 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815d39a5-09a7-4df1-b305-36546a18e987 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:47.308357 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815d39a5-09a7-4df1-b305-36546a18e987 None admin] PATH_INFO: `/v3/roles` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:47.309113 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815d39a5-09a7-4df1-b305-36546a18e987 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80012) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 13:59:47.309451 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815d39a5-09a7-4df1-b305-36546a18e987 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:47.310889 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815d39a5-09a7-4df1-b305-36546a18e987 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:47.321238 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 217/438] 10.222.0.36 () {56 vars in 1111 bytes} [Tue May 3 13:59:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 13:59:47.326494 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815d39a5-09a7-4df1-b305-36546a18e987 None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:47.331389 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1211c19-6478-4169-84c0-b63033cee95e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:47.332072 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1211c19-6478-4169-84c0-b63033cee95e None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:47.332354 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1211c19-6478-4169-84c0-b63033cee95e None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:47.332630 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1211c19-6478-4169-84c0-b63033cee95e None admin] PATH_INFO: `/v3/roles` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:47.333439 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1211c19-6478-4169-84c0-b63033cee95e None admin] RBAC: Adding query filter params (name=member) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 13:59:47.333776 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1211c19-6478-4169-84c0-b63033cee95e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:47.335146 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1211c19-6478-4169-84c0-b63033cee95e None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:47.344509 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 222/439] 10.222.0.36 () {56 vars in 1101 bytes} [Tue May 3 13:59:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 13:59:47.353356 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1211c19-6478-4169-84c0-b63033cee95e None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:47.433320 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815d39a5-09a7-4df1-b305-36546a18e987 None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:47.462574 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1211c19-6478-4169-84c0-b63033cee95e None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:47.466160 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e94bb4-7c59-478c-a1ac-a2953f7ffd65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:47.466935 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e94bb4-7c59-478c-a1ac-a2953f7ffd65 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:47.467326 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e94bb4-7c59-478c-a1ac-a2953f7ffd65 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:47.467683 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e94bb4-7c59-478c-a1ac-a2953f7ffd65 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:47.494387 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d2cb9d-4be3-4e79-9086-0a98655393c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:47.495023 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d2cb9d-4be3-4e79-9086-0a98655393c2 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:47.495299 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d2cb9d-4be3-4e79-9086-0a98655393c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:47.495570 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d2cb9d-4be3-4e79-9086-0a98655393c2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:47.530299 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e94bb4-7c59-478c-a1ac-a2953f7ffd65 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:47.531753 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e94bb4-7c59-478c-a1ac-a2953f7ffd65 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:47.558919 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d2cb9d-4be3-4e79-9086-0a98655393c2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:47.560351 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d2cb9d-4be3-4e79-9086-0a98655393c2 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:47.625728 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 218/440] 10.222.0.36 () {58 vars in 1282 bytes} [Tue May 3 13:59:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 03 13:59:47.626959 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d08a992-74fe-4ed0-8faf-1f735471bccc None None] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:47.627223 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d08a992-74fe-4ed0-8faf-1f735471bccc None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:47.627504 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d08a992-74fe-4ed0-8faf-1f735471bccc None None] PATH_INFO: `/` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:47.628770 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 219/441] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 3 13:59:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 13:59:47.633547 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d08a992-74fe-4ed0-8faf-1f735471bccc None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:47.652904 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 223/442] 10.222.0.36 () {58 vars in 1282 bytes} [Tue May 3 13:59:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 03 13:59:47.654221 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502995bd-08b3-4988-855b-1276c840884c None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:47.654510 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502995bd-08b3-4988-855b-1276c840884c None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:47.654785 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502995bd-08b3-4988-855b-1276c840884c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:47.671877 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-502995bd-08b3-4988-855b-1276c840884c None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 13:59:47.673054 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-502995bd-08b3-4988-855b-1276c840884c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 13:59:47.727823 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d08a992-74fe-4ed0-8faf-1f735471bccc None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:47.738971 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 224/443] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 3 13:59:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 13:59:47.739851 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502995bd-08b3-4988-855b-1276c840884c None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:47.759632 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc4dc7e-6157-4353-b0f0-e303f797739d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:47.760492 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc4dc7e-6157-4353-b0f0-e303f797739d None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:47.760775 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc4dc7e-6157-4353-b0f0-e303f797739d None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:47.761172 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc4dc7e-6157-4353-b0f0-e303f797739d None admin] PATH_INFO: `/v3/projects/446967649a7d47af8f0eb54b376ac1fa` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:47.762260 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc4dc7e-6157-4353-b0f0-e303f797739d None admin] RBAC: Authorizing `identity:get_project(project_id=446967649a7d47af8f0eb54b376ac1fa)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:47.763765 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc4dc7e-6157-4353-b0f0-e303f797739d None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:47.769958 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 220/444] 10.222.0.36 () {56 vars in 1186 bytes} [Tue May 3 13:59:47 2022] GET /identity/v3/projects/446967649a7d47af8f0eb54b376ac1fa => generated 302 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 13:59:47.769958 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc4dc7e-6157-4353-b0f0-e303f797739d None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:47.832237 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502995bd-08b3-4988-855b-1276c840884c None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:47.859252 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc4dc7e-6157-4353-b0f0-e303f797739d None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:47.866700 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73620006-ee09-4e71-a507-4fa1ba2f16d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:47.867556 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73620006-ee09-4e71-a507-4fa1ba2f16d9 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:47.867831 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73620006-ee09-4e71-a507-4fa1ba2f16d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:47.868105 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73620006-ee09-4e71-a507-4fa1ba2f16d9 None admin] PATH_INFO: `/v3/projects/446967649a7d47af8f0eb54b376ac1fa` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:47.869319 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73620006-ee09-4e71-a507-4fa1ba2f16d9 None admin] RBAC: Authorizing `identity:get_project(project_id=446967649a7d47af8f0eb54b376ac1fa)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:47.870738 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73620006-ee09-4e71-a507-4fa1ba2f16d9 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:47.872419 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 225/445] 10.222.0.36 () {56 vars in 1186 bytes} [Tue May 3 13:59:47 2022] GET /identity/v3/projects/446967649a7d47af8f0eb54b376ac1fa => generated 302 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 13:59:47.873202 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73620006-ee09-4e71-a507-4fa1ba2f16d9 None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:47.892665 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b66cb7-520c-4a99-8dfe-0a753c33ecfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:47.893425 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b66cb7-520c-4a99-8dfe-0a753c33ecfa None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:47.893703 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b66cb7-520c-4a99-8dfe-0a753c33ecfa None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:47.893973 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b66cb7-520c-4a99-8dfe-0a753c33ecfa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:47.904280 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b66cb7-520c-4a99-8dfe-0a753c33ecfa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 13:59:47.911995 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application [None req-96b66cb7-520c-4a99-8dfe-0a753c33ecfa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 03 13:59:47.911995 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 13:59:47.911995 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 13:59:47.911995 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 13:59:47.911995 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 13:59:47.911995 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 13:59:47.911995 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 13:59:47.911995 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 13:59:47.911995 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 13:59:47.911995 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 13:59:47.911995 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 13:59:47.911995 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 13:59:47.911995 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 13:59:47.911995 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 13:59:47.911995 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 13:59:47.911995 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 13:59:47.912893 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 13:59:47.912893 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 13:59:47.912893 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 13:59:47.912893 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 13:59:47.912893 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 13:59:47.912893 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 13:59:47.912893 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 13:59:47.912893 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 13:59:47.912893 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 13:59:47.912893 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.get_or_create( May 03 13:59:47.912893 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 13:59:47.912893 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application with Lock( May 03 13:59:47.912893 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 13:59:47.912893 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._enter() May 03 13:59:47.912893 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 13:59:47.912893 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 13:59:47.913767 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 13:59:47.913767 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.creator() May 03 13:59:47.913767 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 13:59:47.913767 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application created_value = creator( May 03 13:59:47.913767 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 13:59:47.913767 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 13:59:47.913767 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 13:59:47.913767 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 13:59:47.913767 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 13:59:47.913767 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 13:59:47.913767 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 03 13:59:47.913767 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application May 03 13:59:47.913767 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 221/446] 10.222.0.36 () {56 vars in 1096 bytes} [Tue May 3 13:59:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 13:59:47.914467 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b66cb7-520c-4a99-8dfe-0a753c33ecfa None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:47.970052 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73620006-ee09-4e71-a507-4fa1ba2f16d9 None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:48.001510 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca1093c-0b6f-45ee-bfec-de756465d9a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:48.002351 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca1093c-0b6f-45ee-bfec-de756465d9a2 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:48.002626 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca1093c-0b6f-45ee-bfec-de756465d9a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:48.002892 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca1093c-0b6f-45ee-bfec-de756465d9a2 None admin] PATH_INFO: `/v3/groups/e97c029b53dc4f44bea073c0a5d1568d` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:48.004081 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca1093c-0b6f-45ee-bfec-de756465d9a2 None admin] RBAC: Authorizing `identity:get_group(group_id=e97c029b53dc4f44bea073c0a5d1568d)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:48.005540 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca1093c-0b6f-45ee-bfec-de756465d9a2 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:48.007158 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 226/447] 10.222.0.36 () {56 vars in 1180 bytes} [Tue May 3 13:59:47 2022] GET /identity/v3/groups/e97c029b53dc4f44bea073c0a5d1568d => generated 226 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 13:59:48.007895 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca1093c-0b6f-45ee-bfec-de756465d9a2 None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:48.012085 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b66cb7-520c-4a99-8dfe-0a753c33ecfa None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:48.045303 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66039d04-458a-4e2f-b56c-a200db39866a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:48.046370 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66039d04-458a-4e2f-b56c-a200db39866a None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:48.046646 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66039d04-458a-4e2f-b56c-a200db39866a None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:48.046919 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66039d04-458a-4e2f-b56c-a200db39866a None admin] PATH_INFO: `/v3/groups/e97c029b53dc4f44bea073c0a5d1568d` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:48.048124 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66039d04-458a-4e2f-b56c-a200db39866a None admin] RBAC: Authorizing `identity:get_group(group_id=e97c029b53dc4f44bea073c0a5d1568d)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:48.049606 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66039d04-458a-4e2f-b56c-a200db39866a None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:48.051227 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 222/448] 10.222.0.36 () {56 vars in 1180 bytes} [Tue May 3 13:59:47 2022] GET /identity/v3/groups/e97c029b53dc4f44bea073c0a5d1568d => generated 226 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 13:59:48.051951 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66039d04-458a-4e2f-b56c-a200db39866a None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:48.103612 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca1093c-0b6f-45ee-bfec-de756465d9a2 None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:48.135702 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d4c8c5-a8d7-4e7b-89d6-e7fc75835d17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:48.136353 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d4c8c5-a8d7-4e7b-89d6-e7fc75835d17 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:48.136627 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d4c8c5-a8d7-4e7b-89d6-e7fc75835d17 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:48.136893 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d4c8c5-a8d7-4e7b-89d6-e7fc75835d17 None admin] PATH_INFO: `/v3/roles` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:48.137662 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d4c8c5-a8d7-4e7b-89d6-e7fc75835d17 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 13:59:48.137956 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d4c8c5-a8d7-4e7b-89d6-e7fc75835d17 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:48.139369 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d4c8c5-a8d7-4e7b-89d6-e7fc75835d17 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:48.147000 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 227/449] 10.222.0.36 () {56 vars in 1099 bytes} [Tue May 3 13:59:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 13:59:48.147711 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d4c8c5-a8d7-4e7b-89d6-e7fc75835d17 None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:48.149536 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66039d04-458a-4e2f-b56c-a200db39866a None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:48.182143 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f184c8c-cdea-4017-9b88-b7654d618007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:48.182826 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f184c8c-cdea-4017-9b88-b7654d618007 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:48.183104 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f184c8c-cdea-4017-9b88-b7654d618007 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:48.183376 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f184c8c-cdea-4017-9b88-b7654d618007 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:48.184181 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f184c8c-cdea-4017-9b88-b7654d618007 None admin] RBAC: Adding query filter params (group.id=e97c029b53dc4f44bea073c0a5d1568d, role.id=bd29d35ea39b4ba293ffbf1ffbf4b940, scope.project.id=446967649a7d47af8f0eb54b376ac1fa) {{(pid=80012) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 13:59:48.184484 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f184c8c-cdea-4017-9b88-b7654d618007 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:48.186034 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f184c8c-cdea-4017-9b88-b7654d618007 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:48.191726 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 223/450] 10.222.0.36 () {56 vars in 1376 bytes} [Tue May 3 13:59:48 2022] GET /identity/v3/role_assignments?group.id=e97c029b53dc4f44bea073c0a5d1568d&scope.project.id=446967649a7d47af8f0eb54b376ac1fa&role.id=bd29d35ea39b4ba293ffbf1ffbf4b940 => generated 611 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 13:59:48.192526 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f184c8c-cdea-4017-9b88-b7654d618007 None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:48.253363 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d4c8c5-a8d7-4e7b-89d6-e7fc75835d17 None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:48.288005 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e91324-172b-4bdc-b65f-6a080455fcde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:48.288683 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e91324-172b-4bdc-b65f-6a080455fcde None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:48.288936 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e91324-172b-4bdc-b65f-6a080455fcde None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:48.289236 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e91324-172b-4bdc-b65f-6a080455fcde None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:48.290074 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e91324-172b-4bdc-b65f-6a080455fcde None admin] RBAC: Adding query filter params (group.id=e97c029b53dc4f44bea073c0a5d1568d, role.id=441fdc11e95b47f4813f72610e39018b, scope.project.id=446967649a7d47af8f0eb54b376ac1fa) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 13:59:48.290381 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e91324-172b-4bdc-b65f-6a080455fcde None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:48.291891 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e91324-172b-4bdc-b65f-6a080455fcde None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:48.309324 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 228/451] 10.222.0.36 () {56 vars in 1376 bytes} [Tue May 3 13:59:48 2022] GET /identity/v3/role_assignments?group.id=e97c029b53dc4f44bea073c0a5d1568d&scope.project.id=446967649a7d47af8f0eb54b376ac1fa&role.id=441fdc11e95b47f4813f72610e39018b => generated 611 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 13:59:48.309574 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f184c8c-cdea-4017-9b88-b7654d618007 None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:48.344617 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961e1ae2-d288-4abf-b415-535fb2a526d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:48.345322 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961e1ae2-d288-4abf-b415-535fb2a526d5 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:48.345595 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961e1ae2-d288-4abf-b415-535fb2a526d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:48.345866 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961e1ae2-d288-4abf-b415-535fb2a526d5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:48.429222 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961e1ae2-d288-4abf-b415-535fb2a526d5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:48.431225 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961e1ae2-d288-4abf-b415-535fb2a526d5 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:48.534234 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 224/452] 10.222.0.36 () {58 vars in 1282 bytes} [Tue May 3 13:59:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 03 13:59:48.539980 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e91324-172b-4bdc-b65f-6a080455fcde None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:48.640318 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e91324-172b-4bdc-b65f-6a080455fcde None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:48.672770 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258d8e79-6d81-46b4-ad55-f2eaa1c24d78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:48.673637 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258d8e79-6d81-46b4-ad55-f2eaa1c24d78 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:48.673914 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258d8e79-6d81-46b4-ad55-f2eaa1c24d78 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:48.674183 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258d8e79-6d81-46b4-ad55-f2eaa1c24d78 None admin] PATH_INFO: `/v3/projects/71795b2bf1064a2fb47b7b3b4817ce5c` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:48.675343 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258d8e79-6d81-46b4-ad55-f2eaa1c24d78 None admin] RBAC: Authorizing `identity:get_project(project_id=71795b2bf1064a2fb47b7b3b4817ce5c)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:48.676792 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258d8e79-6d81-46b4-ad55-f2eaa1c24d78 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:48.678532 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 229/453] 10.222.0.36 () {56 vars in 1186 bytes} [Tue May 3 13:59:48 2022] GET /identity/v3/projects/71795b2bf1064a2fb47b7b3b4817ce5c => generated 344 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 13:59:48.684246 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961e1ae2-d288-4abf-b415-535fb2a526d5 None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:48.780674 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961e1ae2-d288-4abf-b415-535fb2a526d5 None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:48.812427 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cd8d14-ff67-4fa8-bc5a-6eeb48358b20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:48.813331 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cd8d14-ff67-4fa8-bc5a-6eeb48358b20 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:48.813626 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cd8d14-ff67-4fa8-bc5a-6eeb48358b20 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:48.813897 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cd8d14-ff67-4fa8-bc5a-6eeb48358b20 None admin] PATH_INFO: `/v3/groups/5022b31559214460913f588bc58da60f` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:48.815077 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cd8d14-ff67-4fa8-bc5a-6eeb48358b20 None admin] RBAC: Authorizing `identity:get_group(group_id=5022b31559214460913f588bc58da60f)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:48.816525 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cd8d14-ff67-4fa8-bc5a-6eeb48358b20 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:48.818198 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 225/454] 10.222.0.36 () {56 vars in 1180 bytes} [Tue May 3 13:59:48 2022] GET /identity/v3/groups/5022b31559214460913f588bc58da60f => generated 229 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 13:59:48.824161 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258d8e79-6d81-46b4-ad55-f2eaa1c24d78 None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:48.934848 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258d8e79-6d81-46b4-ad55-f2eaa1c24d78 None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:48.968885 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acc11f4-2805-46cc-923d-42121b80debb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:48.969556 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acc11f4-2805-46cc-923d-42121b80debb None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:48.969836 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acc11f4-2805-46cc-923d-42121b80debb None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:48.970113 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acc11f4-2805-46cc-923d-42121b80debb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:48.970948 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acc11f4-2805-46cc-923d-42121b80debb None admin] RBAC: Adding query filter params (group.id=5022b31559214460913f588bc58da60f, role.id=36abe9b50fd8479c86c4f8f70fd85aa3, scope.project.id=71795b2bf1064a2fb47b7b3b4817ce5c) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 13:59:48.971262 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acc11f4-2805-46cc-923d-42121b80debb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:48.972701 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acc11f4-2805-46cc-923d-42121b80debb None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:48.978602 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 230/455] 10.222.0.36 () {56 vars in 1376 bytes} [Tue May 3 13:59:48 2022] GET /identity/v3/role_assignments?group.id=5022b31559214460913f588bc58da60f&scope.project.id=71795b2bf1064a2fb47b7b3b4817ce5c&role.id=36abe9b50fd8479c86c4f8f70fd85aa3 => generated 611 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 13:59:51.610510 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88859859-54d2-479a-9267-01504c435e90 None None] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:51.611554 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88859859-54d2-479a-9267-01504c435e90 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:51.612076 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88859859-54d2-479a-9267-01504c435e90 None None] PATH_INFO: `/` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:51.613847 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 226/456] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 3 13:59:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 13:59:51.639793 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93540a06-83b7-4b7e-9759-3519067bc992 None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:51.640920 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93540a06-83b7-4b7e-9759-3519067bc992 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:51.641452 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93540a06-83b7-4b7e-9759-3519067bc992 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:51.666792 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-93540a06-83b7-4b7e-9759-3519067bc992 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 13:59:51.668336 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-93540a06-83b7-4b7e-9759-3519067bc992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 13:59:51.759180 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 231/457] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 3 13:59:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 13:59:51.794158 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88859859-54d2-479a-9267-01504c435e90 None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:51.836727 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be942d46-6584-4a82-b78b-ab3c964cfa58 None None] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:51.837396 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be942d46-6584-4a82-b78b-ab3c964cfa58 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:51.837895 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be942d46-6584-4a82-b78b-ab3c964cfa58 None None] PATH_INFO: `/` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:51.839745 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 232/458] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 3 13:59:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 13:59:51.845356 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4174733f-fd0c-400c-b0ac-1f008de37a22 None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:51.845946 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4174733f-fd0c-400c-b0ac-1f008de37a22 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:51.846412 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4174733f-fd0c-400c-b0ac-1f008de37a22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:51.871779 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-4174733f-fd0c-400c-b0ac-1f008de37a22 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 13:59:51.875993 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-4174733f-fd0c-400c-b0ac-1f008de37a22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 13:59:51.955472 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88859859-54d2-479a-9267-01504c435e90 None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:52.026753 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7c4afb-099a-4f22-bc5c-c389a6d3bc39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:52.027934 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7c4afb-099a-4f22-bc5c-c389a6d3bc39 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:52.028432 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7c4afb-099a-4f22-bc5c-c389a6d3bc39 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:52.028890 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7c4afb-099a-4f22-bc5c-c389a6d3bc39 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:52.044657 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 233/459] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 3 13:59:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 03 13:59:52.046098 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7c4afb-099a-4f22-bc5c-c389a6d3bc39 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:52.047755 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7c4afb-099a-4f22-bc5c-c389a6d3bc39 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:52.072573 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application [None req-ce7c4afb-099a-4f22-bc5c-c389a6d3bc39 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 13:59:52.072573 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 13:59:52.072573 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 13:59:52.072573 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 13:59:52.072573 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 13:59:52.072573 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 13:59:52.072573 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 13:59:52.072573 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 13:59:52.072573 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 13:59:52.072573 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 13:59:52.072573 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 13:59:52.072573 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 13:59:52.072573 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 13:59:52.072573 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 13:59:52.072573 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 13:59:52.073479 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 13:59:52.073479 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 13:59:52.073479 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 13:59:52.073479 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 13:59:52.073479 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 13:59:52.073479 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 13:59:52.073479 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.get_or_create( May 03 13:59:52.073479 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 13:59:52.073479 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application with Lock( May 03 13:59:52.073479 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 13:59:52.073479 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._enter() May 03 13:59:52.073479 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 13:59:52.073479 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 13:59:52.073479 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 13:59:52.073479 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.creator() May 03 13:59:52.073479 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 13:59:52.073479 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application created_value = creator( May 03 13:59:52.074356 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 13:59:52.074356 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 13:59:52.074356 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 13:59:52.074356 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application May 03 13:59:52.074356 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 227/460] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 3 13:59:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 13:59:52.080065 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4174733f-fd0c-400c-b0ac-1f008de37a22 None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:52.084172 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7c4afb-099a-4f22-bc5c-c389a6d3bc39 None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:52.235565 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7c4afb-099a-4f22-bc5c-c389a6d3bc39 None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:52.235976 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4174733f-fd0c-400c-b0ac-1f008de37a22 None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:52.268877 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d495be6e-622a-4e73-811d-4fd45f87b81f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:52.269961 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d495be6e-622a-4e73-811d-4fd45f87b81f None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:52.270450 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d495be6e-622a-4e73-811d-4fd45f87b81f None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:52.270912 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d495be6e-622a-4e73-811d-4fd45f87b81f None admin] PATH_INFO: `/v3/domains` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:52.272022 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d495be6e-622a-4e73-811d-4fd45f87b81f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 13:59:52.272584 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d495be6e-622a-4e73-811d-4fd45f87b81f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:52.274137 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d65a9fa-b524-48d5-8b06-98af54aa0b65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:52.274511 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d495be6e-622a-4e73-811d-4fd45f87b81f None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:52.274927 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d65a9fa-b524-48d5-8b06-98af54aa0b65 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:52.275203 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d65a9fa-b524-48d5-8b06-98af54aa0b65 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:52.275473 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d65a9fa-b524-48d5-8b06-98af54aa0b65 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:52.287418 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d65a9fa-b524-48d5-8b06-98af54aa0b65 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:52.287773 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 234/461] 10.222.0.36 () {56 vars in 1109 bytes} [Tue May 3 13:59:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 13:59:52.289266 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad6ae0a-f9ee-4793-96ed-91600725b523 None None] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:52.289511 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d65a9fa-b524-48d5-8b06-98af54aa0b65 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:52.289890 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad6ae0a-f9ee-4793-96ed-91600725b523 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:52.290553 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad6ae0a-f9ee-4793-96ed-91600725b523 None None] PATH_INFO: `/` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:52.296455 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 235/462] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 3 13:59:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 13:59:52.297509 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad6ae0a-f9ee-4793-96ed-91600725b523 None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:52.309328 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application [None req-8d65a9fa-b524-48d5-8b06-98af54aa0b65 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 13:59:52.309328 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 13:59:52.309328 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 13:59:52.309328 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 13:59:52.309328 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 13:59:52.309328 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 13:59:52.309328 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 13:59:52.309328 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 13:59:52.309328 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 13:59:52.309328 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 13:59:52.309328 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 13:59:52.309328 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 13:59:52.309328 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 13:59:52.309328 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 13:59:52.309328 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 13:59:52.310240 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 13:59:52.310240 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 13:59:52.310240 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 13:59:52.310240 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 13:59:52.310240 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 13:59:52.310240 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 13:59:52.310240 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.get_or_create( May 03 13:59:52.310240 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 13:59:52.310240 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application with Lock( May 03 13:59:52.310240 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 13:59:52.310240 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._enter() May 03 13:59:52.310240 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 13:59:52.310240 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 13:59:52.310240 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 13:59:52.310240 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.creator() May 03 13:59:52.310240 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 13:59:52.310240 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application created_value = creator( May 03 13:59:52.311213 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 13:59:52.311213 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 13:59:52.311213 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 13:59:52.311213 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application May 03 13:59:52.311213 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 228/463] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 3 13:59:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 13:59:52.312097 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8914794-2485-4e17-931d-921b310b8065 None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:52.312899 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8914794-2485-4e17-931d-921b310b8065 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:52.313332 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8914794-2485-4e17-931d-921b310b8065 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:52.331110 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-a8914794-2485-4e17-931d-921b310b8065 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 13:59:52.332284 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-a8914794-2485-4e17-931d-921b310b8065 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 13:59:52.405322 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 229/464] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 3 13:59:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 13:59:52.405322 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8914794-2485-4e17-931d-921b310b8065 None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:52.411666 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad6ae0a-f9ee-4793-96ed-91600725b523 None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:52.457602 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ecae14-69d4-440b-956d-a3fa15a59e03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:52.458775 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ecae14-69d4-440b-956d-a3fa15a59e03 None admin] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:52.459230 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ecae14-69d4-440b-956d-a3fa15a59e03 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:52.459674 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ecae14-69d4-440b-956d-a3fa15a59e03 None admin] PATH_INFO: `/v3/users` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:52.460546 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ecae14-69d4-440b-956d-a3fa15a59e03 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:52.462191 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ecae14-69d4-440b-956d-a3fa15a59e03 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:52.485425 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 236/465] 10.222.0.36 () {60 vars in 1132 bytes} [Tue May 3 13:59:52 2022] POST /identity/v3/users => generated 246 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 13:59:52.487042 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48401bcf-86f9-4234-8509-ef511e2913ab None None] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:52.487264 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48401bcf-86f9-4234-8509-ef511e2913ab None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:52.487545 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48401bcf-86f9-4234-8509-ef511e2913ab None None] PATH_INFO: `/` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:52.488786 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 237/466] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 3 13:59:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 13:59:52.489510 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48401bcf-86f9-4234-8509-ef511e2913ab None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:52.513830 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8914794-2485-4e17-931d-921b310b8065 None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:52.550923 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11802759-9ad6-4bd1-bf98-7efb7845b993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:52.551921 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11802759-9ad6-4bd1-bf98-7efb7845b993 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:52.552374 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11802759-9ad6-4bd1-bf98-7efb7845b993 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:52.552789 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11802759-9ad6-4bd1-bf98-7efb7845b993 None admin] PATH_INFO: `/v3/domains` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:52.553760 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11802759-9ad6-4bd1-bf98-7efb7845b993 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80012) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 13:59:52.554286 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11802759-9ad6-4bd1-bf98-7efb7845b993 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:52.555869 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11802759-9ad6-4bd1-bf98-7efb7845b993 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:52.573700 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 230/467] 10.222.0.36 () {56 vars in 1109 bytes} [Tue May 3 13:59:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 13:59:52.575390 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825dfb09-6b7e-46d7-b122-a1a150c0a3d7 None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:52.575845 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825dfb09-6b7e-46d7-b122-a1a150c0a3d7 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:52.576293 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825dfb09-6b7e-46d7-b122-a1a150c0a3d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:52.594390 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-825dfb09-6b7e-46d7-b122-a1a150c0a3d7 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 13:59:52.595857 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-825dfb09-6b7e-46d7-b122-a1a150c0a3d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 13:59:52.618416 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48401bcf-86f9-4234-8509-ef511e2913ab None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:52.656026 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85c561d-b443-4d30-aba7-0c56708fb94a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:52.656912 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85c561d-b443-4d30-aba7-0c56708fb94a None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:52.657193 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85c561d-b443-4d30-aba7-0c56708fb94a None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:52.657574 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85c561d-b443-4d30-aba7-0c56708fb94a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:52.669311 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85c561d-b443-4d30-aba7-0c56708fb94a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:52.670925 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85c561d-b443-4d30-aba7-0c56708fb94a None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:52.681730 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 231/468] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 3 13:59:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 13:59:52.683377 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825dfb09-6b7e-46d7-b122-a1a150c0a3d7 None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:52.689513 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application [None req-e85c561d-b443-4d30-aba7-0c56708fb94a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 13:59:52.689513 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 13:59:52.689513 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 13:59:52.689513 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 13:59:52.689513 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 13:59:52.689513 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 13:59:52.689513 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 13:59:52.689513 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 13:59:52.689513 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 13:59:52.689513 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 13:59:52.689513 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 13:59:52.689513 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 13:59:52.689513 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 13:59:52.689513 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 13:59:52.689513 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 13:59:52.690609 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 13:59:52.690609 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 13:59:52.690609 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 13:59:52.690609 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 13:59:52.690609 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 13:59:52.690609 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 13:59:52.690609 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.get_or_create( May 03 13:59:52.690609 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 13:59:52.690609 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application with Lock( May 03 13:59:52.690609 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 13:59:52.690609 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._enter() May 03 13:59:52.690609 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 13:59:52.690609 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 13:59:52.690609 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 13:59:52.690609 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.creator() May 03 13:59:52.690609 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 13:59:52.690609 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application created_value = creator( May 03 13:59:52.691542 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 13:59:52.691542 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 13:59:52.691542 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 13:59:52.691542 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application May 03 13:59:52.691542 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 238/469] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 3 13:59:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 13:59:52.696906 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85c561d-b443-4d30-aba7-0c56708fb94a None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:52.800396 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825dfb09-6b7e-46d7-b122-a1a150c0a3d7 None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:52.815531 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85c561d-b443-4d30-aba7-0c56708fb94a None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:52.836037 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3842ba8e-1b64-41c6-a6fe-13687d4ad16c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:52.837063 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3842ba8e-1b64-41c6-a6fe-13687d4ad16c None admin] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:52.837518 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3842ba8e-1b64-41c6-a6fe-13687d4ad16c None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:52.837938 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3842ba8e-1b64-41c6-a6fe-13687d4ad16c None admin] PATH_INFO: `/v3/users` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:52.838755 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3842ba8e-1b64-41c6-a6fe-13687d4ad16c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:52.840617 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3842ba8e-1b64-41c6-a6fe-13687d4ad16c None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:52.857060 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7f479c-489c-410c-9f78-a4f81b86dd4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:52.858253 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7f479c-489c-410c-9f78-a4f81b86dd4b None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:52.858589 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7f479c-489c-410c-9f78-a4f81b86dd4b None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:52.858950 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7f479c-489c-410c-9f78-a4f81b86dd4b None admin] PATH_INFO: `/v3/domains` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:52.859785 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7f479c-489c-410c-9f78-a4f81b86dd4b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 13:59:52.860199 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7f479c-489c-410c-9f78-a4f81b86dd4b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:52.861698 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7f479c-489c-410c-9f78-a4f81b86dd4b None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:52.862956 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 232/470] 10.222.0.36 () {60 vars in 1132 bytes} [Tue May 3 13:59:52 2022] POST /identity/v3/users => generated 248 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 13:59:52.864173 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3842ba8e-1b64-41c6-a6fe-13687d4ad16c None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:52.887016 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 239/471] 10.222.0.36 () {56 vars in 1109 bytes} [Tue May 3 13:59:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 13:59:52.892569 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7f479c-489c-410c-9f78-a4f81b86dd4b None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:52.986262 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3842ba8e-1b64-41c6-a6fe-13687d4ad16c None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:53.024194 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b94653b-84e1-4a2f-949b-5dbaa5620705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:53.025272 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b94653b-84e1-4a2f-949b-5dbaa5620705 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:53.026122 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b94653b-84e1-4a2f-949b-5dbaa5620705 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:53.026536 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b94653b-84e1-4a2f-949b-5dbaa5620705 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:53.039720 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b94653b-84e1-4a2f-949b-5dbaa5620705 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:53.048301 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b94653b-84e1-4a2f-949b-5dbaa5620705 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:53.076497 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application [None req-3b94653b-84e1-4a2f-949b-5dbaa5620705 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 13:59:53.076497 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 13:59:53.076497 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 13:59:53.076497 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 13:59:53.076497 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 13:59:53.076497 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 13:59:53.076497 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 13:59:53.076497 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 13:59:53.076497 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 13:59:53.076497 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 13:59:53.076497 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 13:59:53.076497 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 13:59:53.076497 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 13:59:53.076497 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 13:59:53.076497 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 13:59:53.077632 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 13:59:53.077632 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 13:59:53.077632 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 13:59:53.077632 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 13:59:53.077632 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 13:59:53.077632 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 13:59:53.077632 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.get_or_create( May 03 13:59:53.077632 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 13:59:53.077632 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application with Lock( May 03 13:59:53.077632 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 13:59:53.077632 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._enter() May 03 13:59:53.077632 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 13:59:53.077632 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 13:59:53.077632 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 13:59:53.077632 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.creator() May 03 13:59:53.077632 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 13:59:53.077632 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application created_value = creator( May 03 13:59:53.078499 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 13:59:53.078499 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 13:59:53.078499 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 13:59:53.078499 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application May 03 13:59:53.080636 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 233/472] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 3 13:59:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 13:59:53.087406 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b94653b-84e1-4a2f-949b-5dbaa5620705 None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:53.114262 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7f479c-489c-410c-9f78-a4f81b86dd4b None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:53.148530 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb3b3f2-e96f-42d9-85ef-dc3837fbccea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:53.149233 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb3b3f2-e96f-42d9-85ef-dc3837fbccea None admin] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:53.149851 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb3b3f2-e96f-42d9-85ef-dc3837fbccea None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:53.149851 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb3b3f2-e96f-42d9-85ef-dc3837fbccea None admin] PATH_INFO: `/v3/users` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:53.150575 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb3b3f2-e96f-42d9-85ef-dc3837fbccea None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:53.152008 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb3b3f2-e96f-42d9-85ef-dc3837fbccea None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:53.174241 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 240/473] 10.222.0.36 () {60 vars in 1132 bytes} [Tue May 3 13:59:52 2022] POST /identity/v3/users => generated 248 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 13:59:53.175720 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60522ff-52c0-47f3-b6cc-2483c1767046 None None] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:53.176058 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60522ff-52c0-47f3-b6cc-2483c1767046 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:53.176333 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60522ff-52c0-47f3-b6cc-2483c1767046 None None] PATH_INFO: `/` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:53.181946 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 241/474] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 3 13:59:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 13:59:53.183795 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3614a0d-fb68-40ad-bba1-6a31a6b9423f None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:53.184139 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3614a0d-fb68-40ad-bba1-6a31a6b9423f None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:53.184420 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3614a0d-fb68-40ad-bba1-6a31a6b9423f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:53.203928 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-d3614a0d-fb68-40ad-bba1-6a31a6b9423f None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 13:59:53.205772 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-d3614a0d-fb68-40ad-bba1-6a31a6b9423f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 13:59:53.213552 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b94653b-84e1-4a2f-949b-5dbaa5620705 None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:53.257306 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62226052-6b43-4ac1-aac8-4916a8c04aef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:53.258430 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62226052-6b43-4ac1-aac8-4916a8c04aef None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:53.258947 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62226052-6b43-4ac1-aac8-4916a8c04aef None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:53.259424 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62226052-6b43-4ac1-aac8-4916a8c04aef None admin] PATH_INFO: `/v3/domains` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:53.260428 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62226052-6b43-4ac1-aac8-4916a8c04aef None admin] RBAC: Adding query filter params (name=Default) {{(pid=80012) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 13:59:53.260958 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62226052-6b43-4ac1-aac8-4916a8c04aef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:53.263276 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62226052-6b43-4ac1-aac8-4916a8c04aef None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:53.281567 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 234/475] 10.222.0.36 () {56 vars in 1109 bytes} [Tue May 3 13:59:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 13:59:53.288943 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62226052-6b43-4ac1-aac8-4916a8c04aef None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:53.301804 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 242/476] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 3 13:59:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 03 13:59:53.320606 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3614a0d-fb68-40ad-bba1-6a31a6b9423f None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:53.414081 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62226052-6b43-4ac1-aac8-4916a8c04aef None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:53.446476 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3614a0d-fb68-40ad-bba1-6a31a6b9423f None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:53.450012 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841020c3-a03c-434f-a770-7b59e8414829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:53.450181 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841020c3-a03c-434f-a770-7b59e8414829 None admin] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:53.450407 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841020c3-a03c-434f-a770-7b59e8414829 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:53.450658 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841020c3-a03c-434f-a770-7b59e8414829 None admin] PATH_INFO: `/v3/users` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:53.451405 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841020c3-a03c-434f-a770-7b59e8414829 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:53.452838 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841020c3-a03c-434f-a770-7b59e8414829 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:53.476537 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 235/477] 10.222.0.36 () {60 vars in 1132 bytes} [Tue May 3 13:59:53 2022] POST /identity/v3/users => generated 249 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 13:59:53.491181 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c9e990-d293-49df-bd6b-70562aa52cea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:53.492235 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c9e990-d293-49df-bd6b-70562aa52cea None admin] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:53.492714 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c9e990-d293-49df-bd6b-70562aa52cea None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:53.493201 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c9e990-d293-49df-bd6b-70562aa52cea None admin] PATH_INFO: `/v3/roles` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:53.494039 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c9e990-d293-49df-bd6b-70562aa52cea None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:53.495501 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c9e990-d293-49df-bd6b-70562aa52cea None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:53.504075 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.sql.core [None req-72c9e990-d293-49df-bd6b-70562aa52cea None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 03 13:59:53.504075 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 03 13:59:53.504075 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [parameters: {'id': 'f5eea41919be4653968a6cc82fb19be6', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 03 13:59:53.504075 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80013) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 03 13:59:53.521825 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application [None req-72c9e990-d293-49df-bd6b-70562aa52cea None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 03 13:59:53.521825 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 13:59:53.521825 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 03 13:59:53.521825 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application self.dialect.do_execute( May 03 13:59:53.521825 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 03 13:59:53.521825 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 03 13:59:53.521825 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 03 13:59:53.521825 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application result = self._query(query) May 03 13:59:53.521825 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 03 13:59:53.521825 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application conn.query(q) May 03 13:59:53.521825 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 03 13:59:53.521825 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 03 13:59:53.521825 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 03 13:59:53.521825 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application result.read() May 03 13:59:53.521825 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 03 13:59:53.522780 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 03 13:59:53.522780 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 03 13:59:53.522780 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application packet.raise_for_error() May 03 13:59:53.522780 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 03 13:59:53.522780 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 03 13:59:53.522780 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 03 13:59:53.522780 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 03 13:59:53.522780 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 03 13:59:53.522780 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application May 03 13:59:53.522780 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 03 13:59:53.522780 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application May 03 13:59:53.522780 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 13:59:53.522780 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 03 13:59:53.522780 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 03 13:59:53.522780 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role May 03 13:59:53.522780 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return ref.to_dict() May 03 13:59:53.522780 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 03 13:59:53.522780 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application next(self.gen) May 03 13:59:53.523724 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 03 13:59:53.523724 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application yield resource May 03 13:59:53.523724 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 03 13:59:53.523724 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application next(self.gen) May 03 13:59:53.523724 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 03 13:59:53.523724 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application self.session.rollback() May 03 13:59:53.523724 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 03 13:59:53.523724 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application self.force_reraise() May 03 13:59:53.523724 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 03 13:59:53.523724 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application raise self.value May 03 13:59:53.523724 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 03 13:59:53.523724 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 03 13:59:53.523724 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 03 13:59:53.523724 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application session.commit() May 03 13:59:53.523724 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 03 13:59:53.523724 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 03 13:59:53.523724 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 03 13:59:53.524630 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application self._prepare_impl() May 03 13:59:53.524630 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 03 13:59:53.524630 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application self.session.flush() May 03 13:59:53.524630 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 03 13:59:53.524630 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application self._flush(objects) May 03 13:59:53.524630 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 03 13:59:53.524630 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 03 13:59:53.524630 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 03 13:59:53.524630 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application compat.raise_( May 03 13:59:53.524630 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 03 13:59:53.524630 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application raise exception May 03 13:59:53.524630 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 03 13:59:53.524630 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application flush_context.execute() May 03 13:59:53.524630 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 03 13:59:53.524630 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application rec.execute(self) May 03 13:59:53.524630 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 03 13:59:53.524630 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 03 13:59:53.525609 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 03 13:59:53.525609 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application _emit_insert_statements( May 03 13:59:53.525609 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 03 13:59:53.525609 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application c = connection._execute_20( May 03 13:59:53.525609 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 03 13:59:53.525609 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 03 13:59:53.525609 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 03 13:59:53.525609 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 03 13:59:53.525609 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 03 13:59:53.525609 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application ret = self._execute_context( May 03 13:59:53.525609 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 03 13:59:53.525609 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 03 13:59:53.525609 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 03 13:59:53.525609 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 03 13:59:53.525609 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 03 13:59:53.525609 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application raise exception May 03 13:59:53.526636 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 03 13:59:53.526636 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application self.dialect.do_execute( May 03 13:59:53.526636 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 03 13:59:53.526636 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 03 13:59:53.526636 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 03 13:59:53.526636 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application result = self._query(query) May 03 13:59:53.526636 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 03 13:59:53.526636 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application conn.query(q) May 03 13:59:53.526636 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 03 13:59:53.526636 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 03 13:59:53.526636 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 03 13:59:53.526636 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application result.read() May 03 13:59:53.526636 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 03 13:59:53.526636 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 03 13:59:53.526636 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 03 13:59:53.526636 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application packet.raise_for_error() May 03 13:59:53.527427 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 03 13:59:53.527427 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 03 13:59:53.527427 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 03 13:59:53.527427 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 03 13:59:53.527427 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 03 13:59:53.527427 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 03 13:59:53.527427 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application [parameters: {'id': 'f5eea41919be4653968a6cc82fb19be6', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 03 13:59:53.527427 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 03 13:59:53.527427 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application May 03 13:59:53.527427 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 03 13:59:53.527427 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application May 03 13:59:53.527427 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 13:59:53.527427 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 13:59:53.527427 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 13:59:53.527427 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 13:59:53.527427 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 13:59:53.528223 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 13:59:53.528223 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 13:59:53.528223 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 13:59:53.528223 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 13:59:53.528223 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 13:59:53.528223 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 13:59:53.528223 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post May 03 13:59:53.528223 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( May 03 13:59:53.528223 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 13:59:53.528223 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 13:59:53.528223 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role May 03 13:59:53.528223 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) May 03 13:59:53.528223 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 03 13:59:53.528223 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 03 13:59:53.528223 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 03 13:59:53.528223 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application May 03 13:59:53.529122 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 243/478] 10.222.0.36 () {60 vars in 1131 bytes} [Tue May 3 13:59:53 2022] POST /identity/v3/roles => generated 144 bytes in 204 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 03 13:59:53.530331 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841020c3-a03c-434f-a770-7b59e8414829 None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:53.648677 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841020c3-a03c-434f-a770-7b59e8414829 None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:53.688310 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f8347d-d5d7-4ee9-927e-0a20d84363a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:53.689890 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f8347d-d5d7-4ee9-927e-0a20d84363a5 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:53.690313 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f8347d-d5d7-4ee9-927e-0a20d84363a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:53.690742 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f8347d-d5d7-4ee9-927e-0a20d84363a5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:53.703318 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f8347d-d5d7-4ee9-927e-0a20d84363a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 13:59:53.711406 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application [None req-d0f8347d-d5d7-4ee9-927e-0a20d84363a5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 03 13:59:53.711406 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 13:59:53.711406 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 13:59:53.711406 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 13:59:53.711406 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 13:59:53.711406 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 13:59:53.711406 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 13:59:53.711406 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 13:59:53.711406 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 13:59:53.711406 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 13:59:53.711406 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 13:59:53.711406 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 13:59:53.711406 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 13:59:53.711406 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 13:59:53.711406 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 13:59:53.711406 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 13:59:53.712325 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 13:59:53.712325 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 13:59:53.712325 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 13:59:53.712325 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 13:59:53.712325 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 13:59:53.712325 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 13:59:53.712325 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 13:59:53.712325 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 13:59:53.712325 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 13:59:53.712325 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.get_or_create( May 03 13:59:53.712325 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 13:59:53.712325 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application with Lock( May 03 13:59:53.712325 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 13:59:53.712325 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._enter() May 03 13:59:53.712325 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 13:59:53.712325 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 13:59:53.713155 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 13:59:53.713155 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.creator() May 03 13:59:53.713155 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 13:59:53.713155 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application created_value = creator( May 03 13:59:53.713155 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 13:59:53.713155 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 13:59:53.713155 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 13:59:53.713155 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 13:59:53.713155 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 13:59:53.713155 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 13:59:53.713155 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 03 13:59:53.713155 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application May 03 13:59:53.713155 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 236/479] 10.222.0.36 () {56 vars in 1114 bytes} [Tue May 3 13:59:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 13:59:53.718790 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c9e990-d293-49df-bd6b-70562aa52cea None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:53.823055 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c9e990-d293-49df-bd6b-70562aa52cea None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:53.861154 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad733a2-40ac-43be-9d76-1d69e3e76af2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:53.862105 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad733a2-40ac-43be-9d76-1d69e3e76af2 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:53.862524 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad733a2-40ac-43be-9d76-1d69e3e76af2 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:53.862933 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad733a2-40ac-43be-9d76-1d69e3e76af2 None admin] PATH_INFO: `/v3/roles` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:53.863852 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad733a2-40ac-43be-9d76-1d69e3e76af2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 13:59:53.864306 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad733a2-40ac-43be-9d76-1d69e3e76af2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:53.865859 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad733a2-40ac-43be-9d76-1d69e3e76af2 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:53.875280 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 244/480] 10.222.0.36 () {56 vars in 1111 bytes} [Tue May 3 13:59:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 13:59:55.146004 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2be86c-70bd-44e5-9643-ad286704b497 None None] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:55.146552 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2be86c-70bd-44e5-9643-ad286704b497 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:55.146552 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2be86c-70bd-44e5-9643-ad286704b497 None None] PATH_INFO: `/` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:55.148168 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 237/481] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 3 13:59:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 13:59:55.153336 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4ada0b-af67-44cf-ad14-c543755bbca5 None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:55.153733 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4ada0b-af67-44cf-ad14-c543755bbca5 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:55.153912 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4ada0b-af67-44cf-ad14-c543755bbca5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:55.172558 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-6e4ada0b-af67-44cf-ad14-c543755bbca5 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 13:59:55.173774 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-6e4ada0b-af67-44cf-ad14-c543755bbca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 13:59:55.241870 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 245/482] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 3 13:59:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 13:59:55.264824 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2be86c-70bd-44e5-9643-ad286704b497 None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:55.364584 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2be86c-70bd-44e5-9643-ad286704b497 None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:55.397209 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb20e09d-1ae6-4a82-982c-91c355fd67ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:55.398044 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb20e09d-1ae6-4a82-982c-91c355fd67ba None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:55.398322 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb20e09d-1ae6-4a82-982c-91c355fd67ba None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:55.398591 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb20e09d-1ae6-4a82-982c-91c355fd67ba None admin] PATH_INFO: `/v3/roles/service` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:55.408804 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb20e09d-1ae6-4a82-982c-91c355fd67ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 13:59:55.416607 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application [None req-bb20e09d-1ae6-4a82-982c-91c355fd67ba None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 03 13:59:55.416607 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 13:59:55.416607 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 13:59:55.416607 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 13:59:55.416607 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 13:59:55.416607 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 13:59:55.416607 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 13:59:55.416607 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 13:59:55.416607 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 13:59:55.416607 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 13:59:55.416607 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 13:59:55.416607 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 13:59:55.416607 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 13:59:55.416607 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 13:59:55.416607 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 13:59:55.416607 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 13:59:55.418655 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 13:59:55.418655 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 13:59:55.418655 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 13:59:55.418655 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 13:59:55.418655 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 13:59:55.418655 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 13:59:55.418655 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 13:59:55.418655 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 13:59:55.418655 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 13:59:55.418655 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.get_or_create( May 03 13:59:55.418655 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 13:59:55.418655 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application with Lock( May 03 13:59:55.418655 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 13:59:55.418655 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._enter() May 03 13:59:55.418655 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 13:59:55.418655 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 13:59:55.420655 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 13:59:55.420655 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.creator() May 03 13:59:55.420655 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 13:59:55.420655 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application created_value = creator( May 03 13:59:55.420655 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 13:59:55.420655 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 13:59:55.420655 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 13:59:55.420655 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 13:59:55.420655 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 13:59:55.420655 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 13:59:55.420655 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 03 13:59:55.420655 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application May 03 13:59:55.420655 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 238/483] 10.222.0.36 () {56 vars in 1102 bytes} [Tue May 3 13:59:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 13:59:55.429314 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4ada0b-af67-44cf-ad14-c543755bbca5 None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:55.571783 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4ada0b-af67-44cf-ad14-c543755bbca5 None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:55.618919 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20546255-2838-4cf7-b849-09bdeaa99987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:55.619511 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20546255-2838-4cf7-b849-09bdeaa99987 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:55.619792 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20546255-2838-4cf7-b849-09bdeaa99987 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:55.620065 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20546255-2838-4cf7-b849-09bdeaa99987 None admin] PATH_INFO: `/v3/roles` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:55.620817 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20546255-2838-4cf7-b849-09bdeaa99987 None admin] RBAC: Adding query filter params (name=service) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 13:59:55.621122 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20546255-2838-4cf7-b849-09bdeaa99987 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:55.622529 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20546255-2838-4cf7-b849-09bdeaa99987 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:55.635224 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 246/484] 10.222.0.36 () {56 vars in 1103 bytes} [Tue May 3 13:59:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 13:59:55.641542 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb20e09d-1ae6-4a82-982c-91c355fd67ba None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:55.677548 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7310967-20f2-4d4d-a4ac-1ec32182ce1f None None] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:55.677876 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7310967-20f2-4d4d-a4ac-1ec32182ce1f None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:55.678115 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7310967-20f2-4d4d-a4ac-1ec32182ce1f None None] PATH_INFO: `/` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:55.679612 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 247/485] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 3 13:59:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 13:59:55.685504 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153cdb11-757a-44f4-a8e7-72b3a8be18e6 None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:55.685786 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153cdb11-757a-44f4-a8e7-72b3a8be18e6 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:55.686089 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153cdb11-757a-44f4-a8e7-72b3a8be18e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:55.718965 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-153cdb11-757a-44f4-a8e7-72b3a8be18e6 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 13:59:55.720134 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-153cdb11-757a-44f4-a8e7-72b3a8be18e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 13:59:55.801705 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb20e09d-1ae6-4a82-982c-91c355fd67ba None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:55.832123 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 248/486] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 3 13:59:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 13:59:55.854867 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3abca1a-0fbf-492f-9ac7-35c9d31e50fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:55.855914 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3abca1a-0fbf-492f-9ac7-35c9d31e50fd None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:55.856360 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3abca1a-0fbf-492f-9ac7-35c9d31e50fd None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:55.856777 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3abca1a-0fbf-492f-9ac7-35c9d31e50fd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:55.875837 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3abca1a-0fbf-492f-9ac7-35c9d31e50fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:55.877580 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3abca1a-0fbf-492f-9ac7-35c9d31e50fd None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:55.902338 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application [None req-e3abca1a-0fbf-492f-9ac7-35c9d31e50fd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 13:59:55.902338 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 13:59:55.902338 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 13:59:55.902338 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 13:59:55.902338 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 13:59:55.902338 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 13:59:55.902338 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 13:59:55.902338 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 13:59:55.902338 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 13:59:55.902338 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 13:59:55.902338 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 13:59:55.902338 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 13:59:55.902338 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 13:59:55.902338 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 13:59:55.902338 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 13:59:55.903507 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 13:59:55.903507 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 13:59:55.903507 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 13:59:55.903507 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 13:59:55.903507 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 13:59:55.903507 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 13:59:55.903507 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.get_or_create( May 03 13:59:55.903507 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 13:59:55.903507 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application with Lock( May 03 13:59:55.903507 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 13:59:55.903507 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._enter() May 03 13:59:55.903507 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 13:59:55.903507 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 13:59:55.903507 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 13:59:55.903507 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.creator() May 03 13:59:55.903507 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 13:59:55.903507 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application created_value = creator( May 03 13:59:55.904686 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 13:59:55.904686 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 13:59:55.904686 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 13:59:55.904686 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application May 03 13:59:55.911431 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 239/487] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 3 13:59:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 13:59:55.911998 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153cdb11-757a-44f4-a8e7-72b3a8be18e6 None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:55.912595 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3abca1a-0fbf-492f-9ac7-35c9d31e50fd None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:56.022838 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3abca1a-0fbf-492f-9ac7-35c9d31e50fd None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:56.054407 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153cdb11-757a-44f4-a8e7-72b3a8be18e6 None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:56.059510 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd51235-ee92-42b4-91d4-99bfa82f505e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:56.062230 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd51235-ee92-42b4-91d4-99bfa82f505e None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:56.062733 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd51235-ee92-42b4-91d4-99bfa82f505e None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:56.063203 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd51235-ee92-42b4-91d4-99bfa82f505e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:56.081780 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd51235-ee92-42b4-91d4-99bfa82f505e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 13:59:56.089866 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application [None req-2bd51235-ee92-42b4-91d4-99bfa82f505e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 03 13:59:56.089866 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 13:59:56.089866 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 13:59:56.089866 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 13:59:56.089866 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 13:59:56.089866 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 13:59:56.089866 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 13:59:56.089866 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 13:59:56.089866 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 13:59:56.089866 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 13:59:56.089866 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 13:59:56.089866 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 13:59:56.089866 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 13:59:56.089866 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 13:59:56.089866 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 13:59:56.089866 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 13:59:56.090767 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 13:59:56.090767 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 13:59:56.090767 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 13:59:56.090767 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 13:59:56.090767 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 13:59:56.090767 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 13:59:56.090767 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 13:59:56.090767 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 13:59:56.090767 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 13:59:56.090767 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.get_or_create( May 03 13:59:56.090767 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 13:59:56.090767 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application with Lock( May 03 13:59:56.090767 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 13:59:56.090767 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._enter() May 03 13:59:56.090767 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 13:59:56.090767 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 13:59:56.091621 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 13:59:56.091621 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.creator() May 03 13:59:56.091621 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 13:59:56.091621 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application created_value = creator( May 03 13:59:56.091621 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 13:59:56.091621 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 13:59:56.091621 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 13:59:56.091621 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 13:59:56.091621 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 13:59:56.091621 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 13:59:56.091621 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 03 13:59:56.091621 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application May 03 13:59:56.091621 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 240/488] 10.222.0.36 () {56 vars in 1102 bytes} [Tue May 3 13:59:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 13:59:56.097337 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd51235-ee92-42b4-91d4-99bfa82f505e None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:56.104811 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a42727-8919-490e-a55b-3d2b68db9b94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:56.105661 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a42727-8919-490e-a55b-3d2b68db9b94 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:56.105940 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a42727-8919-490e-a55b-3d2b68db9b94 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:56.106209 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a42727-8919-490e-a55b-3d2b68db9b94 None admin] PATH_INFO: `/v3/domains` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:56.106933 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a42727-8919-490e-a55b-3d2b68db9b94 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 13:59:56.107333 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a42727-8919-490e-a55b-3d2b68db9b94 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:56.108707 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a42727-8919-490e-a55b-3d2b68db9b94 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:56.120577 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 249/489] 10.222.0.36 () {56 vars in 1109 bytes} [Tue May 3 13:59:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 13:59:56.121869 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91d78bb-c148-4e54-8f04-68a4a0d7276d None None] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:56.122246 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91d78bb-c148-4e54-8f04-68a4a0d7276d None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:56.122522 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91d78bb-c148-4e54-8f04-68a4a0d7276d None None] PATH_INFO: `/` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:56.124054 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 250/490] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 3 13:59:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 13:59:56.126381 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91d78bb-c148-4e54-8f04-68a4a0d7276d None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:56.207272 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd51235-ee92-42b4-91d4-99bfa82f505e None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:56.226293 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91d78bb-c148-4e54-8f04-68a4a0d7276d None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:56.241477 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc185f2-6ac7-4b08-a27c-ad8f83f10e80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:56.242367 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc185f2-6ac7-4b08-a27c-ad8f83f10e80 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:56.242783 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc185f2-6ac7-4b08-a27c-ad8f83f10e80 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:56.243193 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc185f2-6ac7-4b08-a27c-ad8f83f10e80 None admin] PATH_INFO: `/v3/roles` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:56.244058 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc185f2-6ac7-4b08-a27c-ad8f83f10e80 None admin] RBAC: Adding query filter params (name=service) {{(pid=80012) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 13:59:56.244522 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc185f2-6ac7-4b08-a27c-ad8f83f10e80 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:56.246049 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc185f2-6ac7-4b08-a27c-ad8f83f10e80 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:56.254636 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 241/491] 10.222.0.36 () {56 vars in 1103 bytes} [Tue May 3 13:59:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 13:59:56.256116 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c1ea83-9298-45de-a9f1-134c2b271094 None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:56.256579 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c1ea83-9298-45de-a9f1-134c2b271094 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:56.257038 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c1ea83-9298-45de-a9f1-134c2b271094 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:56.260430 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479da945-e9bd-48d9-94a2-2406b7c6cb12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:56.261331 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479da945-e9bd-48d9-94a2-2406b7c6cb12 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:56.261673 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479da945-e9bd-48d9-94a2-2406b7c6cb12 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:56.262008 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479da945-e9bd-48d9-94a2-2406b7c6cb12 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:56.270666 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479da945-e9bd-48d9-94a2-2406b7c6cb12 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:56.272194 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479da945-e9bd-48d9-94a2-2406b7c6cb12 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:56.275414 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-d4c1ea83-9298-45de-a9f1-134c2b271094 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 13:59:56.276907 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-d4c1ea83-9298-45de-a9f1-134c2b271094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 13:59:56.289644 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application [None req-479da945-e9bd-48d9-94a2-2406b7c6cb12 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 03 13:59:56.289644 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 13:59:56.289644 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 13:59:56.289644 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 13:59:56.289644 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 13:59:56.289644 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 13:59:56.289644 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 13:59:56.289644 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 13:59:56.289644 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 13:59:56.289644 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 13:59:56.289644 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 13:59:56.289644 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 13:59:56.289644 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 13:59:56.289644 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 13:59:56.289644 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 13:59:56.289644 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 13:59:56.290635 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 13:59:56.290635 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 13:59:56.290635 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 13:59:56.290635 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 13:59:56.290635 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 13:59:56.290635 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 13:59:56.290635 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 13:59:56.290635 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 13:59:56.290635 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 13:59:56.290635 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.get_or_create( May 03 13:59:56.290635 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 13:59:56.290635 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application with Lock( May 03 13:59:56.290635 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 13:59:56.290635 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._enter() May 03 13:59:56.290635 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 13:59:56.290635 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 13:59:56.290635 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 13:59:56.290635 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.creator() May 03 13:59:56.291532 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 13:59:56.291532 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application created_value = creator( May 03 13:59:56.291532 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 13:59:56.291532 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 13:59:56.291532 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 13:59:56.291532 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 13:59:56.291532 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 13:59:56.291532 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 13:59:56.291532 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 03 13:59:56.291532 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application May 03 13:59:56.291532 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 251/492] 10.222.0.36 () {56 vars in 1093 bytes} [Tue May 3 13:59:56 2022] GET /identity/v3/users/nova => generated 82 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 13:59:56.292104 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479da945-e9bd-48d9-94a2-2406b7c6cb12 None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:56.348248 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 242/493] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 3 13:59:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 13:59:56.358253 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c1ea83-9298-45de-a9f1-134c2b271094 None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:56.392382 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479da945-e9bd-48d9-94a2-2406b7c6cb12 None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:56.434666 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bdf343-3b54-42f0-a9e3-19a1f799bb5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:56.435684 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bdf343-3b54-42f0-a9e3-19a1f799bb5c None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:56.435865 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bdf343-3b54-42f0-a9e3-19a1f799bb5c None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:56.436150 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bdf343-3b54-42f0-a9e3-19a1f799bb5c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:56.447941 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bdf343-3b54-42f0-a9e3-19a1f799bb5c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:56.449507 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bdf343-3b54-42f0-a9e3-19a1f799bb5c None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:56.468876 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application [None req-03bdf343-3b54-42f0-a9e3-19a1f799bb5c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 13:59:56.468876 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 13:59:56.468876 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 13:59:56.468876 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 13:59:56.468876 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 13:59:56.468876 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 13:59:56.468876 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 13:59:56.468876 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 13:59:56.468876 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 13:59:56.468876 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 13:59:56.468876 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 13:59:56.468876 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 13:59:56.468876 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 13:59:56.468876 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 13:59:56.468876 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 13:59:56.469823 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 13:59:56.469823 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 13:59:56.469823 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 13:59:56.469823 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 13:59:56.469823 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 13:59:56.469823 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 13:59:56.469823 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.get_or_create( May 03 13:59:56.469823 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 13:59:56.469823 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application with Lock( May 03 13:59:56.469823 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 13:59:56.469823 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._enter() May 03 13:59:56.469823 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 13:59:56.469823 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 13:59:56.469823 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 13:59:56.469823 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.creator() May 03 13:59:56.469823 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 13:59:56.469823 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application created_value = creator( May 03 13:59:56.471038 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 13:59:56.471038 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 13:59:56.471038 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 13:59:56.471038 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application May 03 13:59:56.471038 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 252/494] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 3 13:59:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 13:59:56.473529 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c1ea83-9298-45de-a9f1-134c2b271094 None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:56.475864 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bdf343-3b54-42f0-a9e3-19a1f799bb5c None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:56.508871 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588c30fc-065d-4395-a115-ad19a8b44c5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:56.509564 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588c30fc-065d-4395-a115-ad19a8b44c5f None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:56.509866 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588c30fc-065d-4395-a115-ad19a8b44c5f None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:56.510115 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588c30fc-065d-4395-a115-ad19a8b44c5f None admin] PATH_INFO: `/v3/users` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:56.510949 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588c30fc-065d-4395-a115-ad19a8b44c5f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80012) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 13:59:56.511255 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588c30fc-065d-4395-a115-ad19a8b44c5f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:56.512676 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588c30fc-065d-4395-a115-ad19a8b44c5f None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:56.548992 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 243/495] 10.222.0.36 () {56 vars in 1133 bytes} [Tue May 3 13:59:56 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 13:59:56.549864 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588c30fc-065d-4395-a115-ad19a8b44c5f None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:56.575319 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bdf343-3b54-42f0-a9e3-19a1f799bb5c None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:56.609015 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706297c1-fc10-4a7c-a968-eb41d0ea6a69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:56.609848 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706297c1-fc10-4a7c-a968-eb41d0ea6a69 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:56.610128 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706297c1-fc10-4a7c-a968-eb41d0ea6a69 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:56.610403 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706297c1-fc10-4a7c-a968-eb41d0ea6a69 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:56.620430 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706297c1-fc10-4a7c-a968-eb41d0ea6a69 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 13:59:56.628358 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application [None req-706297c1-fc10-4a7c-a968-eb41d0ea6a69 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 03 13:59:56.628358 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 13:59:56.628358 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 13:59:56.628358 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 13:59:56.628358 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 13:59:56.628358 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 13:59:56.628358 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 13:59:56.628358 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 13:59:56.628358 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 13:59:56.628358 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 13:59:56.628358 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 13:59:56.628358 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 13:59:56.628358 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 13:59:56.628358 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 13:59:56.628358 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 13:59:56.628358 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 13:59:56.629316 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 13:59:56.629316 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 13:59:56.629316 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 13:59:56.629316 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 13:59:56.629316 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 13:59:56.629316 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 13:59:56.629316 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 13:59:56.629316 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 13:59:56.629316 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 13:59:56.629316 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.get_or_create( May 03 13:59:56.629316 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 13:59:56.629316 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application with Lock( May 03 13:59:56.629316 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 13:59:56.629316 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._enter() May 03 13:59:56.629316 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 13:59:56.629316 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 13:59:56.630163 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 13:59:56.630163 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.creator() May 03 13:59:56.630163 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 13:59:56.630163 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application created_value = creator( May 03 13:59:56.630163 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 13:59:56.630163 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 13:59:56.630163 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 13:59:56.630163 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 13:59:56.630163 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 13:59:56.630163 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 13:59:56.630163 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 03 13:59:56.630163 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application May 03 13:59:56.630163 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 253/496] 10.222.0.36 () {56 vars in 1102 bytes} [Tue May 3 13:59:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 13:59:56.631330 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c5c6b6-0799-4b31-9b11-c9a19594d1c8 None None] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:56.631330 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c5c6b6-0799-4b31-9b11-c9a19594d1c8 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:56.631749 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c5c6b6-0799-4b31-9b11-c9a19594d1c8 None None] PATH_INFO: `/` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:56.637412 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 254/497] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 3 13:59:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 13:59:56.637412 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c5c6b6-0799-4b31-9b11-c9a19594d1c8 None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:56.658261 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588c30fc-065d-4395-a115-ad19a8b44c5f None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:56.690863 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f960c8-57a3-4fee-8832-b8a1129564c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:56.691523 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f960c8-57a3-4fee-8832-b8a1129564c0 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:56.691806 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f960c8-57a3-4fee-8832-b8a1129564c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:56.692082 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f960c8-57a3-4fee-8832-b8a1129564c0 None admin] PATH_INFO: `/v3/domains` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:56.692803 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f960c8-57a3-4fee-8832-b8a1129564c0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80012) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 13:59:56.693107 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f960c8-57a3-4fee-8832-b8a1129564c0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:56.694525 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f960c8-57a3-4fee-8832-b8a1129564c0 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:56.709946 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 244/498] 10.222.0.36 () {56 vars in 1109 bytes} [Tue May 3 13:59:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 13:59:56.710827 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f960c8-57a3-4fee-8832-b8a1129564c0 None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:56.735515 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c5c6b6-0799-4b31-9b11-c9a19594d1c8 None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:56.767619 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798ce7a8-a7d1-46b2-89d2-20366c49f2a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:56.768288 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798ce7a8-a7d1-46b2-89d2-20366c49f2a0 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:56.768567 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798ce7a8-a7d1-46b2-89d2-20366c49f2a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:56.768854 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798ce7a8-a7d1-46b2-89d2-20366c49f2a0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:56.809560 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f960c8-57a3-4fee-8832-b8a1129564c0 None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:56.844940 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798ce7a8-a7d1-46b2-89d2-20366c49f2a0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:56.845496 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6816259-d211-4392-9816-6974a89cf6ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:56.846171 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6816259-d211-4392-9816-6974a89cf6ca None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:56.846452 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6816259-d211-4392-9816-6974a89cf6ca None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:56.846549 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798ce7a8-a7d1-46b2-89d2-20366c49f2a0 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:56.846725 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6816259-d211-4392-9816-6974a89cf6ca None admin] PATH_INFO: `/v3/roles` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:56.847530 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6816259-d211-4392-9816-6974a89cf6ca None admin] RBAC: Adding query filter params (name=service) {{(pid=80012) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 13:59:56.847835 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6816259-d211-4392-9816-6974a89cf6ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:56.849297 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6816259-d211-4392-9816-6974a89cf6ca None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:56.861809 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 245/499] 10.222.0.36 () {56 vars in 1103 bytes} [Tue May 3 13:59:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 13:59:56.861809 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010b2188-3924-4b7c-a68e-0b09508c64e2 None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:56.861809 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010b2188-3924-4b7c-a68e-0b09508c64e2 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:56.861809 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010b2188-3924-4b7c-a68e-0b09508c64e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:56.876933 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-010b2188-3924-4b7c-a68e-0b09508c64e2 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 13:59:56.878160 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-010b2188-3924-4b7c-a68e-0b09508c64e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 13:59:56.941923 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 246/500] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 3 13:59:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 13:59:56.943023 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010b2188-3924-4b7c-a68e-0b09508c64e2 None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:56.960673 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 255/501] 10.222.0.36 () {58 vars in 1282 bytes} [Tue May 3 13:59:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 03 13:59:56.966749 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798ce7a8-a7d1-46b2-89d2-20366c49f2a0 None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:57.039318 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010b2188-3924-4b7c-a68e-0b09508c64e2 None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:57.058382 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798ce7a8-a7d1-46b2-89d2-20366c49f2a0 None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:57.070944 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc46e807-e8e9-443a-b02d-9d350fc2ab17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:57.071739 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc46e807-e8e9-443a-b02d-9d350fc2ab17 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:57.072013 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc46e807-e8e9-443a-b02d-9d350fc2ab17 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:57.072289 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc46e807-e8e9-443a-b02d-9d350fc2ab17 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:57.079605 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc46e807-e8e9-443a-b02d-9d350fc2ab17 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:57.081079 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc46e807-e8e9-443a-b02d-9d350fc2ab17 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:57.091760 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9dcf67-b531-4362-907c-a22147a8d785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:57.092557 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9dcf67-b531-4362-907c-a22147a8d785 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:57.092839 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9dcf67-b531-4362-907c-a22147a8d785 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:57.093100 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9dcf67-b531-4362-907c-a22147a8d785 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:57.096854 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application [None req-fc46e807-e8e9-443a-b02d-9d350fc2ab17 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 03 13:59:57.096854 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 13:59:57.096854 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 13:59:57.096854 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 13:59:57.096854 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 13:59:57.096854 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 13:59:57.096854 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 13:59:57.096854 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 13:59:57.096854 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 13:59:57.096854 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 13:59:57.096854 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 13:59:57.096854 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 13:59:57.096854 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 13:59:57.096854 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 13:59:57.096854 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 13:59:57.096854 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 13:59:57.097836 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 13:59:57.097836 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 13:59:57.097836 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 13:59:57.097836 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 13:59:57.097836 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 13:59:57.097836 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 13:59:57.097836 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 13:59:57.097836 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 13:59:57.097836 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 13:59:57.097836 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.get_or_create( May 03 13:59:57.097836 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 13:59:57.097836 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application with Lock( May 03 13:59:57.097836 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 13:59:57.097836 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._enter() May 03 13:59:57.097836 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 13:59:57.097836 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 13:59:57.097836 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 13:59:57.097836 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.creator() May 03 13:59:57.098785 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 13:59:57.098785 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application created_value = creator( May 03 13:59:57.098785 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 13:59:57.098785 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 13:59:57.098785 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 13:59:57.098785 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 13:59:57.098785 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 13:59:57.098785 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 13:59:57.098785 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 03 13:59:57.098785 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application May 03 13:59:57.098785 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 247/502] 10.222.0.36 () {56 vars in 1099 bytes} [Tue May 3 13:59:56 2022] GET /identity/v3/users/glance => generated 84 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 13:59:57.099359 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc46e807-e8e9-443a-b02d-9d350fc2ab17 None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:57.106998 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9dcf67-b531-4362-907c-a22147a8d785 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:57.108521 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9dcf67-b531-4362-907c-a22147a8d785 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:57.126495 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application [None req-7c9dcf67-b531-4362-907c-a22147a8d785 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 13:59:57.126495 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 13:59:57.126495 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 13:59:57.126495 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 13:59:57.126495 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 13:59:57.126495 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 13:59:57.126495 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 13:59:57.126495 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 13:59:57.126495 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 13:59:57.126495 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 13:59:57.126495 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 13:59:57.126495 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 13:59:57.126495 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 13:59:57.126495 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 13:59:57.126495 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 13:59:57.127354 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 13:59:57.127354 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 13:59:57.127354 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 13:59:57.127354 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 13:59:57.127354 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 13:59:57.127354 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 13:59:57.127354 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.get_or_create( May 03 13:59:57.127354 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 13:59:57.127354 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application with Lock( May 03 13:59:57.127354 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 13:59:57.127354 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._enter() May 03 13:59:57.127354 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 13:59:57.127354 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 13:59:57.127354 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 13:59:57.127354 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.creator() May 03 13:59:57.127354 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 13:59:57.127354 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application created_value = creator( May 03 13:59:57.128391 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 13:59:57.128391 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 13:59:57.128391 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 13:59:57.128391 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application May 03 13:59:57.128391 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 256/503] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 3 13:59:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 13:59:57.128651 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9dcf67-b531-4362-907c-a22147a8d785 None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:57.194511 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc46e807-e8e9-443a-b02d-9d350fc2ab17 None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:57.225672 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9dcf67-b531-4362-907c-a22147a8d785 None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:57.227779 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f362098-7b98-40df-b780-b19f1dfdee9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:57.228583 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f362098-7b98-40df-b780-b19f1dfdee9d None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:57.228836 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f362098-7b98-40df-b780-b19f1dfdee9d None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:57.229104 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f362098-7b98-40df-b780-b19f1dfdee9d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:57.239088 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f362098-7b98-40df-b780-b19f1dfdee9d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:57.240533 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f362098-7b98-40df-b780-b19f1dfdee9d None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:57.257614 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application [None req-4f362098-7b98-40df-b780-b19f1dfdee9d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 13:59:57.257614 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 13:59:57.257614 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 13:59:57.257614 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 13:59:57.257614 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 13:59:57.257614 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 13:59:57.257614 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 13:59:57.257614 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 13:59:57.257614 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 13:59:57.257614 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 13:59:57.257614 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 13:59:57.257614 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 13:59:57.257614 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 13:59:57.257614 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 13:59:57.257614 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 13:59:57.258570 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 13:59:57.258570 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 13:59:57.258570 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 13:59:57.258570 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 13:59:57.258570 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 13:59:57.258570 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 13:59:57.258570 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.get_or_create( May 03 13:59:57.258570 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 13:59:57.258570 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application with Lock( May 03 13:59:57.258570 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 13:59:57.258570 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._enter() May 03 13:59:57.258570 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 13:59:57.258570 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 13:59:57.258570 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 13:59:57.258570 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.creator() May 03 13:59:57.258570 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 13:59:57.258570 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application created_value = creator( May 03 13:59:57.259429 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 13:59:57.259429 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 13:59:57.259429 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 13:59:57.259429 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application May 03 13:59:57.259662 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c54a01-4015-4495-bb10-b8e2ea8bcc8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:57.260067 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 248/504] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 3 13:59:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 13:59:57.260139 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c54a01-4015-4495-bb10-b8e2ea8bcc8e None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:57.260139 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c54a01-4015-4495-bb10-b8e2ea8bcc8e None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:57.260274 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162a5e23-77da-4271-bebe-6f6403344d3c None None] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:57.260344 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c54a01-4015-4495-bb10-b8e2ea8bcc8e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:57.260411 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162a5e23-77da-4271-bebe-6f6403344d3c None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:57.260477 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162a5e23-77da-4271-bebe-6f6403344d3c None None] PATH_INFO: `/` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:57.261726 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 249/505] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 3 13:59:57 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 13:59:57.262391 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162a5e23-77da-4271-bebe-6f6403344d3c None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:57.273622 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c54a01-4015-4495-bb10-b8e2ea8bcc8e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 13:59:57.281359 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application [None req-56c54a01-4015-4495-bb10-b8e2ea8bcc8e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 03 13:59:57.281359 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 13:59:57.281359 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 13:59:57.281359 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 13:59:57.281359 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 13:59:57.281359 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 13:59:57.281359 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 13:59:57.281359 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 13:59:57.281359 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 13:59:57.281359 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 13:59:57.281359 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 13:59:57.281359 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 13:59:57.281359 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 13:59:57.281359 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 13:59:57.281359 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 13:59:57.281359 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 13:59:57.282327 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 13:59:57.282327 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 13:59:57.282327 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 13:59:57.282327 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 13:59:57.282327 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 13:59:57.282327 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 13:59:57.282327 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 13:59:57.282327 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 13:59:57.282327 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 13:59:57.282327 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.get_or_create( May 03 13:59:57.282327 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 13:59:57.282327 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application with Lock( May 03 13:59:57.282327 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 13:59:57.282327 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._enter() May 03 13:59:57.282327 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 13:59:57.282327 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 13:59:57.283150 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 13:59:57.283150 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.creator() May 03 13:59:57.283150 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 13:59:57.283150 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application created_value = creator( May 03 13:59:57.283150 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 13:59:57.283150 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 13:59:57.283150 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 13:59:57.283150 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 13:59:57.283150 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 13:59:57.283150 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 13:59:57.283150 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 03 13:59:57.283150 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application May 03 13:59:57.283150 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 257/506] 10.222.0.36 () {56 vars in 1102 bytes} [Tue May 3 13:59:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 13:59:57.283857 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c54a01-4015-4495-bb10-b8e2ea8bcc8e None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:57.359615 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162a5e23-77da-4271-bebe-6f6403344d3c None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:57.381980 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c54a01-4015-4495-bb10-b8e2ea8bcc8e None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:57.392274 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f736d6-c6be-4d27-86b7-9f6a981931b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:57.392931 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f736d6-c6be-4d27-86b7-9f6a981931b5 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:57.393204 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f736d6-c6be-4d27-86b7-9f6a981931b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:57.393499 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f736d6-c6be-4d27-86b7-9f6a981931b5 None admin] PATH_INFO: `/v3/users` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:57.394326 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f736d6-c6be-4d27-86b7-9f6a981931b5 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80012) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 13:59:57.394623 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f736d6-c6be-4d27-86b7-9f6a981931b5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:57.396037 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f736d6-c6be-4d27-86b7-9f6a981931b5 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:57.412172 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 250/507] 10.222.0.36 () {56 vars in 1137 bytes} [Tue May 3 13:59:57 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 13:59:57.412947 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f736d6-c6be-4d27-86b7-9f6a981931b5 None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:57.418404 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdeb637-7ce6-4a3b-be59-6f29929a401a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:57.419061 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdeb637-7ce6-4a3b-be59-6f29929a401a None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:57.419338 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdeb637-7ce6-4a3b-be59-6f29929a401a None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:57.419632 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdeb637-7ce6-4a3b-be59-6f29929a401a None admin] PATH_INFO: `/v3/domains` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:57.420533 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdeb637-7ce6-4a3b-be59-6f29929a401a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 13:59:57.420838 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdeb637-7ce6-4a3b-be59-6f29929a401a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:57.422239 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdeb637-7ce6-4a3b-be59-6f29929a401a None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:57.433604 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 258/508] 10.222.0.36 () {56 vars in 1109 bytes} [Tue May 3 13:59:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 13:59:57.434835 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e22c73d-36e2-47dc-a939-88f12236ddd3 None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:57.435116 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e22c73d-36e2-47dc-a939-88f12236ddd3 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:57.435417 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e22c73d-36e2-47dc-a939-88f12236ddd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:57.451174 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-6e22c73d-36e2-47dc-a939-88f12236ddd3 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 13:59:57.452259 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-6e22c73d-36e2-47dc-a939-88f12236ddd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 13:59:57.507675 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f736d6-c6be-4d27-86b7-9f6a981931b5 None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:57.516204 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 259/509] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 3 13:59:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 13:59:57.517033 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e22c73d-36e2-47dc-a939-88f12236ddd3 None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:57.542545 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaea8e1-349b-4b1d-8bcb-b61d82dca63b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:57.543225 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaea8e1-349b-4b1d-8bcb-b61d82dca63b None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:57.543496 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaea8e1-349b-4b1d-8bcb-b61d82dca63b None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:57.543760 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaea8e1-349b-4b1d-8bcb-b61d82dca63b None admin] PATH_INFO: `/v3/domains` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:57.544472 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aaea8e1-349b-4b1d-8bcb-b61d82dca63b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80012) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 13:59:57.544826 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aaea8e1-349b-4b1d-8bcb-b61d82dca63b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:57.546209 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aaea8e1-349b-4b1d-8bcb-b61d82dca63b None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:57.557150 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 251/510] 10.222.0.36 () {56 vars in 1109 bytes} [Tue May 3 13:59:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 13:59:57.557947 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaea8e1-349b-4b1d-8bcb-b61d82dca63b None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:57.616018 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e22c73d-36e2-47dc-a939-88f12236ddd3 None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:57.648678 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725ef4d9-be94-4a7e-b7e4-ce0a66bd9ace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:57.649363 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725ef4d9-be94-4a7e-b7e4-ce0a66bd9ace None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:57.649643 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725ef4d9-be94-4a7e-b7e4-ce0a66bd9ace None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:57.649912 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725ef4d9-be94-4a7e-b7e4-ce0a66bd9ace None admin] PATH_INFO: `/v3/roles` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:57.650650 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725ef4d9-be94-4a7e-b7e4-ce0a66bd9ace None admin] RBAC: Adding query filter params (name=service) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 13:59:57.650950 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725ef4d9-be94-4a7e-b7e4-ce0a66bd9ace None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:57.652318 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725ef4d9-be94-4a7e-b7e4-ce0a66bd9ace None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:57.657389 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaea8e1-349b-4b1d-8bcb-b61d82dca63b None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:57.660064 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 260/511] 10.222.0.36 () {56 vars in 1103 bytes} [Tue May 3 13:59:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 13:59:57.660838 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725ef4d9-be94-4a7e-b7e4-ce0a66bd9ace None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:57.691298 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e5ed3f-cd45-4b84-a729-25c6d6dde14f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:57.691942 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e5ed3f-cd45-4b84-a729-25c6d6dde14f None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:57.692224 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e5ed3f-cd45-4b84-a729-25c6d6dde14f None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:57.692497 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e5ed3f-cd45-4b84-a729-25c6d6dde14f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:57.754558 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725ef4d9-be94-4a7e-b7e4-ce0a66bd9ace None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:57.757118 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e5ed3f-cd45-4b84-a729-25c6d6dde14f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:57.758608 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e5ed3f-cd45-4b84-a729-25c6d6dde14f None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:57.787031 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc26060-ff07-4459-b265-2ba5cb415c6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:57.787804 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc26060-ff07-4459-b265-2ba5cb415c6b None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:57.788081 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc26060-ff07-4459-b265-2ba5cb415c6b None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:57.788379 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc26060-ff07-4459-b265-2ba5cb415c6b None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:57.795621 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc26060-ff07-4459-b265-2ba5cb415c6b None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:57.797065 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc26060-ff07-4459-b265-2ba5cb415c6b None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:57.811253 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application [None req-ccc26060-ff07-4459-b265-2ba5cb415c6b None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 03 13:59:57.811253 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 13:59:57.811253 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 13:59:57.811253 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 13:59:57.811253 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 13:59:57.811253 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 13:59:57.811253 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 13:59:57.811253 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 13:59:57.811253 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 13:59:57.811253 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 13:59:57.811253 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 13:59:57.811253 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 13:59:57.811253 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 13:59:57.811253 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 13:59:57.811253 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 13:59:57.811253 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 13:59:57.812274 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 13:59:57.812274 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 13:59:57.812274 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 13:59:57.812274 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 13:59:57.812274 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 13:59:57.812274 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 13:59:57.812274 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 13:59:57.812274 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 13:59:57.812274 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 13:59:57.812274 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.get_or_create( May 03 13:59:57.812274 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 13:59:57.812274 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application with Lock( May 03 13:59:57.812274 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 13:59:57.812274 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._enter() May 03 13:59:57.812274 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 13:59:57.812274 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 13:59:57.812274 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 13:59:57.812274 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.creator() May 03 13:59:57.813222 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 13:59:57.813222 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application created_value = creator( May 03 13:59:57.813222 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 13:59:57.813222 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 13:59:57.813222 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 13:59:57.813222 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 13:59:57.813222 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 13:59:57.813222 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 13:59:57.813222 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 03 13:59:57.813222 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application May 03 13:59:57.813222 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 261/512] 10.222.0.36 () {56 vars in 1099 bytes} [Tue May 3 13:59:57 2022] GET /identity/v3/users/cinder => generated 84 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 13:59:57.813923 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc26060-ff07-4459-b265-2ba5cb415c6b None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:57.856178 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 252/513] 10.222.0.36 () {58 vars in 1282 bytes} [Tue May 3 13:59:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 03 13:59:57.857009 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e5ed3f-cd45-4b84-a729-25c6d6dde14f None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:57.908928 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc26060-ff07-4459-b265-2ba5cb415c6b None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:57.942284 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecece821-c51b-407b-a9a6-ccf0b1eedfec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:57.943098 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecece821-c51b-407b-a9a6-ccf0b1eedfec None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:57.943368 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecece821-c51b-407b-a9a6-ccf0b1eedfec None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:57.943650 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecece821-c51b-407b-a9a6-ccf0b1eedfec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:57.948916 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e5ed3f-cd45-4b84-a729-25c6d6dde14f None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:57.953986 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecece821-c51b-407b-a9a6-ccf0b1eedfec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:57.955452 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecece821-c51b-407b-a9a6-ccf0b1eedfec None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:57.972510 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application [None req-ecece821-c51b-407b-a9a6-ccf0b1eedfec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 13:59:57.972510 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 13:59:57.972510 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 13:59:57.972510 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 13:59:57.972510 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 13:59:57.972510 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 13:59:57.972510 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 13:59:57.972510 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 13:59:57.972510 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 13:59:57.972510 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 13:59:57.972510 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 13:59:57.972510 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 13:59:57.972510 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 13:59:57.972510 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 13:59:57.972510 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 13:59:57.973433 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 13:59:57.973433 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 13:59:57.973433 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 13:59:57.973433 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 13:59:57.973433 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 13:59:57.973433 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 13:59:57.973433 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.get_or_create( May 03 13:59:57.973433 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 13:59:57.973433 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application with Lock( May 03 13:59:57.973433 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 13:59:57.973433 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._enter() May 03 13:59:57.973433 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 13:59:57.973433 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 13:59:57.973433 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 13:59:57.973433 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.creator() May 03 13:59:57.973433 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 13:59:57.973433 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application created_value = creator( May 03 13:59:57.974304 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 13:59:57.974304 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 13:59:57.974304 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 13:59:57.974304 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application May 03 13:59:57.974304 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 262/514] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 3 13:59:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 13:59:57.974579 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecece821-c51b-407b-a9a6-ccf0b1eedfec None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:57.988263 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ab7fb1-4d4b-4b15-8be7-fd1402be17e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:57.989061 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ab7fb1-4d4b-4b15-8be7-fd1402be17e3 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:57.989336 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ab7fb1-4d4b-4b15-8be7-fd1402be17e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:57.989630 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ab7fb1-4d4b-4b15-8be7-fd1402be17e3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:57.996391 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ab7fb1-4d4b-4b15-8be7-fd1402be17e3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:57.997927 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ab7fb1-4d4b-4b15-8be7-fd1402be17e3 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:58.012063 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application [None req-93ab7fb1-4d4b-4b15-8be7-fd1402be17e3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 13:59:58.012063 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 13:59:58.012063 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 13:59:58.012063 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 13:59:58.012063 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 13:59:58.012063 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 13:59:58.012063 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 13:59:58.012063 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 13:59:58.012063 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 13:59:58.012063 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 13:59:58.012063 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 13:59:58.012063 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 13:59:58.012063 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 13:59:58.012063 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 13:59:58.012063 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 13:59:58.012937 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 13:59:58.012937 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 13:59:58.012937 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 13:59:58.012937 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 13:59:58.012937 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 13:59:58.012937 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 13:59:58.012937 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.get_or_create( May 03 13:59:58.012937 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 13:59:58.012937 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application with Lock( May 03 13:59:58.012937 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 13:59:58.012937 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._enter() May 03 13:59:58.012937 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 13:59:58.012937 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 13:59:58.012937 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 13:59:58.012937 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.creator() May 03 13:59:58.012937 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 13:59:58.012937 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application created_value = creator( May 03 13:59:58.014285 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 13:59:58.014285 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 13:59:58.014285 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 13:59:58.014285 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 13:59:58.014285 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 13:59:58.014285 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 13:59:58.014285 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 13:59:58.014285 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application May 03 13:59:58.014285 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 253/515] 10.222.0.36 () {56 vars in 1111 bytes} [Tue May 3 13:59:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 13:59:58.014778 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ab7fb1-4d4b-4b15-8be7-fd1402be17e3 None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:58.078608 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecece821-c51b-407b-a9a6-ccf0b1eedfec None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:58.109964 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d284ed3-83c3-4114-b4f7-e72ba849c46b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:58.110756 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d284ed3-83c3-4114-b4f7-e72ba849c46b None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:58.111037 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d284ed3-83c3-4114-b4f7-e72ba849c46b None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:58.111311 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d284ed3-83c3-4114-b4f7-e72ba849c46b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:58.114398 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ab7fb1-4d4b-4b15-8be7-fd1402be17e3 None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:58.121393 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d284ed3-83c3-4114-b4f7-e72ba849c46b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:58.122867 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d284ed3-83c3-4114-b4f7-e72ba849c46b None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:58.139085 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application [None req-8d284ed3-83c3-4114-b4f7-e72ba849c46b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 13:59:58.139085 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 13:59:58.139085 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 13:59:58.139085 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 13:59:58.139085 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 13:59:58.139085 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 13:59:58.139085 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 13:59:58.139085 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 13:59:58.139085 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 13:59:58.139085 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 13:59:58.139085 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 13:59:58.139085 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 13:59:58.139085 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 13:59:58.139085 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 13:59:58.139085 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 13:59:58.139974 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 13:59:58.139974 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 13:59:58.139974 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 13:59:58.139974 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 13:59:58.139974 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 13:59:58.139974 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 13:59:58.139974 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.get_or_create( May 03 13:59:58.139974 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 13:59:58.139974 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application with Lock( May 03 13:59:58.139974 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 13:59:58.139974 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._enter() May 03 13:59:58.139974 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 13:59:58.139974 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 13:59:58.139974 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 13:59:58.139974 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.creator() May 03 13:59:58.139974 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 13:59:58.139974 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application created_value = creator( May 03 13:59:58.140893 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 13:59:58.140893 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 13:59:58.140893 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 13:59:58.140893 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application May 03 13:59:58.141512 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 263/516] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 3 13:59:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 13:59:58.142461 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d284ed3-83c3-4114-b4f7-e72ba849c46b None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:58.145978 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cbe24d-2196-46fc-be7b-3f7996a579a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:58.146642 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cbe24d-2196-46fc-be7b-3f7996a579a0 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:58.146922 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cbe24d-2196-46fc-be7b-3f7996a579a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:58.147188 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cbe24d-2196-46fc-be7b-3f7996a579a0 None admin] PATH_INFO: `/v3/users` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:58.148015 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cbe24d-2196-46fc-be7b-3f7996a579a0 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80012) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 13:59:58.148314 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cbe24d-2196-46fc-be7b-3f7996a579a0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:58.149764 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cbe24d-2196-46fc-be7b-3f7996a579a0 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:58.166191 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 254/517] 10.222.0.36 () {56 vars in 1137 bytes} [Tue May 3 13:59:58 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 13:59:58.166973 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cbe24d-2196-46fc-be7b-3f7996a579a0 None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:58.237723 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d284ed3-83c3-4114-b4f7-e72ba849c46b None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:58.259591 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cbe24d-2196-46fc-be7b-3f7996a579a0 None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:58.270433 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eedbdab-ca95-450a-8cd5-da780a52d630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:58.271199 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eedbdab-ca95-450a-8cd5-da780a52d630 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:58.271471 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eedbdab-ca95-450a-8cd5-da780a52d630 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:58.271777 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eedbdab-ca95-450a-8cd5-da780a52d630 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:58.282114 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eedbdab-ca95-450a-8cd5-da780a52d630 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:58.283552 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eedbdab-ca95-450a-8cd5-da780a52d630 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:58.292621 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9ee78c-dfc8-44d7-8617-f5f6dacc0de7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:58.293267 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9ee78c-dfc8-44d7-8617-f5f6dacc0de7 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:58.293567 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9ee78c-dfc8-44d7-8617-f5f6dacc0de7 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:58.293837 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9ee78c-dfc8-44d7-8617-f5f6dacc0de7 None admin] PATH_INFO: `/v3/domains` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:58.294587 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9ee78c-dfc8-44d7-8617-f5f6dacc0de7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80012) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 13:59:58.295011 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9ee78c-dfc8-44d7-8617-f5f6dacc0de7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:58.296358 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9ee78c-dfc8-44d7-8617-f5f6dacc0de7 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:58.300705 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application [None req-0eedbdab-ca95-450a-8cd5-da780a52d630 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 13:59:58.300705 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 13:59:58.300705 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 13:59:58.300705 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 13:59:58.300705 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 13:59:58.300705 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 13:59:58.300705 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 13:59:58.300705 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 13:59:58.300705 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 13:59:58.300705 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 13:59:58.300705 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 13:59:58.300705 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 13:59:58.300705 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 13:59:58.300705 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 13:59:58.300705 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 13:59:58.301630 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 13:59:58.301630 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 13:59:58.301630 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 13:59:58.301630 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 13:59:58.301630 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 13:59:58.301630 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 13:59:58.301630 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.get_or_create( May 03 13:59:58.301630 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 13:59:58.301630 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application with Lock( May 03 13:59:58.301630 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 13:59:58.301630 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._enter() May 03 13:59:58.301630 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 13:59:58.301630 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 13:59:58.301630 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 13:59:58.301630 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.creator() May 03 13:59:58.301630 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 13:59:58.301630 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application created_value = creator( May 03 13:59:58.302491 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 13:59:58.302491 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 13:59:58.302491 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 13:59:58.302491 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application May 03 13:59:58.302491 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 264/518] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 3 13:59:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 13:59:58.302757 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eedbdab-ca95-450a-8cd5-da780a52d630 None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:58.306989 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 255/519] 10.222.0.36 () {56 vars in 1109 bytes} [Tue May 3 13:59:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 13:59:58.307768 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9ee78c-dfc8-44d7-8617-f5f6dacc0de7 None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:58.399667 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eedbdab-ca95-450a-8cd5-da780a52d630 None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:58.401254 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9ee78c-dfc8-44d7-8617-f5f6dacc0de7 None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:58.431613 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7cbee0-f1dc-4da3-84ce-ec29d5f42021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:58.432267 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7cbee0-f1dc-4da3-84ce-ec29d5f42021 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:58.432547 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7cbee0-f1dc-4da3-84ce-ec29d5f42021 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:58.432817 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7cbee0-f1dc-4da3-84ce-ec29d5f42021 None admin] PATH_INFO: `/v3/projects` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:58.433642 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7cbee0-f1dc-4da3-84ce-ec29d5f42021 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 13:59:58.433944 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7cbee0-f1dc-4da3-84ce-ec29d5f42021 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:58.434993 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1292c61c-4d15-446c-bb9d-315a0419a0ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:58.435396 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7cbee0-f1dc-4da3-84ce-ec29d5f42021 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:58.435790 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1292c61c-4d15-446c-bb9d-315a0419a0ab None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:58.435973 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1292c61c-4d15-446c-bb9d-315a0419a0ab None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:58.436245 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1292c61c-4d15-446c-bb9d-315a0419a0ab None admin] PATH_INFO: `/v3/domains` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:58.436956 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1292c61c-4d15-446c-bb9d-315a0419a0ab None admin] RBAC: Adding query filter params (name=Default) {{(pid=80012) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 13:59:58.437261 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1292c61c-4d15-446c-bb9d-315a0419a0ab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:58.438643 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1292c61c-4d15-446c-bb9d-315a0419a0ab None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:58.450440 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 256/520] 10.222.0.36 () {56 vars in 1109 bytes} [Tue May 3 13:59:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 13:59:58.451276 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1292c61c-4d15-446c-bb9d-315a0419a0ab None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:58.453344 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 265/521] 10.222.0.36 () {56 vars in 1148 bytes} [Tue May 3 13:59:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 13:59:58.454044 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7cbee0-f1dc-4da3-84ce-ec29d5f42021 None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:58.546879 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1292c61c-4d15-446c-bb9d-315a0419a0ab None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:58.552888 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7cbee0-f1dc-4da3-84ce-ec29d5f42021 None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:58.582892 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e96c807-7263-4b79-8c9d-d37411f63b0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:58.583532 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e96c807-7263-4b79-8c9d-d37411f63b0c None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:58.583808 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e96c807-7263-4b79-8c9d-d37411f63b0c None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:58.584076 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e96c807-7263-4b79-8c9d-d37411f63b0c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:58.588530 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac77ad24-0498-428e-bc8a-5b787d1dccdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:58.589529 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac77ad24-0498-428e-bc8a-5b787d1dccdd None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:58.589807 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac77ad24-0498-428e-bc8a-5b787d1dccdd None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:58.590085 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac77ad24-0498-428e-bc8a-5b787d1dccdd None admin] PATH_INFO: `/v3/domains` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:58.590798 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac77ad24-0498-428e-bc8a-5b787d1dccdd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 13:59:58.591101 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac77ad24-0498-428e-bc8a-5b787d1dccdd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:58.592881 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac77ad24-0498-428e-bc8a-5b787d1dccdd None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:58.603843 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 266/522] 10.222.0.36 () {56 vars in 1109 bytes} [Tue May 3 13:59:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 13:59:58.604595 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac77ad24-0498-428e-bc8a-5b787d1dccdd None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:58.651161 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e96c807-7263-4b79-8c9d-d37411f63b0c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:58.652615 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e96c807-7263-4b79-8c9d-d37411f63b0c None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:58.695336 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac77ad24-0498-428e-bc8a-5b787d1dccdd None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:58.728579 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd8d2d0-10a9-45b7-9006-53b23669d224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:58.729230 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd8d2d0-10a9-45b7-9006-53b23669d224 None admin] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:58.729537 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd8d2d0-10a9-45b7-9006-53b23669d224 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:58.729797 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd8d2d0-10a9-45b7-9006-53b23669d224 None admin] PATH_INFO: `/v3/users` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:58.730489 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd8d2d0-10a9-45b7-9006-53b23669d224 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:58.731902 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd8d2d0-10a9-45b7-9006-53b23669d224 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:58.754440 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 257/523] 10.222.0.36 () {58 vars in 1282 bytes} [Tue May 3 13:59:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 03 13:59:58.754440 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e96c807-7263-4b79-8c9d-d37411f63b0c None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:58.759724 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 267/524] 10.222.0.36 () {60 vars in 1132 bytes} [Tue May 3 13:59:58 2022] POST /identity/v3/users => generated 247 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 13:59:58.759724 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd8d2d0-10a9-45b7-9006-53b23669d224 None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:58.868176 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd8d2d0-10a9-45b7-9006-53b23669d224 None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:58.873038 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e96c807-7263-4b79-8c9d-d37411f63b0c None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:58.907881 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdb9a8d-d981-4374-bd64-aa95384b2b29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:58.908553 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdb9a8d-d981-4374-bd64-aa95384b2b29 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:58.908923 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdb9a8d-d981-4374-bd64-aa95384b2b29 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:58.909042 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa372af2-70fc-460f-8ab5-8be9ee17d2b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:58.909363 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdb9a8d-d981-4374-bd64-aa95384b2b29 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:58.909759 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa372af2-70fc-460f-8ab5-8be9ee17d2b7 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:58.910033 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa372af2-70fc-460f-8ab5-8be9ee17d2b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:58.910301 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa372af2-70fc-460f-8ab5-8be9ee17d2b7 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:58.910404 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdb9a8d-d981-4374-bd64-aa95384b2b29 None admin] RBAC: Adding query filter params (role.id=b3902525744e454694820e2ea3b2e563, scope.project.id=de541be478754087934323bdbe41a579, user.id=63489e658c094a2598a2ac62159d2fda) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 13:59:58.910665 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdb9a8d-d981-4374-bd64-aa95384b2b29 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:58.912304 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdb9a8d-d981-4374-bd64-aa95384b2b29 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:58.918193 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa372af2-70fc-460f-8ab5-8be9ee17d2b7 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:58.929623 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 268/525] 10.222.0.36 () {56 vars in 1374 bytes} [Tue May 3 13:59:58 2022] GET /identity/v3/role_assignments?user.id=63489e658c094a2598a2ac62159d2fda&scope.project.id=de541be478754087934323bdbe41a579&role.id=b3902525744e454694820e2ea3b2e563 => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 13:59:58.929623 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdb9a8d-d981-4374-bd64-aa95384b2b29 None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:58.929897 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa372af2-70fc-460f-8ab5-8be9ee17d2b7 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:58.948901 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application [None req-fa372af2-70fc-460f-8ab5-8be9ee17d2b7 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 03 13:59:58.948901 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 13:59:58.948901 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 13:59:58.948901 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 13:59:58.948901 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 13:59:58.948901 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 13:59:58.948901 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 13:59:58.948901 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 13:59:58.948901 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 13:59:58.948901 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 13:59:58.948901 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 13:59:58.948901 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 13:59:58.948901 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 13:59:58.948901 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 13:59:58.948901 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 13:59:58.948901 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 13:59:58.949958 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 13:59:58.949958 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 13:59:58.949958 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 13:59:58.949958 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 13:59:58.949958 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 13:59:58.949958 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 13:59:58.949958 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 13:59:58.949958 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 13:59:58.949958 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 13:59:58.949958 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.get_or_create( May 03 13:59:58.949958 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 13:59:58.949958 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application with Lock( May 03 13:59:58.949958 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 13:59:58.949958 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._enter() May 03 13:59:58.949958 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 13:59:58.949958 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 13:59:58.949958 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 13:59:58.949958 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.creator() May 03 13:59:58.950927 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 13:59:58.950927 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application created_value = creator( May 03 13:59:58.950927 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 13:59:58.950927 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 13:59:58.950927 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 13:59:58.950927 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 13:59:58.950927 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 13:59:58.950927 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 13:59:58.950927 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 03 13:59:58.950927 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application May 03 13:59:58.955112 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 258/526] 10.222.0.36 () {56 vars in 1102 bytes} [Tue May 3 13:59:58 2022] GET /identity/v3/users/neutron => generated 85 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 13:59:58.956141 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa372af2-70fc-460f-8ab5-8be9ee17d2b7 None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:59.041644 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdb9a8d-d981-4374-bd64-aa95384b2b29 None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:59.077428 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd014ed5-d1c6-4b85-a2fb-eeb06fc632ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:59.078237 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd014ed5-d1c6-4b85-a2fb-eeb06fc632ab None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:59.078513 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd014ed5-d1c6-4b85-a2fb-eeb06fc632ab None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:59.078780 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd014ed5-d1c6-4b85-a2fb-eeb06fc632ab None admin] PATH_INFO: `/v3/projects/service` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:59.086333 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd014ed5-d1c6-4b85-a2fb-eeb06fc632ab None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:59.086655 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa372af2-70fc-460f-8ab5-8be9ee17d2b7 None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:59.087802 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd014ed5-d1c6-4b85-a2fb-eeb06fc632ab None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:59.104034 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application [None req-fd014ed5-d1c6-4b85-a2fb-eeb06fc632ab None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 13:59:59.104034 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 13:59:59.104034 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 13:59:59.104034 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 13:59:59.104034 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 13:59:59.104034 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 13:59:59.104034 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 13:59:59.104034 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 13:59:59.104034 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 13:59:59.104034 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 13:59:59.104034 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 13:59:59.104034 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 13:59:59.104034 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 13:59:59.104034 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 13:59:59.104034 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 13:59:59.104953 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 13:59:59.104953 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 13:59:59.104953 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 13:59:59.104953 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 13:59:59.104953 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 13:59:59.104953 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 13:59:59.104953 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.get_or_create( May 03 13:59:59.104953 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 13:59:59.104953 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application with Lock( May 03 13:59:59.104953 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 13:59:59.104953 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._enter() May 03 13:59:59.104953 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 13:59:59.104953 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 13:59:59.104953 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 13:59:59.104953 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.creator() May 03 13:59:59.104953 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 13:59:59.104953 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application created_value = creator( May 03 13:59:59.105864 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 13:59:59.105864 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 13:59:59.105864 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 13:59:59.105864 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 13:59:59.105864 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 13:59:59.105864 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 13:59:59.105864 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 13:59:59.105864 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application May 03 13:59:59.105864 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 269/527] 10.222.0.36 () {56 vars in 1111 bytes} [Tue May 3 13:59:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 13:59:59.106799 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd014ed5-d1c6-4b85-a2fb-eeb06fc632ab None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:59.123291 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff87539-506e-474c-aeab-d675762208ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:59.124046 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff87539-506e-474c-aeab-d675762208ae None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:59.124310 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff87539-506e-474c-aeab-d675762208ae None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:59.124568 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff87539-506e-474c-aeab-d675762208ae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:59.135178 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff87539-506e-474c-aeab-d675762208ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:59.136646 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff87539-506e-474c-aeab-d675762208ae None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:59.154438 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application [None req-2ff87539-506e-474c-aeab-d675762208ae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 13:59:59.154438 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 13:59:59.154438 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 13:59:59.154438 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 13:59:59.154438 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 13:59:59.154438 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 13:59:59.154438 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 13:59:59.154438 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 13:59:59.154438 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 13:59:59.154438 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 13:59:59.154438 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 13:59:59.154438 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 13:59:59.154438 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 13:59:59.154438 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 13:59:59.154438 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 13:59:59.156654 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 13:59:59.156654 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 13:59:59.156654 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 13:59:59.156654 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 13:59:59.156654 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 13:59:59.156654 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 13:59:59.156654 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.get_or_create( May 03 13:59:59.156654 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 13:59:59.156654 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application with Lock( May 03 13:59:59.156654 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 13:59:59.156654 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._enter() May 03 13:59:59.156654 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 13:59:59.156654 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 13:59:59.156654 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 13:59:59.156654 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.creator() May 03 13:59:59.156654 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 13:59:59.156654 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application created_value = creator( May 03 13:59:59.158720 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 13:59:59.158720 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 13:59:59.158720 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 13:59:59.158720 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application May 03 13:59:59.158720 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 259/528] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 3 13:59:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 13:59:59.158720 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff87539-506e-474c-aeab-d675762208ae None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:59.210783 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd014ed5-d1c6-4b85-a2fb-eeb06fc632ab None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:59.245456 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc65f651-04d9-46f0-8c32-dc55692d03f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:59.246132 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc65f651-04d9-46f0-8c32-dc55692d03f2 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:59.246406 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc65f651-04d9-46f0-8c32-dc55692d03f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:59.246664 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc65f651-04d9-46f0-8c32-dc55692d03f2 None admin] PATH_INFO: `/v3/users` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:59.247505 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc65f651-04d9-46f0-8c32-dc55692d03f2 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 13:59:59.247865 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc65f651-04d9-46f0-8c32-dc55692d03f2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:59.249357 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc65f651-04d9-46f0-8c32-dc55692d03f2 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:59.253911 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff87539-506e-474c-aeab-d675762208ae None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:59.287402 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142ce23b-5687-4806-bff8-78bc4ae1f917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:59.288177 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 270/529] 10.222.0.36 () {56 vars in 1139 bytes} [Tue May 3 13:59:59 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 13:59:59.288593 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142ce23b-5687-4806-bff8-78bc4ae1f917 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:59.288593 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142ce23b-5687-4806-bff8-78bc4ae1f917 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:59.288904 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc65f651-04d9-46f0-8c32-dc55692d03f2 None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:59.289049 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142ce23b-5687-4806-bff8-78bc4ae1f917 None admin] PATH_INFO: `/v3/projects` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:59.291982 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142ce23b-5687-4806-bff8-78bc4ae1f917 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80012) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 13:59:59.291982 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142ce23b-5687-4806-bff8-78bc4ae1f917 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:59.291982 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142ce23b-5687-4806-bff8-78bc4ae1f917 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:59.309212 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 260/530] 10.222.0.36 () {56 vars in 1148 bytes} [Tue May 3 13:59:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 13:59:59.310132 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142ce23b-5687-4806-bff8-78bc4ae1f917 None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:59.387684 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc65f651-04d9-46f0-8c32-dc55692d03f2 None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:59.404950 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142ce23b-5687-4806-bff8-78bc4ae1f917 None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:59.420654 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33740fa-a068-4adc-b56c-9fa311690ec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:59.421338 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33740fa-a068-4adc-b56c-9fa311690ec6 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:59.421619 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33740fa-a068-4adc-b56c-9fa311690ec6 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:59.421888 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33740fa-a068-4adc-b56c-9fa311690ec6 None admin] PATH_INFO: `/v3/domains` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:59.422609 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33740fa-a068-4adc-b56c-9fa311690ec6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 13:59:59.422910 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33740fa-a068-4adc-b56c-9fa311690ec6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:59.424281 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33740fa-a068-4adc-b56c-9fa311690ec6 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:59.436515 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 271/531] 10.222.0.36 () {56 vars in 1109 bytes} [Tue May 3 13:59:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 13:59:59.437436 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b54713-6903-4081-8932-613b106b7da2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:59.437654 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33740fa-a068-4adc-b56c-9fa311690ec6 None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:59.438080 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b54713-6903-4081-8932-613b106b7da2 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:59.438397 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b54713-6903-4081-8932-613b106b7da2 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:59.438618 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b54713-6903-4081-8932-613b106b7da2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:59.503040 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b54713-6903-4081-8932-613b106b7da2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:59.504510 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b54713-6903-4081-8932-613b106b7da2 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:59.535246 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33740fa-a068-4adc-b56c-9fa311690ec6 None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:59.568279 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5388bbc-18d5-4a1e-8243-fe975eb19a84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:59.568988 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5388bbc-18d5-4a1e-8243-fe975eb19a84 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:59.569266 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5388bbc-18d5-4a1e-8243-fe975eb19a84 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:59.569613 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5388bbc-18d5-4a1e-8243-fe975eb19a84 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:59.570457 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5388bbc-18d5-4a1e-8243-fe975eb19a84 None admin] RBAC: Adding query filter params (role.id=b3902525744e454694820e2ea3b2e563, scope.project.id=de541be478754087934323bdbe41a579, user.id=616de5e7daed46849efc75ad77ea054e) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 13:59:59.570764 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5388bbc-18d5-4a1e-8243-fe975eb19a84 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:59.572194 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5388bbc-18d5-4a1e-8243-fe975eb19a84 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:59.578384 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 272/532] 10.222.0.36 () {56 vars in 1374 bytes} [Tue May 3 13:59:59 2022] GET /identity/v3/role_assignments?user.id=616de5e7daed46849efc75ad77ea054e&scope.project.id=de541be478754087934323bdbe41a579&role.id=b3902525744e454694820e2ea3b2e563 => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 13:59:59.579180 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5388bbc-18d5-4a1e-8243-fe975eb19a84 None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:59.601751 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 261/533] 10.222.0.36 () {58 vars in 1282 bytes} [Tue May 3 13:59:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 03 13:59:59.607424 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b54713-6903-4081-8932-613b106b7da2 None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:59.746198 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5388bbc-18d5-4a1e-8243-fe975eb19a84 None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:59.762918 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b54713-6903-4081-8932-613b106b7da2 None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:59.781681 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b0eb23-69e9-4303-9f74-5028fe432ef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:59.782491 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b0eb23-69e9-4303-9f74-5028fe432ef0 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:59.782769 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b0eb23-69e9-4303-9f74-5028fe432ef0 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:59.783044 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b0eb23-69e9-4303-9f74-5028fe432ef0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:59.790522 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b0eb23-69e9-4303-9f74-5028fe432ef0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:59.791992 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b0eb23-69e9-4303-9f74-5028fe432ef0 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:59.807211 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application [None req-15b0eb23-69e9-4303-9f74-5028fe432ef0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 13:59:59.807211 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 13:59:59.807211 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 13:59:59.807211 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 13:59:59.807211 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 13:59:59.807211 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 13:59:59.807211 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 13:59:59.807211 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 13:59:59.807211 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 13:59:59.807211 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 13:59:59.807211 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 13:59:59.807211 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 13:59:59.807211 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 13:59:59.807211 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 13:59:59.807211 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 13:59:59.808114 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 13:59:59.808114 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 13:59:59.808114 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 13:59:59.808114 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 13:59:59.808114 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 13:59:59.808114 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 13:59:59.808114 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.get_or_create( May 03 13:59:59.808114 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 13:59:59.808114 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application with Lock( May 03 13:59:59.808114 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 13:59:59.808114 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._enter() May 03 13:59:59.808114 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 13:59:59.808114 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 13:59:59.808114 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 13:59:59.808114 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.creator() May 03 13:59:59.808114 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 13:59:59.808114 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application created_value = creator( May 03 13:59:59.809600 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 13:59:59.809600 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 13:59:59.809600 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 13:59:59.809600 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 13:59:59.809600 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 13:59:59.809600 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 13:59:59.809600 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 13:59:59.809600 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application May 03 13:59:59.809600 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 273/534] 10.222.0.36 () {56 vars in 1111 bytes} [Tue May 3 13:59:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 13:59:59.814363 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b0eb23-69e9-4303-9f74-5028fe432ef0 None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:59.833995 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da78901b-aa92-4856-818a-bbc92d5c8ef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:59.834806 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da78901b-aa92-4856-818a-bbc92d5c8ef4 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:59.835081 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da78901b-aa92-4856-818a-bbc92d5c8ef4 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:59.835348 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da78901b-aa92-4856-818a-bbc92d5c8ef4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:59.858749 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da78901b-aa92-4856-818a-bbc92d5c8ef4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:59.860227 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da78901b-aa92-4856-818a-bbc92d5c8ef4 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:59.905589 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application [None req-da78901b-aa92-4856-818a-bbc92d5c8ef4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 13:59:59.905589 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 13:59:59.905589 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 13:59:59.905589 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 13:59:59.905589 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 13:59:59.905589 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 13:59:59.905589 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 13:59:59.905589 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 13:59:59.905589 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 13:59:59.905589 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 13:59:59.905589 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 13:59:59.905589 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 13:59:59.905589 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 13:59:59.905589 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 13:59:59.905589 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 13:59:59.906598 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 13:59:59.906598 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 13:59:59.906598 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 13:59:59.906598 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 13:59:59.906598 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 13:59:59.906598 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 13:59:59.906598 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.get_or_create( May 03 13:59:59.906598 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 13:59:59.906598 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application with Lock( May 03 13:59:59.906598 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 13:59:59.906598 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._enter() May 03 13:59:59.906598 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 13:59:59.906598 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 13:59:59.906598 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 13:59:59.906598 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.creator() May 03 13:59:59.906598 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 13:59:59.906598 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application created_value = creator( May 03 13:59:59.907896 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 13:59:59.907896 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 13:59:59.907896 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 13:59:59.907896 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application May 03 13:59:59.907896 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 262/535] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 3 13:59:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 13:59:59.913652 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da78901b-aa92-4856-818a-bbc92d5c8ef4 None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 13:59:59.934781 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b0eb23-69e9-4303-9f74-5028fe432ef0 None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 13:59:59.968893 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d9e751-a2da-4de9-a0c3-8393992aede8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 13:59:59.969585 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d9e751-a2da-4de9-a0c3-8393992aede8 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 13:59:59.969916 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d9e751-a2da-4de9-a0c3-8393992aede8 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 13:59:59.970194 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d9e751-a2da-4de9-a0c3-8393992aede8 None admin] PATH_INFO: `/v3/projects` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 13:59:59.971038 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d9e751-a2da-4de9-a0c3-8393992aede8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 13:59:59.971391 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d9e751-a2da-4de9-a0c3-8393992aede8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 13:59:59.972860 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d9e751-a2da-4de9-a0c3-8393992aede8 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 13:59:59.985204 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 274/536] 10.222.0.36 () {56 vars in 1148 bytes} [Tue May 3 13:59:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 13:59:59.990974 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d9e751-a2da-4de9-a0c3-8393992aede8 None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:00.124932 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d9e751-a2da-4de9-a0c3-8393992aede8 None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:00.140735 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da78901b-aa92-4856-818a-bbc92d5c8ef4 None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:00.178043 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b811758-0bef-400d-94f9-5f6df9641195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:00.178718 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b811758-0bef-400d-94f9-5f6df9641195 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:00.179000 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b811758-0bef-400d-94f9-5f6df9641195 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:00.179278 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b811758-0bef-400d-94f9-5f6df9641195 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:00.180119 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b811758-0bef-400d-94f9-5f6df9641195 None admin] RBAC: Adding query filter params (role.id=b3902525744e454694820e2ea3b2e563, scope.project.id=de541be478754087934323bdbe41a579, user.id=5b014f4c7ba1414cb8a597f5bc4033f7) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:00:00.180430 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b811758-0bef-400d-94f9-5f6df9641195 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:00.181910 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b811758-0bef-400d-94f9-5f6df9641195 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:00.187139 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d49004b-6a53-4241-9e19-ae08ec08ea50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:00.187791 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d49004b-6a53-4241-9e19-ae08ec08ea50 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:00.188070 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d49004b-6a53-4241-9e19-ae08ec08ea50 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:00.188172 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 275/537] 10.222.0.36 () {56 vars in 1374 bytes} [Tue May 3 13:59:59 2022] GET /identity/v3/role_assignments?user.id=5b014f4c7ba1414cb8a597f5bc4033f7&scope.project.id=de541be478754087934323bdbe41a579&role.id=b3902525744e454694820e2ea3b2e563 => generated 259 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 14:00:00.188343 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d49004b-6a53-4241-9e19-ae08ec08ea50 None admin] PATH_INFO: `/v3/domains` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:00.189059 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d49004b-6a53-4241-9e19-ae08ec08ea50 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80012) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:00:00.189397 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d49004b-6a53-4241-9e19-ae08ec08ea50 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:00.190811 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d49004b-6a53-4241-9e19-ae08ec08ea50 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:00.204546 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 263/538] 10.222.0.36 () {56 vars in 1109 bytes} [Tue May 3 13:59:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 14:00:00.210006 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b811758-0bef-400d-94f9-5f6df9641195 None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:00.354991 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b811758-0bef-400d-94f9-5f6df9641195 None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:00.392792 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19ae1ae-b71c-4e3f-bc8d-ad8b05c28786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:00.393633 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19ae1ae-b71c-4e3f-bc8d-ad8b05c28786 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:00.393908 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19ae1ae-b71c-4e3f-bc8d-ad8b05c28786 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:00.394173 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19ae1ae-b71c-4e3f-bc8d-ad8b05c28786 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:00.404336 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19ae1ae-b71c-4e3f-bc8d-ad8b05c28786 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:00.405847 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19ae1ae-b71c-4e3f-bc8d-ad8b05c28786 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:00.422842 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application [None req-f19ae1ae-b71c-4e3f-bc8d-ad8b05c28786 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 14:00:00.422842 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:00:00.422842 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 14:00:00.422842 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 14:00:00.422842 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 14:00:00.422842 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 14:00:00.422842 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 14:00:00.422842 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 14:00:00.422842 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 14:00:00.422842 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 14:00:00.422842 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 14:00:00.422842 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 14:00:00.422842 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 14:00:00.422842 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 14:00:00.422842 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 14:00:00.425138 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 14:00:00.425138 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 14:00:00.425138 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 14:00:00.425138 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 14:00:00.425138 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 14:00:00.425138 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 14:00:00.425138 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.get_or_create( May 03 14:00:00.425138 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 14:00:00.425138 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application with Lock( May 03 14:00:00.425138 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 14:00:00.425138 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._enter() May 03 14:00:00.425138 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 14:00:00.425138 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 14:00:00.425138 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 14:00:00.425138 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.creator() May 03 14:00:00.425138 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 14:00:00.425138 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application created_value = creator( May 03 14:00:00.427211 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 14:00:00.427211 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 14:00:00.427211 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 14:00:00.427211 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 14:00:00.427211 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 14:00:00.427211 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 14:00:00.427211 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 14:00:00.427211 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application May 03 14:00:00.427211 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 276/539] 10.222.0.36 () {56 vars in 1111 bytes} [Tue May 3 14:00:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 14:00:00.434386 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d49004b-6a53-4241-9e19-ae08ec08ea50 None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:00.541527 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d49004b-6a53-4241-9e19-ae08ec08ea50 None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:00.578567 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6073f77-78e7-4738-a8ec-e95cc84e0d21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:00.579625 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6073f77-78e7-4738-a8ec-e95cc84e0d21 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:00.580116 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6073f77-78e7-4738-a8ec-e95cc84e0d21 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:00.580578 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6073f77-78e7-4738-a8ec-e95cc84e0d21 None admin] PATH_INFO: `/v3/projects` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:00.581611 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6073f77-78e7-4738-a8ec-e95cc84e0d21 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80012) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:00:00.582160 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6073f77-78e7-4738-a8ec-e95cc84e0d21 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:00.583978 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6073f77-78e7-4738-a8ec-e95cc84e0d21 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:00.597700 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 264/540] 10.222.0.36 () {56 vars in 1148 bytes} [Tue May 3 14:00:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:00:00.605497 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19ae1ae-b71c-4e3f-bc8d-ad8b05c28786 None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:00.741645 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19ae1ae-b71c-4e3f-bc8d-ad8b05c28786 None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:00.780817 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abfd1d1-f3b5-4cc9-943a-66332a9a7027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:00.781498 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abfd1d1-f3b5-4cc9-943a-66332a9a7027 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:00.781778 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abfd1d1-f3b5-4cc9-943a-66332a9a7027 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:00.782048 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abfd1d1-f3b5-4cc9-943a-66332a9a7027 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:00.782876 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abfd1d1-f3b5-4cc9-943a-66332a9a7027 None admin] RBAC: Adding query filter params (role.id=b3902525744e454694820e2ea3b2e563, scope.project.id=de541be478754087934323bdbe41a579, user.id=937bea4f355144b4a7ee11baabc3a4cb) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:00:00.783179 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abfd1d1-f3b5-4cc9-943a-66332a9a7027 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:00.784605 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abfd1d1-f3b5-4cc9-943a-66332a9a7027 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:00.797452 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 277/541] 10.222.0.36 () {56 vars in 1374 bytes} [Tue May 3 14:00:00 2022] GET /identity/v3/role_assignments?user.id=937bea4f355144b4a7ee11baabc3a4cb&scope.project.id=de541be478754087934323bdbe41a579&role.id=b3902525744e454694820e2ea3b2e563 => generated 259 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:00:01.490988 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245e9f8f-5ea1-4a73-8f32-962486874cd2 None None] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:01.492020 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245e9f8f-5ea1-4a73-8f32-962486874cd2 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:01.492510 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245e9f8f-5ea1-4a73-8f32-962486874cd2 None None] PATH_INFO: `/` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:01.494377 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 265/542] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 3 14:00:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 14:00:01.499944 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc0c3ba-8714-4a10-b902-c953ac7f0d84 None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:01.500373 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc0c3ba-8714-4a10-b902-c953ac7f0d84 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:01.500550 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc0c3ba-8714-4a10-b902-c953ac7f0d84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:01.521659 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-fbc0c3ba-8714-4a10-b902-c953ac7f0d84 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:00:01.522852 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-fbc0c3ba-8714-4a10-b902-c953ac7f0d84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:00:01.608048 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 278/543] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 3 14:00:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 14:00:01.635249 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2c9055-8687-4143-b246-c0a5415d9260 None None] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:01.635552 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2c9055-8687-4143-b246-c0a5415d9260 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:01.635805 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2c9055-8687-4143-b246-c0a5415d9260 None None] PATH_INFO: `/` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:01.637177 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 266/544] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 3 14:00:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 14:00:01.643629 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310b47a7-e1a5-43b7-807f-fa4e53f1e031 None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:01.643995 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310b47a7-e1a5-43b7-807f-fa4e53f1e031 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:01.644188 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310b47a7-e1a5-43b7-807f-fa4e53f1e031 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:01.647103 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2c9055-8687-4143-b246-c0a5415d9260 None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:01.666349 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-310b47a7-e1a5-43b7-807f-fa4e53f1e031 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:00:01.667544 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-310b47a7-e1a5-43b7-807f-fa4e53f1e031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:00:01.793375 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 279/545] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 3 14:00:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 14:00:01.817167 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310b47a7-e1a5-43b7-807f-fa4e53f1e031 None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:01.817534 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2c9055-8687-4143-b246-c0a5415d9260 None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:01.856993 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96602739-f112-4b64-8db0-412e92118570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:01.857979 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96602739-f112-4b64-8db0-412e92118570 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:01.858251 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96602739-f112-4b64-8db0-412e92118570 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:01.858516 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96602739-f112-4b64-8db0-412e92118570 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:01.877058 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96602739-f112-4b64-8db0-412e92118570 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 14:00:01.884923 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application [None req-96602739-f112-4b64-8db0-412e92118570 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 03 14:00:01.884923 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:00:01.884923 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 14:00:01.884923 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 14:00:01.884923 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 14:00:01.884923 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 14:00:01.884923 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 14:00:01.884923 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 14:00:01.884923 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 14:00:01.884923 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 14:00:01.884923 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 14:00:01.884923 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 14:00:01.884923 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 14:00:01.884923 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 14:00:01.884923 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 14:00:01.884923 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 14:00:01.885872 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 14:00:01.885872 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 14:00:01.885872 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 14:00:01.885872 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 14:00:01.885872 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 14:00:01.885872 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 14:00:01.885872 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 14:00:01.885872 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 14:00:01.885872 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 14:00:01.885872 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.get_or_create( May 03 14:00:01.885872 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 14:00:01.885872 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application with Lock( May 03 14:00:01.885872 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 14:00:01.885872 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._enter() May 03 14:00:01.885872 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 14:00:01.885872 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 14:00:01.886689 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 14:00:01.886689 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.creator() May 03 14:00:01.886689 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 14:00:01.886689 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application created_value = creator( May 03 14:00:01.886689 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 14:00:01.886689 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 14:00:01.886689 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 14:00:01.886689 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 14:00:01.886689 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 14:00:01.886689 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 14:00:01.886689 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 03 14:00:01.886689 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application May 03 14:00:01.886689 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 267/546] 10.222.0.36 () {56 vars in 1102 bytes} [Tue May 3 14:00:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 14:00:01.893662 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96602739-f112-4b64-8db0-412e92118570 None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:01.951702 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310b47a7-e1a5-43b7-807f-fa4e53f1e031 None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:01.995797 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a66a22f-f361-4631-8274-0b97c3cadc86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:01.996610 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a66a22f-f361-4631-8274-0b97c3cadc86 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:01.996887 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a66a22f-f361-4631-8274-0b97c3cadc86 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:01.997159 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a66a22f-f361-4631-8274-0b97c3cadc86 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:02.020308 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a66a22f-f361-4631-8274-0b97c3cadc86 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 14:00:02.028045 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application [None req-0a66a22f-f361-4631-8274-0b97c3cadc86 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 03 14:00:02.028045 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:00:02.028045 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 14:00:02.028045 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 14:00:02.028045 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 14:00:02.028045 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 14:00:02.028045 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 14:00:02.028045 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 14:00:02.028045 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 14:00:02.028045 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 14:00:02.028045 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 14:00:02.028045 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 14:00:02.028045 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 14:00:02.028045 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 14:00:02.028045 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 14:00:02.028045 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 14:00:02.029097 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 14:00:02.029097 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 14:00:02.029097 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 14:00:02.029097 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 14:00:02.029097 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 14:00:02.029097 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 14:00:02.029097 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 14:00:02.029097 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 14:00:02.029097 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 14:00:02.029097 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.get_or_create( May 03 14:00:02.029097 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 14:00:02.029097 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application with Lock( May 03 14:00:02.029097 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 14:00:02.029097 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._enter() May 03 14:00:02.029097 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 14:00:02.029097 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 14:00:02.029966 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 14:00:02.029966 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.creator() May 03 14:00:02.029966 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 14:00:02.029966 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application created_value = creator( May 03 14:00:02.029966 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 14:00:02.029966 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 14:00:02.029966 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 14:00:02.029966 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 14:00:02.029966 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 14:00:02.029966 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 14:00:02.029966 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 03 14:00:02.029966 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application May 03 14:00:02.041879 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 280/547] 10.222.0.36 () {56 vars in 1102 bytes} [Tue May 3 14:00:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 14:00:02.048090 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a66a22f-f361-4631-8274-0b97c3cadc86 None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:02.088083 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96602739-f112-4b64-8db0-412e92118570 None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:02.141702 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d710a2a2-c6a2-4001-8405-b73ef1b434fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:02.142393 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d710a2a2-c6a2-4001-8405-b73ef1b434fa None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:02.142672 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d710a2a2-c6a2-4001-8405-b73ef1b434fa None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:02.142945 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d710a2a2-c6a2-4001-8405-b73ef1b434fa None admin] PATH_INFO: `/v3/roles` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:02.143715 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d710a2a2-c6a2-4001-8405-b73ef1b434fa None admin] RBAC: Adding query filter params (name=service) {{(pid=80012) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:00:02.144019 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d710a2a2-c6a2-4001-8405-b73ef1b434fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:02.147632 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d710a2a2-c6a2-4001-8405-b73ef1b434fa None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:02.166374 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 268/548] 10.222.0.36 () {56 vars in 1103 bytes} [Tue May 3 14:00:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 14:00:02.172210 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d710a2a2-c6a2-4001-8405-b73ef1b434fa None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:02.239855 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a66a22f-f361-4631-8274-0b97c3cadc86 None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:02.272988 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc6b547-c666-40c7-ba10-e5239a84602d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:02.273751 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc6b547-c666-40c7-ba10-e5239a84602d None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:02.274034 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc6b547-c666-40c7-ba10-e5239a84602d None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:02.274308 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc6b547-c666-40c7-ba10-e5239a84602d None admin] PATH_INFO: `/v3/roles` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:02.275064 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc6b547-c666-40c7-ba10-e5239a84602d None admin] RBAC: Adding query filter params (name=service) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:00:02.275353 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc6b547-c666-40c7-ba10-e5239a84602d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:02.281310 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc6b547-c666-40c7-ba10-e5239a84602d None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:02.289390 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 281/549] 10.222.0.36 () {56 vars in 1103 bytes} [Tue May 3 14:00:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:00:02.290735 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc6b547-c666-40c7-ba10-e5239a84602d None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:02.362741 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d710a2a2-c6a2-4001-8405-b73ef1b434fa None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:02.395145 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1116600-ee56-40c4-ba75-9693f89a09b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:02.395591 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc6b547-c666-40c7-ba10-e5239a84602d None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:02.395944 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1116600-ee56-40c4-ba75-9693f89a09b6 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:02.396223 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1116600-ee56-40c4-ba75-9693f89a09b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:02.396497 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1116600-ee56-40c4-ba75-9693f89a09b6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:02.409645 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1116600-ee56-40c4-ba75-9693f89a09b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:02.411898 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1116600-ee56-40c4-ba75-9693f89a09b6 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:02.431016 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352e59d9-4361-4b27-aef0-1ea1bf78dd81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:02.431852 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352e59d9-4361-4b27-aef0-1ea1bf78dd81 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:02.432161 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352e59d9-4361-4b27-aef0-1ea1bf78dd81 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:02.432434 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352e59d9-4361-4b27-aef0-1ea1bf78dd81 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:02.432870 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application [None req-e1116600-ee56-40c4-ba75-9693f89a09b6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 14:00:02.432870 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:00:02.432870 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 14:00:02.432870 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 14:00:02.432870 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 14:00:02.432870 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 14:00:02.432870 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 14:00:02.432870 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 14:00:02.432870 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 14:00:02.432870 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 14:00:02.432870 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 14:00:02.432870 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 14:00:02.432870 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 14:00:02.432870 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 14:00:02.432870 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 14:00:02.433740 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 14:00:02.433740 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 14:00:02.433740 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 14:00:02.433740 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 14:00:02.433740 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 14:00:02.433740 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 14:00:02.433740 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.get_or_create( May 03 14:00:02.433740 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 14:00:02.433740 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application with Lock( May 03 14:00:02.433740 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 14:00:02.433740 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._enter() May 03 14:00:02.433740 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 14:00:02.433740 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 14:00:02.433740 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 14:00:02.433740 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.creator() May 03 14:00:02.433740 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 14:00:02.433740 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application created_value = creator( May 03 14:00:02.434616 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 14:00:02.434616 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 14:00:02.434616 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 14:00:02.434616 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application May 03 14:00:02.434616 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 269/550] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 3 14:00:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 14:00:02.441308 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4302c979-eef3-428d-a5ad-5bd40e5d685f None None] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:02.441308 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4302c979-eef3-428d-a5ad-5bd40e5d685f None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:02.441308 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4302c979-eef3-428d-a5ad-5bd40e5d685f None None] PATH_INFO: `/` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:02.441308 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 270/551] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 3 14:00:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 14:00:02.446401 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4302c979-eef3-428d-a5ad-5bd40e5d685f None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:02.452337 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352e59d9-4361-4b27-aef0-1ea1bf78dd81 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:02.453832 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352e59d9-4361-4b27-aef0-1ea1bf78dd81 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:02.475716 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application [None req-352e59d9-4361-4b27-aef0-1ea1bf78dd81 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 14:00:02.475716 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:00:02.475716 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 14:00:02.475716 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 14:00:02.475716 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 14:00:02.475716 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 14:00:02.475716 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 14:00:02.475716 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 14:00:02.475716 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 14:00:02.475716 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 14:00:02.475716 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 14:00:02.475716 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 14:00:02.475716 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 14:00:02.475716 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 14:00:02.475716 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 14:00:02.477230 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 14:00:02.477230 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 14:00:02.477230 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 14:00:02.477230 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 14:00:02.477230 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 14:00:02.477230 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 14:00:02.477230 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.get_or_create( May 03 14:00:02.477230 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 14:00:02.477230 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application with Lock( May 03 14:00:02.477230 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 14:00:02.477230 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._enter() May 03 14:00:02.477230 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 14:00:02.477230 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 14:00:02.477230 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 14:00:02.477230 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.creator() May 03 14:00:02.477230 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 14:00:02.477230 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application created_value = creator( May 03 14:00:02.478932 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 14:00:02.478932 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 14:00:02.478932 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 14:00:02.478932 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application May 03 14:00:02.481391 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 282/552] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 3 14:00:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 14:00:02.482776 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b9b483-3551-49ad-a84c-880601f77f4a None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:02.483117 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b9b483-3551-49ad-a84c-880601f77f4a None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:02.483388 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b9b483-3551-49ad-a84c-880601f77f4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:02.502735 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-69b9b483-3551-49ad-a84c-880601f77f4a None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:00:02.503897 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-69b9b483-3551-49ad-a84c-880601f77f4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:00:02.566864 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4302c979-eef3-428d-a5ad-5bd40e5d685f None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:02.585563 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 283/553] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 3 14:00:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 14:00:02.586481 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b9b483-3551-49ad-a84c-880601f77f4a None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:02.600577 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f55856-1f9a-42b1-a49f-048addcfaafb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:02.601319 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f55856-1f9a-42b1-a49f-048addcfaafb None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:02.601612 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f55856-1f9a-42b1-a49f-048addcfaafb None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:02.601882 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f55856-1f9a-42b1-a49f-048addcfaafb None admin] PATH_INFO: `/v3/domains` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:02.602639 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f55856-1f9a-42b1-a49f-048addcfaafb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80012) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:00:02.602942 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f55856-1f9a-42b1-a49f-048addcfaafb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:02.604441 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f55856-1f9a-42b1-a49f-048addcfaafb None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:02.616991 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 271/554] 10.222.0.36 () {56 vars in 1109 bytes} [Tue May 3 14:00:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:00:02.622045 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f55856-1f9a-42b1-a49f-048addcfaafb None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:02.724734 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b9b483-3551-49ad-a84c-880601f77f4a None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:02.726211 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f55856-1f9a-42b1-a49f-048addcfaafb None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:02.762302 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a482fea3-00e9-4a96-b939-0cc33f1e0897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:02.763148 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a482fea3-00e9-4a96-b939-0cc33f1e0897 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:02.763485 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a482fea3-00e9-4a96-b939-0cc33f1e0897 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:02.763754 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a482fea3-00e9-4a96-b939-0cc33f1e0897 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:02.767953 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4362108e-ba5b-4538-944f-3f049dfcc5f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:02.768762 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4362108e-ba5b-4538-944f-3f049dfcc5f4 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:02.769179 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4362108e-ba5b-4538-944f-3f049dfcc5f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:02.769484 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4362108e-ba5b-4538-944f-3f049dfcc5f4 None admin] PATH_INFO: `/v3/domains` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:02.770214 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4362108e-ba5b-4538-944f-3f049dfcc5f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:00:02.770518 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4362108e-ba5b-4538-944f-3f049dfcc5f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:02.772457 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4362108e-ba5b-4538-944f-3f049dfcc5f4 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:02.774114 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a482fea3-00e9-4a96-b939-0cc33f1e0897 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 14:00:02.782075 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application [None req-a482fea3-00e9-4a96-b939-0cc33f1e0897 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 03 14:00:02.782075 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:00:02.782075 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 14:00:02.782075 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 14:00:02.782075 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 14:00:02.782075 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 14:00:02.782075 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 14:00:02.782075 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 14:00:02.782075 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 14:00:02.782075 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 14:00:02.782075 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 14:00:02.782075 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 14:00:02.782075 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 14:00:02.782075 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 14:00:02.782075 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 14:00:02.782075 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 14:00:02.784258 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 14:00:02.784258 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 14:00:02.784258 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 14:00:02.784258 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 14:00:02.784258 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 14:00:02.784258 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 14:00:02.784258 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 14:00:02.784258 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 14:00:02.784258 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 14:00:02.784258 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.get_or_create( May 03 14:00:02.784258 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 14:00:02.784258 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application with Lock( May 03 14:00:02.784258 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 14:00:02.784258 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._enter() May 03 14:00:02.784258 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 14:00:02.784258 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 14:00:02.786254 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 14:00:02.786254 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.creator() May 03 14:00:02.786254 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 14:00:02.786254 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application created_value = creator( May 03 14:00:02.786254 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 14:00:02.786254 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 14:00:02.786254 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 14:00:02.786254 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 14:00:02.786254 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 14:00:02.786254 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 14:00:02.786254 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 03 14:00:02.786254 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application May 03 14:00:02.786254 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 272/555] 10.222.0.36 () {56 vars in 1102 bytes} [Tue May 3 14:00:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 14:00:02.786254 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a482fea3-00e9-4a96-b939-0cc33f1e0897 None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:02.790554 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 284/556] 10.222.0.36 () {56 vars in 1109 bytes} [Tue May 3 14:00:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:00:02.791458 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4362108e-ba5b-4538-944f-3f049dfcc5f4 None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:02.892541 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a482fea3-00e9-4a96-b939-0cc33f1e0897 None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:02.916319 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4362108e-ba5b-4538-944f-3f049dfcc5f4 None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:02.928665 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2decc833-11ea-4a49-985c-1885eb8e5828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:02.929491 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2decc833-11ea-4a49-985c-1885eb8e5828 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:02.929768 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2decc833-11ea-4a49-985c-1885eb8e5828 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:02.930024 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2decc833-11ea-4a49-985c-1885eb8e5828 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:02.937559 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2decc833-11ea-4a49-985c-1885eb8e5828 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:02.939234 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2decc833-11ea-4a49-985c-1885eb8e5828 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:02.948130 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da44a909-1577-4b5f-a483-2f5c5cf59a8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:02.948794 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da44a909-1577-4b5f-a483-2f5c5cf59a8f None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:02.949071 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da44a909-1577-4b5f-a483-2f5c5cf59a8f None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:02.949367 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da44a909-1577-4b5f-a483-2f5c5cf59a8f None admin] PATH_INFO: `/v3/roles` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:02.950106 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da44a909-1577-4b5f-a483-2f5c5cf59a8f None admin] RBAC: Adding query filter params (name=service) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:00:02.950407 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da44a909-1577-4b5f-a483-2f5c5cf59a8f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:02.952084 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da44a909-1577-4b5f-a483-2f5c5cf59a8f None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:02.953195 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application [None req-2decc833-11ea-4a49-985c-1885eb8e5828 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 03 14:00:02.953195 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:00:02.953195 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 14:00:02.953195 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 14:00:02.953195 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 14:00:02.953195 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 14:00:02.953195 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 14:00:02.953195 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 14:00:02.953195 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 14:00:02.953195 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 14:00:02.953195 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 14:00:02.953195 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 14:00:02.953195 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 14:00:02.953195 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 14:00:02.953195 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 14:00:02.953195 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 14:00:02.954349 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 14:00:02.954349 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 14:00:02.954349 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 14:00:02.954349 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 14:00:02.954349 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 14:00:02.954349 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 14:00:02.954349 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 14:00:02.954349 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 14:00:02.954349 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 14:00:02.954349 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.get_or_create( May 03 14:00:02.954349 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 14:00:02.954349 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application with Lock( May 03 14:00:02.954349 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 14:00:02.954349 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._enter() May 03 14:00:02.954349 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 14:00:02.954349 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 14:00:02.954349 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 14:00:02.954349 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.creator() May 03 14:00:02.955378 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 14:00:02.955378 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application created_value = creator( May 03 14:00:02.955378 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 14:00:02.955378 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 14:00:02.955378 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 14:00:02.955378 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 14:00:02.955378 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 14:00:02.955378 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 14:00:02.955378 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 03 14:00:02.955378 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application May 03 14:00:02.955378 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 273/557] 10.222.0.36 () {56 vars in 1096 bytes} [Tue May 3 14:00:02 2022] GET /identity/v3/users/swift => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 14:00:02.955378 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2decc833-11ea-4a49-985c-1885eb8e5828 None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:02.966131 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 285/558] 10.222.0.36 () {56 vars in 1103 bytes} [Tue May 3 14:00:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:00:02.967808 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5db46f-f06b-45e3-ab25-cad2c281eace None None] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:02.968163 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5db46f-f06b-45e3-ab25-cad2c281eace None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:02.968502 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5db46f-f06b-45e3-ab25-cad2c281eace None None] PATH_INFO: `/` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:02.969949 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 286/559] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 3 14:00:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 14:00:02.974581 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5db46f-f06b-45e3-ab25-cad2c281eace None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:03.055089 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2decc833-11ea-4a49-985c-1885eb8e5828 None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:03.082427 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5db46f-f06b-45e3-ab25-cad2c281eace None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:03.088042 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb61eb2-da7f-4f98-b9f6-3a02ea45e634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:03.089144 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb61eb2-da7f-4f98-b9f6-3a02ea45e634 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:03.089463 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb61eb2-da7f-4f98-b9f6-3a02ea45e634 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:03.089735 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb61eb2-da7f-4f98-b9f6-3a02ea45e634 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:03.097856 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb61eb2-da7f-4f98-b9f6-3a02ea45e634 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:03.099301 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb61eb2-da7f-4f98-b9f6-3a02ea45e634 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:03.113185 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application [None req-abb61eb2-da7f-4f98-b9f6-3a02ea45e634 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 03 14:00:03.113185 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:00:03.113185 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 14:00:03.113185 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 14:00:03.113185 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 14:00:03.113185 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 14:00:03.113185 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 14:00:03.113185 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 14:00:03.113185 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 14:00:03.113185 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 14:00:03.113185 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 14:00:03.113185 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 14:00:03.113185 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 14:00:03.113185 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 14:00:03.113185 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 14:00:03.113185 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 14:00:03.114204 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 14:00:03.114204 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 14:00:03.114204 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 14:00:03.114204 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 14:00:03.114204 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 14:00:03.114204 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 14:00:03.114204 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 14:00:03.114204 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 14:00:03.114204 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 14:00:03.114204 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.get_or_create( May 03 14:00:03.114204 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 14:00:03.114204 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application with Lock( May 03 14:00:03.114204 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 14:00:03.114204 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._enter() May 03 14:00:03.114204 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 14:00:03.114204 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 14:00:03.114204 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 14:00:03.114204 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.creator() May 03 14:00:03.115133 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 14:00:03.115133 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application created_value = creator( May 03 14:00:03.115133 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 14:00:03.115133 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 14:00:03.115133 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 14:00:03.115133 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 14:00:03.115133 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 14:00:03.115133 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 14:00:03.115133 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 03 14:00:03.115133 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application May 03 14:00:03.115133 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 274/560] 10.222.0.36 () {56 vars in 1093 bytes} [Tue May 3 14:00:02 2022] GET /identity/v3/users/nova => generated 82 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 14:00:03.115719 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb61eb2-da7f-4f98-b9f6-3a02ea45e634 None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:03.120239 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7df4440-bcce-4f5d-83a6-086bd41b8159 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:03.120920 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7df4440-bcce-4f5d-83a6-086bd41b8159 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:03.121194 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7df4440-bcce-4f5d-83a6-086bd41b8159 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:03.121490 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7df4440-bcce-4f5d-83a6-086bd41b8159 None admin] PATH_INFO: `/v3/users` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:03.122325 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7df4440-bcce-4f5d-83a6-086bd41b8159 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:00:03.122727 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7df4440-bcce-4f5d-83a6-086bd41b8159 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:03.124144 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7df4440-bcce-4f5d-83a6-086bd41b8159 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:03.141664 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 287/561] 10.222.0.36 () {56 vars in 1135 bytes} [Tue May 3 14:00:02 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:00:03.147549 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e1a3f0-565d-4c6e-8148-ae26a5359fcc None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:03.147807 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e1a3f0-565d-4c6e-8148-ae26a5359fcc None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:03.148048 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e1a3f0-565d-4c6e-8148-ae26a5359fcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:03.164492 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-70e1a3f0-565d-4c6e-8148-ae26a5359fcc None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:00:03.166154 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-70e1a3f0-565d-4c6e-8148-ae26a5359fcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:00:03.214824 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb61eb2-da7f-4f98-b9f6-3a02ea45e634 None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:03.232764 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 288/562] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 3 14:00:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 14:00:03.233975 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e1a3f0-565d-4c6e-8148-ae26a5359fcc None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:03.262498 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbe3f81-a520-4763-b2ce-8be37ffddbc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:03.263917 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbe3f81-a520-4763-b2ce-8be37ffddbc2 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:03.264300 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbe3f81-a520-4763-b2ce-8be37ffddbc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:03.264610 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbe3f81-a520-4763-b2ce-8be37ffddbc2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:03.274930 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbe3f81-a520-4763-b2ce-8be37ffddbc2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:03.276428 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbe3f81-a520-4763-b2ce-8be37ffddbc2 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:03.293550 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application [None req-abbe3f81-a520-4763-b2ce-8be37ffddbc2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 14:00:03.293550 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:00:03.293550 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 14:00:03.293550 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 14:00:03.293550 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 14:00:03.293550 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 14:00:03.293550 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 14:00:03.293550 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 14:00:03.293550 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 14:00:03.293550 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 14:00:03.293550 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 14:00:03.293550 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 14:00:03.293550 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 14:00:03.293550 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 14:00:03.293550 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 14:00:03.295064 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 14:00:03.295064 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 14:00:03.295064 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 14:00:03.295064 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 14:00:03.295064 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 14:00:03.295064 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 14:00:03.295064 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.get_or_create( May 03 14:00:03.295064 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 14:00:03.295064 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application with Lock( May 03 14:00:03.295064 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 14:00:03.295064 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._enter() May 03 14:00:03.295064 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 14:00:03.295064 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 14:00:03.295064 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 14:00:03.295064 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.creator() May 03 14:00:03.295064 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 14:00:03.295064 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application created_value = creator( May 03 14:00:03.296128 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 14:00:03.296128 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 14:00:03.296128 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 14:00:03.296128 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application May 03 14:00:03.296128 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 275/563] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 3 14:00:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 14:00:03.296128 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbe3f81-a520-4763-b2ce-8be37ffddbc2 None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:03.335827 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e1a3f0-565d-4c6e-8148-ae26a5359fcc None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:03.368578 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9086be9f-1e17-4e73-b085-53cafded58a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:03.369249 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9086be9f-1e17-4e73-b085-53cafded58a6 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:03.369552 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9086be9f-1e17-4e73-b085-53cafded58a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:03.369819 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9086be9f-1e17-4e73-b085-53cafded58a6 None admin] PATH_INFO: `/v3/users` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:03.370638 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9086be9f-1e17-4e73-b085-53cafded58a6 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:00:03.370953 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9086be9f-1e17-4e73-b085-53cafded58a6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:03.372386 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9086be9f-1e17-4e73-b085-53cafded58a6 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:03.389395 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 289/564] 10.222.0.36 () {56 vars in 1133 bytes} [Tue May 3 14:00:03 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:00:03.390279 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9086be9f-1e17-4e73-b085-53cafded58a6 None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:03.405064 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbe3f81-a520-4763-b2ce-8be37ffddbc2 None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:03.436714 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb54aac8-043e-4300-9ca3-6059d035d67c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:03.437397 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb54aac8-043e-4300-9ca3-6059d035d67c None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:03.437682 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb54aac8-043e-4300-9ca3-6059d035d67c None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:03.437950 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb54aac8-043e-4300-9ca3-6059d035d67c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:03.483787 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9086be9f-1e17-4e73-b085-53cafded58a6 None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:03.500825 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb54aac8-043e-4300-9ca3-6059d035d67c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:03.502300 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb54aac8-043e-4300-9ca3-6059d035d67c None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:03.515766 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf58cd57-cc18-4719-b965-dc80a3c081b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:03.516561 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf58cd57-cc18-4719-b965-dc80a3c081b7 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:03.516834 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf58cd57-cc18-4719-b965-dc80a3c081b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:03.517112 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf58cd57-cc18-4719-b965-dc80a3c081b7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:03.526860 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf58cd57-cc18-4719-b965-dc80a3c081b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 14:00:03.534845 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application [None req-bf58cd57-cc18-4719-b965-dc80a3c081b7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 03 14:00:03.534845 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:00:03.534845 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 14:00:03.534845 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 14:00:03.534845 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 14:00:03.534845 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 14:00:03.534845 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 14:00:03.534845 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 14:00:03.534845 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 14:00:03.534845 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 14:00:03.534845 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 14:00:03.534845 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 14:00:03.534845 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 14:00:03.534845 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 14:00:03.534845 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 14:00:03.534845 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 14:00:03.535779 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 14:00:03.535779 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 14:00:03.535779 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 14:00:03.535779 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 14:00:03.535779 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 14:00:03.535779 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 14:00:03.535779 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 14:00:03.535779 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 14:00:03.535779 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 14:00:03.535779 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.get_or_create( May 03 14:00:03.535779 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 14:00:03.535779 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application with Lock( May 03 14:00:03.535779 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 14:00:03.535779 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._enter() May 03 14:00:03.535779 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 14:00:03.535779 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 14:00:03.536786 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 14:00:03.536786 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.creator() May 03 14:00:03.536786 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 14:00:03.536786 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application created_value = creator( May 03 14:00:03.536786 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 14:00:03.536786 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 14:00:03.536786 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 14:00:03.536786 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 14:00:03.536786 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 14:00:03.536786 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 14:00:03.536786 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 03 14:00:03.536786 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application May 03 14:00:03.536786 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 290/565] 10.222.0.36 () {56 vars in 1102 bytes} [Tue May 3 14:00:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 14:00:03.536786 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf58cd57-cc18-4719-b965-dc80a3c081b7 None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:03.595986 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 276/566] 10.222.0.36 () {58 vars in 1282 bytes} [Tue May 3 14:00:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 03 14:00:03.596805 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb54aac8-043e-4300-9ca3-6059d035d67c None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:03.633744 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf58cd57-cc18-4719-b965-dc80a3c081b7 None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:03.666757 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43d41be-0bc5-4152-a14f-f05d1a557628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:03.667336 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43d41be-0bc5-4152-a14f-f05d1a557628 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:03.667610 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43d41be-0bc5-4152-a14f-f05d1a557628 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:03.667873 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43d41be-0bc5-4152-a14f-f05d1a557628 None admin] PATH_INFO: `/v3/domains` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:03.668583 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43d41be-0bc5-4152-a14f-f05d1a557628 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:00:03.668881 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43d41be-0bc5-4152-a14f-f05d1a557628 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:03.670440 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43d41be-0bc5-4152-a14f-f05d1a557628 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:03.681564 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 291/567] 10.222.0.36 () {56 vars in 1109 bytes} [Tue May 3 14:00:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:00:03.682843 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57433a27-8c32-490d-862b-72047302e6b3 None None] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:03.683114 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57433a27-8c32-490d-862b-72047302e6b3 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:03.683405 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57433a27-8c32-490d-862b-72047302e6b3 None None] PATH_INFO: `/` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:03.686239 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 292/568] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 3 14:00:03 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 14:00:03.686239 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57433a27-8c32-490d-862b-72047302e6b3 None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:03.694324 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb54aac8-043e-4300-9ca3-6059d035d67c None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:03.726855 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1aded84-8395-4fc5-9107-e368001154da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:03.727618 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aded84-8395-4fc5-9107-e368001154da None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:03.727877 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aded84-8395-4fc5-9107-e368001154da None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:03.728165 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aded84-8395-4fc5-9107-e368001154da None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:03.737778 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1aded84-8395-4fc5-9107-e368001154da None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:03.739198 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1aded84-8395-4fc5-9107-e368001154da None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:03.758637 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application [None req-e1aded84-8395-4fc5-9107-e368001154da None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 14:00:03.758637 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:00:03.758637 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 14:00:03.758637 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 14:00:03.758637 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 14:00:03.758637 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 14:00:03.758637 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 14:00:03.758637 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 14:00:03.758637 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 14:00:03.758637 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 14:00:03.758637 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 14:00:03.758637 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 14:00:03.758637 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 14:00:03.758637 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 14:00:03.758637 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 14:00:03.759674 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 14:00:03.759674 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 14:00:03.759674 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 14:00:03.759674 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 14:00:03.759674 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 14:00:03.759674 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 14:00:03.759674 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.get_or_create( May 03 14:00:03.759674 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 14:00:03.759674 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application with Lock( May 03 14:00:03.759674 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 14:00:03.759674 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._enter() May 03 14:00:03.759674 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 14:00:03.759674 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 14:00:03.759674 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 14:00:03.759674 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.creator() May 03 14:00:03.759674 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 14:00:03.759674 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application created_value = creator( May 03 14:00:03.760572 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 14:00:03.760572 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 14:00:03.760572 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 14:00:03.760572 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application May 03 14:00:03.760572 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 277/569] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 3 14:00:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 14:00:03.760572 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1aded84-8395-4fc5-9107-e368001154da None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:03.787176 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57433a27-8c32-490d-862b-72047302e6b3 None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:03.821032 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c31c10f-8f90-4e07-9cca-e94c44da4baa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:03.821719 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c31c10f-8f90-4e07-9cca-e94c44da4baa None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:03.821993 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c31c10f-8f90-4e07-9cca-e94c44da4baa None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:03.822262 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c31c10f-8f90-4e07-9cca-e94c44da4baa None admin] PATH_INFO: `/v3/roles` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:03.822999 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c31c10f-8f90-4e07-9cca-e94c44da4baa None admin] RBAC: Adding query filter params (name=service) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:00:03.823278 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c31c10f-8f90-4e07-9cca-e94c44da4baa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:03.824639 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c31c10f-8f90-4e07-9cca-e94c44da4baa None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:03.832415 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 293/570] 10.222.0.36 () {56 vars in 1103 bytes} [Tue May 3 14:00:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:00:03.833170 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c31c10f-8f90-4e07-9cca-e94c44da4baa None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:03.854348 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1aded84-8395-4fc5-9107-e368001154da None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:03.885862 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8eee7b3-e732-4225-870e-fbd653b5093e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:03.886651 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eee7b3-e732-4225-870e-fbd653b5093e None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:03.886932 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eee7b3-e732-4225-870e-fbd653b5093e None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:03.887202 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eee7b3-e732-4225-870e-fbd653b5093e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:03.896760 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8eee7b3-e732-4225-870e-fbd653b5093e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:03.898254 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8eee7b3-e732-4225-870e-fbd653b5093e None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:03.915188 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application [None req-c8eee7b3-e732-4225-870e-fbd653b5093e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 14:00:03.915188 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:00:03.915188 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 14:00:03.915188 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 14:00:03.915188 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 14:00:03.915188 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 14:00:03.915188 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 14:00:03.915188 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 14:00:03.915188 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 14:00:03.915188 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 14:00:03.915188 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 14:00:03.915188 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 14:00:03.915188 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 14:00:03.915188 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 14:00:03.915188 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 14:00:03.916184 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 14:00:03.916184 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 14:00:03.916184 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 14:00:03.916184 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 14:00:03.916184 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 14:00:03.916184 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 14:00:03.916184 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.get_or_create( May 03 14:00:03.916184 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 14:00:03.916184 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application with Lock( May 03 14:00:03.916184 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 14:00:03.916184 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._enter() May 03 14:00:03.916184 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 14:00:03.916184 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 14:00:03.916184 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 14:00:03.916184 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.creator() May 03 14:00:03.916184 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 14:00:03.916184 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application created_value = creator( May 03 14:00:03.917639 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 14:00:03.917639 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 14:00:03.917639 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 14:00:03.917639 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application May 03 14:00:03.921074 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 278/571] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 3 14:00:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 14:00:03.922264 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e97eedf-31c9-42d2-9b0f-d8ed265a85e3 None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:03.922571 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e97eedf-31c9-42d2-9b0f-d8ed265a85e3 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:03.922829 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e97eedf-31c9-42d2-9b0f-d8ed265a85e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:03.928493 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c31c10f-8f90-4e07-9cca-e94c44da4baa None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:03.938928 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-6e97eedf-31c9-42d2-9b0f-d8ed265a85e3 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:00:03.940082 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-6e97eedf-31c9-42d2-9b0f-d8ed265a85e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:00:03.960892 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459b135d-8c9c-4e30-accf-77eacdf1b564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:03.961711 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459b135d-8c9c-4e30-accf-77eacdf1b564 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:03.962019 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459b135d-8c9c-4e30-accf-77eacdf1b564 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:03.962268 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459b135d-8c9c-4e30-accf-77eacdf1b564 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:03.970040 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459b135d-8c9c-4e30-accf-77eacdf1b564 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:03.971459 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459b135d-8c9c-4e30-accf-77eacdf1b564 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:03.985189 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application [None req-459b135d-8c9c-4e30-accf-77eacdf1b564 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 03 14:00:03.985189 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:00:03.985189 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 14:00:03.985189 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 14:00:03.985189 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 14:00:03.985189 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 14:00:03.985189 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 14:00:03.985189 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 14:00:03.985189 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 14:00:03.985189 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 14:00:03.985189 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 14:00:03.985189 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 14:00:03.985189 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 14:00:03.985189 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 14:00:03.985189 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 14:00:03.985189 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 14:00:03.986196 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 14:00:03.986196 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 14:00:03.986196 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 14:00:03.986196 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 14:00:03.986196 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 14:00:03.986196 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 14:00:03.986196 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 14:00:03.986196 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 14:00:03.986196 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 14:00:03.986196 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.get_or_create( May 03 14:00:03.986196 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 14:00:03.986196 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application with Lock( May 03 14:00:03.986196 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 14:00:03.986196 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._enter() May 03 14:00:03.986196 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 14:00:03.986196 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 14:00:03.986196 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 14:00:03.986196 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.creator() May 03 14:00:03.987189 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 14:00:03.987189 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application created_value = creator( May 03 14:00:03.987189 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 14:00:03.987189 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 14:00:03.987189 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 14:00:03.987189 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 14:00:03.987189 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 14:00:03.987189 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 14:00:03.987189 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 03 14:00:03.987189 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application May 03 14:00:03.987189 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 294/572] 10.222.0.36 () {56 vars in 1099 bytes} [Tue May 3 14:00:03 2022] GET /identity/v3/users/glance => generated 84 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 14:00:03.987189 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459b135d-8c9c-4e30-accf-77eacdf1b564 None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:04.007406 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 279/573] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 3 14:00:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 14:00:04.012167 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e97eedf-31c9-42d2-9b0f-d8ed265a85e3 None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:04.085346 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459b135d-8c9c-4e30-accf-77eacdf1b564 None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:04.101175 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e97eedf-31c9-42d2-9b0f-d8ed265a85e3 None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:04.116456 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc55b710-4ae5-4fee-a32e-fc2c19bd34d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:04.117116 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc55b710-4ae5-4fee-a32e-fc2c19bd34d8 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:04.117417 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc55b710-4ae5-4fee-a32e-fc2c19bd34d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:04.117692 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc55b710-4ae5-4fee-a32e-fc2c19bd34d8 None admin] PATH_INFO: `/v3/domains` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:04.118398 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc55b710-4ae5-4fee-a32e-fc2c19bd34d8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:00:04.118700 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc55b710-4ae5-4fee-a32e-fc2c19bd34d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:04.120067 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc55b710-4ae5-4fee-a32e-fc2c19bd34d8 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:04.131520 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 295/574] 10.222.0.36 () {56 vars in 1109 bytes} [Tue May 3 14:00:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:00:04.132315 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc55b710-4ae5-4fee-a32e-fc2c19bd34d8 None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:04.134213 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1a7275-feed-45b1-929a-38fc816bf500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:04.134995 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1a7275-feed-45b1-929a-38fc816bf500 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:04.135277 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1a7275-feed-45b1-929a-38fc816bf500 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:04.135546 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1a7275-feed-45b1-929a-38fc816bf500 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:04.146047 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1a7275-feed-45b1-929a-38fc816bf500 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:04.147474 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1a7275-feed-45b1-929a-38fc816bf500 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:04.164392 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application [None req-0a1a7275-feed-45b1-929a-38fc816bf500 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 14:00:04.164392 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:00:04.164392 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 14:00:04.164392 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 14:00:04.164392 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 14:00:04.164392 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 14:00:04.164392 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 14:00:04.164392 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 14:00:04.164392 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 14:00:04.164392 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 14:00:04.164392 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 14:00:04.164392 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 14:00:04.164392 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 14:00:04.164392 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 14:00:04.164392 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 14:00:04.165428 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 14:00:04.165428 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 14:00:04.165428 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 14:00:04.165428 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 14:00:04.165428 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 14:00:04.165428 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 14:00:04.165428 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.get_or_create( May 03 14:00:04.165428 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 14:00:04.165428 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application with Lock( May 03 14:00:04.165428 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 14:00:04.165428 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._enter() May 03 14:00:04.165428 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 14:00:04.165428 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 14:00:04.165428 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 14:00:04.165428 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.creator() May 03 14:00:04.165428 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 14:00:04.165428 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application created_value = creator( May 03 14:00:04.166533 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 14:00:04.166533 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 14:00:04.166533 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 14:00:04.166533 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application May 03 14:00:04.166533 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 280/575] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 3 14:00:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 14:00:04.166533 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1a7275-feed-45b1-929a-38fc816bf500 None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:04.228136 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc55b710-4ae5-4fee-a32e-fc2c19bd34d8 None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:04.263140 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cbead0-91bb-457f-9d39-a8e74950710e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:04.263828 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cbead0-91bb-457f-9d39-a8e74950710e None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:04.264103 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cbead0-91bb-457f-9d39-a8e74950710e None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:04.264199 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1a7275-feed-45b1-929a-38fc816bf500 None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:04.264376 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cbead0-91bb-457f-9d39-a8e74950710e None admin] PATH_INFO: `/v3/domains` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:04.265085 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cbead0-91bb-457f-9d39-a8e74950710e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:00:04.265415 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cbead0-91bb-457f-9d39-a8e74950710e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:04.266793 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cbead0-91bb-457f-9d39-a8e74950710e None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:04.277864 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 296/576] 10.222.0.36 () {56 vars in 1109 bytes} [Tue May 3 14:00:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:00:04.278628 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cbead0-91bb-457f-9d39-a8e74950710e None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:04.296873 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbaa08f-a520-4da9-83a9-6c6585b3a688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:04.297562 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbaa08f-a520-4da9-83a9-6c6585b3a688 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:04.297825 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbaa08f-a520-4da9-83a9-6c6585b3a688 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:04.298088 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbaa08f-a520-4da9-83a9-6c6585b3a688 None admin] PATH_INFO: `/v3/users` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:04.298911 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbaa08f-a520-4da9-83a9-6c6585b3a688 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80012) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:00:04.299212 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbaa08f-a520-4da9-83a9-6c6585b3a688 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:04.300613 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbaa08f-a520-4da9-83a9-6c6585b3a688 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:04.317546 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 281/577] 10.222.0.36 () {56 vars in 1137 bytes} [Tue May 3 14:00:04 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:00:04.318329 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbaa08f-a520-4da9-83a9-6c6585b3a688 None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:04.377268 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cbead0-91bb-457f-9d39-a8e74950710e None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:04.407394 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbaa08f-a520-4da9-83a9-6c6585b3a688 None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:04.411895 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8c003f-63d0-454e-9149-8634d36ddeb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:04.412689 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8c003f-63d0-454e-9149-8634d36ddeb7 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:04.412964 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8c003f-63d0-454e-9149-8634d36ddeb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:04.413231 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8c003f-63d0-454e-9149-8634d36ddeb7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:04.423910 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8c003f-63d0-454e-9149-8634d36ddeb7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 14:00:04.431490 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application [None req-dc8c003f-63d0-454e-9149-8634d36ddeb7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 03 14:00:04.431490 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:00:04.431490 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 14:00:04.431490 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 14:00:04.431490 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 14:00:04.431490 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 14:00:04.431490 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 14:00:04.431490 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 14:00:04.431490 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 14:00:04.431490 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 14:00:04.431490 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 14:00:04.431490 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 14:00:04.431490 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 14:00:04.431490 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 14:00:04.431490 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 14:00:04.431490 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 14:00:04.432465 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 14:00:04.432465 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 14:00:04.432465 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 14:00:04.432465 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 14:00:04.432465 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 14:00:04.432465 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 14:00:04.432465 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 14:00:04.432465 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 14:00:04.432465 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 14:00:04.432465 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.get_or_create( May 03 14:00:04.432465 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 14:00:04.432465 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application with Lock( May 03 14:00:04.432465 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 14:00:04.432465 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._enter() May 03 14:00:04.432465 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 14:00:04.432465 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 14:00:04.433373 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 14:00:04.433373 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.creator() May 03 14:00:04.433373 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 14:00:04.433373 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application created_value = creator( May 03 14:00:04.433373 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 14:00:04.433373 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 14:00:04.433373 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 14:00:04.433373 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 14:00:04.433373 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 14:00:04.433373 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 14:00:04.433373 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 03 14:00:04.433373 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application May 03 14:00:04.433373 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 297/578] 10.222.0.36 () {56 vars in 1102 bytes} [Tue May 3 14:00:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 14:00:04.434119 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8c003f-63d0-454e-9149-8634d36ddeb7 None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:04.442251 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00389800-a74d-447a-a0d7-ea4638f180c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:04.443042 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00389800-a74d-447a-a0d7-ea4638f180c6 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:04.443313 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00389800-a74d-447a-a0d7-ea4638f180c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:04.443576 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00389800-a74d-447a-a0d7-ea4638f180c6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:04.450073 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00389800-a74d-447a-a0d7-ea4638f180c6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:04.451555 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00389800-a74d-447a-a0d7-ea4638f180c6 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:04.465034 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application [None req-00389800-a74d-447a-a0d7-ea4638f180c6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 14:00:04.465034 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:00:04.465034 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 14:00:04.465034 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 14:00:04.465034 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 14:00:04.465034 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 14:00:04.465034 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 14:00:04.465034 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 14:00:04.465034 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 14:00:04.465034 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 14:00:04.465034 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 14:00:04.465034 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 14:00:04.465034 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 14:00:04.465034 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 14:00:04.465034 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 14:00:04.466103 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 14:00:04.466103 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 14:00:04.466103 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 14:00:04.466103 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 14:00:04.466103 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 14:00:04.466103 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 14:00:04.466103 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.get_or_create( May 03 14:00:04.466103 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 14:00:04.466103 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application with Lock( May 03 14:00:04.466103 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 14:00:04.466103 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._enter() May 03 14:00:04.466103 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 14:00:04.466103 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 14:00:04.466103 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 14:00:04.466103 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.creator() May 03 14:00:04.466103 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 14:00:04.466103 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application created_value = creator( May 03 14:00:04.467098 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 14:00:04.467098 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 14:00:04.467098 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 14:00:04.467098 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 14:00:04.467098 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 14:00:04.467098 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 14:00:04.467098 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 14:00:04.467098 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application May 03 14:00:04.467098 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 282/579] 10.222.0.36 () {56 vars in 1111 bytes} [Tue May 3 14:00:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 14:00:04.467098 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00389800-a74d-447a-a0d7-ea4638f180c6 None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:04.535792 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8c003f-63d0-454e-9149-8634d36ddeb7 None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:04.563020 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00389800-a74d-447a-a0d7-ea4638f180c6 None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:04.569403 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d22834-31a7-41b9-9752-cefb96329515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:04.570069 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d22834-31a7-41b9-9752-cefb96329515 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:04.570352 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d22834-31a7-41b9-9752-cefb96329515 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:04.570624 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d22834-31a7-41b9-9752-cefb96329515 None admin] PATH_INFO: `/v3/domains` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:04.571346 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d22834-31a7-41b9-9752-cefb96329515 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:00:04.571647 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d22834-31a7-41b9-9752-cefb96329515 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:04.573029 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d22834-31a7-41b9-9752-cefb96329515 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:04.585274 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 298/580] 10.222.0.36 () {56 vars in 1109 bytes} [Tue May 3 14:00:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:00:04.586083 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d22834-31a7-41b9-9752-cefb96329515 None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:04.595401 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af85d527-788b-479c-91f2-b366ffd020f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:04.596309 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af85d527-788b-479c-91f2-b366ffd020f1 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:04.596870 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af85d527-788b-479c-91f2-b366ffd020f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:04.596974 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af85d527-788b-479c-91f2-b366ffd020f1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:04.604214 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af85d527-788b-479c-91f2-b366ffd020f1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:04.605496 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af85d527-788b-479c-91f2-b366ffd020f1 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:04.619648 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application [None req-af85d527-788b-479c-91f2-b366ffd020f1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 14:00:04.619648 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:00:04.619648 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 14:00:04.619648 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 14:00:04.619648 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 14:00:04.619648 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 14:00:04.619648 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 14:00:04.619648 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 14:00:04.619648 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 14:00:04.619648 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 14:00:04.619648 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 14:00:04.619648 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 14:00:04.619648 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 14:00:04.619648 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 14:00:04.619648 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 14:00:04.620569 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 14:00:04.620569 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 14:00:04.620569 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 14:00:04.620569 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 14:00:04.620569 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 14:00:04.620569 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 14:00:04.620569 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.get_or_create( May 03 14:00:04.620569 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 14:00:04.620569 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application with Lock( May 03 14:00:04.620569 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 14:00:04.620569 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._enter() May 03 14:00:04.620569 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 14:00:04.620569 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 14:00:04.620569 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 14:00:04.620569 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.creator() May 03 14:00:04.620569 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 14:00:04.620569 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application created_value = creator( May 03 14:00:04.626449 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 14:00:04.626449 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 14:00:04.626449 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 14:00:04.626449 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 14:00:04.626449 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 14:00:04.626449 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 14:00:04.626449 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 14:00:04.626449 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application May 03 14:00:04.626449 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 283/581] 10.222.0.36 () {56 vars in 1111 bytes} [Tue May 3 14:00:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 14:00:04.626449 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af85d527-788b-479c-91f2-b366ffd020f1 None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:04.681350 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d22834-31a7-41b9-9752-cefb96329515 None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:04.712937 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ed2cdf-8de6-4f09-8719-3ea1e01eedf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:04.714047 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ed2cdf-8de6-4f09-8719-3ea1e01eedf3 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:04.714329 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ed2cdf-8de6-4f09-8719-3ea1e01eedf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:04.714598 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ed2cdf-8de6-4f09-8719-3ea1e01eedf3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:04.720938 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af85d527-788b-479c-91f2-b366ffd020f1 None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:04.724391 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ed2cdf-8de6-4f09-8719-3ea1e01eedf3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:04.725859 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ed2cdf-8de6-4f09-8719-3ea1e01eedf3 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:04.742842 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application [None req-65ed2cdf-8de6-4f09-8719-3ea1e01eedf3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 14:00:04.742842 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:00:04.742842 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 14:00:04.742842 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 14:00:04.742842 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 14:00:04.742842 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 14:00:04.742842 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 14:00:04.742842 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 14:00:04.742842 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 14:00:04.742842 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 14:00:04.742842 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 14:00:04.742842 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 14:00:04.742842 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 14:00:04.742842 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 14:00:04.742842 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 14:00:04.743806 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 14:00:04.743806 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 14:00:04.743806 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 14:00:04.743806 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 14:00:04.743806 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 14:00:04.743806 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 14:00:04.743806 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.get_or_create( May 03 14:00:04.743806 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 14:00:04.743806 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application with Lock( May 03 14:00:04.743806 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 14:00:04.743806 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._enter() May 03 14:00:04.743806 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 14:00:04.743806 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 14:00:04.743806 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 14:00:04.743806 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.creator() May 03 14:00:04.743806 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 14:00:04.743806 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application created_value = creator( May 03 14:00:04.744716 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 14:00:04.744716 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 14:00:04.744716 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 14:00:04.744716 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application May 03 14:00:04.744716 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 299/582] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 3 14:00:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 14:00:04.745011 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ed2cdf-8de6-4f09-8719-3ea1e01eedf3 None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:04.757675 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cb80b7-ffd4-4f5c-95d7-c03875264e09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:04.758356 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cb80b7-ffd4-4f5c-95d7-c03875264e09 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:04.758637 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cb80b7-ffd4-4f5c-95d7-c03875264e09 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:04.758909 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cb80b7-ffd4-4f5c-95d7-c03875264e09 None admin] PATH_INFO: `/v3/roles` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:04.759655 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cb80b7-ffd4-4f5c-95d7-c03875264e09 None admin] RBAC: Adding query filter params (name=service) {{(pid=80012) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:00:04.759962 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cb80b7-ffd4-4f5c-95d7-c03875264e09 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:04.761355 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cb80b7-ffd4-4f5c-95d7-c03875264e09 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:04.774362 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 284/583] 10.222.0.36 () {56 vars in 1103 bytes} [Tue May 3 14:00:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:00:04.774362 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cb80b7-ffd4-4f5c-95d7-c03875264e09 None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:04.843475 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ed2cdf-8de6-4f09-8719-3ea1e01eedf3 None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:04.872731 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cb80b7-ffd4-4f5c-95d7-c03875264e09 None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:04.877154 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c094bcad-1272-4bbb-818b-8fd7e450965f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:04.877836 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c094bcad-1272-4bbb-818b-8fd7e450965f None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:04.878117 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c094bcad-1272-4bbb-818b-8fd7e450965f None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:04.878390 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c094bcad-1272-4bbb-818b-8fd7e450965f None admin] PATH_INFO: `/v3/projects` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:04.879163 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c094bcad-1272-4bbb-818b-8fd7e450965f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:00:04.879472 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c094bcad-1272-4bbb-818b-8fd7e450965f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:04.880889 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c094bcad-1272-4bbb-818b-8fd7e450965f None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:04.892453 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 300/584] 10.222.0.36 () {56 vars in 1148 bytes} [Tue May 3 14:00:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:00:04.893200 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c094bcad-1272-4bbb-818b-8fd7e450965f None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:04.905184 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9ba140-da02-44fc-98aa-c4461031fa68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:04.906043 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9ba140-da02-44fc-98aa-c4461031fa68 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:04.906322 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9ba140-da02-44fc-98aa-c4461031fa68 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:04.906596 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9ba140-da02-44fc-98aa-c4461031fa68 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:04.914199 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9ba140-da02-44fc-98aa-c4461031fa68 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:04.915626 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9ba140-da02-44fc-98aa-c4461031fa68 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:04.929718 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application [None req-7d9ba140-da02-44fc-98aa-c4461031fa68 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 03 14:00:04.929718 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:00:04.929718 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 14:00:04.929718 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 14:00:04.929718 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 14:00:04.929718 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 14:00:04.929718 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 14:00:04.929718 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 14:00:04.929718 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 14:00:04.929718 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 14:00:04.929718 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 14:00:04.929718 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 14:00:04.929718 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 14:00:04.929718 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 14:00:04.929718 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 14:00:04.929718 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 14:00:04.930852 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 14:00:04.930852 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 14:00:04.930852 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 14:00:04.930852 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 14:00:04.930852 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 14:00:04.930852 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 14:00:04.930852 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 14:00:04.930852 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 14:00:04.930852 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 14:00:04.930852 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.get_or_create( May 03 14:00:04.930852 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 14:00:04.930852 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application with Lock( May 03 14:00:04.930852 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 14:00:04.930852 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._enter() May 03 14:00:04.930852 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 14:00:04.930852 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 14:00:04.930852 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 14:00:04.930852 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.creator() May 03 14:00:04.931865 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 14:00:04.931865 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application created_value = creator( May 03 14:00:04.931865 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 14:00:04.931865 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 14:00:04.931865 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 14:00:04.931865 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 14:00:04.931865 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 14:00:04.931865 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 14:00:04.931865 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 03 14:00:04.931865 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application May 03 14:00:04.931865 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 285/585] 10.222.0.36 () {56 vars in 1099 bytes} [Tue May 3 14:00:04 2022] GET /identity/v3/users/cinder => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 14:00:04.931865 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9ba140-da02-44fc-98aa-c4461031fa68 None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:04.991499 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c094bcad-1272-4bbb-818b-8fd7e450965f None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:05.024159 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c652d0-c280-4956-8c1f-6535439068d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:05.024832 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c652d0-c280-4956-8c1f-6535439068d6 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:05.025106 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c652d0-c280-4956-8c1f-6535439068d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:05.025408 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c652d0-c280-4956-8c1f-6535439068d6 None admin] PATH_INFO: `/v3/projects` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:05.026190 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c652d0-c280-4956-8c1f-6535439068d6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:00:05.026494 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c652d0-c280-4956-8c1f-6535439068d6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:05.027922 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c652d0-c280-4956-8c1f-6535439068d6 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:05.032675 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9ba140-da02-44fc-98aa-c4461031fa68 None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:05.039380 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 301/586] 10.222.0.36 () {56 vars in 1148 bytes} [Tue May 3 14:00:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:00:05.040157 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c652d0-c280-4956-8c1f-6535439068d6 None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:05.068905 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b7aead-8acf-46af-a87c-ca823e1dafae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:05.069619 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b7aead-8acf-46af-a87c-ca823e1dafae None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:05.069903 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b7aead-8acf-46af-a87c-ca823e1dafae None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:05.070177 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b7aead-8acf-46af-a87c-ca823e1dafae None admin] PATH_INFO: `/v3/domains` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:05.070899 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b7aead-8acf-46af-a87c-ca823e1dafae None admin] RBAC: Adding query filter params (name=Default) {{(pid=80012) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:00:05.071203 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b7aead-8acf-46af-a87c-ca823e1dafae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:05.072574 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b7aead-8acf-46af-a87c-ca823e1dafae None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:05.084220 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 286/587] 10.222.0.36 () {56 vars in 1109 bytes} [Tue May 3 14:00:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:00:05.084987 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b7aead-8acf-46af-a87c-ca823e1dafae None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:05.139154 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c652d0-c280-4956-8c1f-6535439068d6 None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:05.172112 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a095bb-8f92-487d-aa89-0e2e855fdf64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:05.172915 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a095bb-8f92-487d-aa89-0e2e855fdf64 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:05.173215 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a095bb-8f92-487d-aa89-0e2e855fdf64 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:05.173528 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a095bb-8f92-487d-aa89-0e2e855fdf64 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:05.177905 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b7aead-8acf-46af-a87c-ca823e1dafae None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:05.184172 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a095bb-8f92-487d-aa89-0e2e855fdf64 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:05.185803 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a095bb-8f92-487d-aa89-0e2e855fdf64 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:05.203446 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application [None req-b5a095bb-8f92-487d-aa89-0e2e855fdf64 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 14:00:05.203446 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:00:05.203446 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 14:00:05.203446 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 14:00:05.203446 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 14:00:05.203446 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 14:00:05.203446 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 14:00:05.203446 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 14:00:05.203446 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 14:00:05.203446 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 14:00:05.203446 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 14:00:05.203446 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 14:00:05.203446 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 14:00:05.203446 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 14:00:05.203446 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 14:00:05.204545 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 14:00:05.204545 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 14:00:05.204545 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 14:00:05.204545 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 14:00:05.204545 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 14:00:05.204545 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 14:00:05.204545 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.get_or_create( May 03 14:00:05.204545 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 14:00:05.204545 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application with Lock( May 03 14:00:05.204545 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 14:00:05.204545 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._enter() May 03 14:00:05.204545 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 14:00:05.204545 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 14:00:05.204545 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 14:00:05.204545 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.creator() May 03 14:00:05.204545 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 14:00:05.204545 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application created_value = creator( May 03 14:00:05.205640 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 14:00:05.205640 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 14:00:05.205640 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 14:00:05.205640 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application May 03 14:00:05.205640 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 302/588] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 3 14:00:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 14:00:05.206007 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a095bb-8f92-487d-aa89-0e2e855fdf64 None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:05.214197 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727e9d76-b420-48e1-9805-3aad1b4bf9be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:05.215089 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727e9d76-b420-48e1-9805-3aad1b4bf9be None admin] REQUEST_METHOD: `PUT` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:05.215371 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727e9d76-b420-48e1-9805-3aad1b4bf9be None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:05.215643 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727e9d76-b420-48e1-9805-3aad1b4bf9be None admin] PATH_INFO: `/v3/projects/de541be478754087934323bdbe41a579/users/63489e658c094a2598a2ac62159d2fda/roles/b3902525744e454694820e2ea3b2e563` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:05.229641 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727e9d76-b420-48e1-9805-3aad1b4bf9be None admin] RBAC: Authorizing `identity:create_grant(project_id=de541be478754087934323bdbe41a579, user_id=63489e658c094a2598a2ac62159d2fda, role_id=b3902525744e454694820e2ea3b2e563)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:05.231107 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727e9d76-b420-48e1-9805-3aad1b4bf9be None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:05.243895 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 287/589] 10.222.0.36 () {58 vars in 1439 bytes} [Tue May 3 14:00:05 2022] PUT /identity/v3/projects/de541be478754087934323bdbe41a579/users/63489e658c094a2598a2ac62159d2fda/roles/b3902525744e454694820e2ea3b2e563 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:00:05.244895 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727e9d76-b420-48e1-9805-3aad1b4bf9be None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:05.307860 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a095bb-8f92-487d-aa89-0e2e855fdf64 None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:05.343102 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec47f172-0eaa-49cd-bd00-7a9c87f5285d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:05.343871 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec47f172-0eaa-49cd-bd00-7a9c87f5285d None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:05.344175 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec47f172-0eaa-49cd-bd00-7a9c87f5285d None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:05.344438 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec47f172-0eaa-49cd-bd00-7a9c87f5285d None admin] PATH_INFO: `/v3/users` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:05.345309 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec47f172-0eaa-49cd-bd00-7a9c87f5285d None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:00:05.345630 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec47f172-0eaa-49cd-bd00-7a9c87f5285d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:05.347108 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec47f172-0eaa-49cd-bd00-7a9c87f5285d None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:05.359574 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727e9d76-b420-48e1-9805-3aad1b4bf9be None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:05.370180 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 303/590] 10.222.0.36 () {56 vars in 1137 bytes} [Tue May 3 14:00:05 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:00:05.370180 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec47f172-0eaa-49cd-bd00-7a9c87f5285d None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:05.395749 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d7aabc-de19-4156-bf44-586f87ada6fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:05.396326 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d7aabc-de19-4156-bf44-586f87ada6fc None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:05.396594 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d7aabc-de19-4156-bf44-586f87ada6fc None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:05.396874 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d7aabc-de19-4156-bf44-586f87ada6fc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:05.397910 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d7aabc-de19-4156-bf44-586f87ada6fc None admin] RBAC: Adding query filter params (role.id=b3902525744e454694820e2ea3b2e563, scope.project.id=de541be478754087934323bdbe41a579, user.id=e1180e29180d44418390cf22d3e0bd6f) {{(pid=80012) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:00:05.398223 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d7aabc-de19-4156-bf44-586f87ada6fc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:05.399694 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d7aabc-de19-4156-bf44-586f87ada6fc None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:05.406016 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 288/591] 10.222.0.36 () {56 vars in 1374 bytes} [Tue May 3 14:00:05 2022] GET /identity/v3/role_assignments?user.id=e1180e29180d44418390cf22d3e0bd6f&scope.project.id=de541be478754087934323bdbe41a579&role.id=b3902525744e454694820e2ea3b2e563 => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:00:05.410069 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d7aabc-de19-4156-bf44-586f87ada6fc None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:05.488521 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec47f172-0eaa-49cd-bd00-7a9c87f5285d None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:05.524529 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f790a245-fa33-4eb5-a496-39386bfc5123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:05.524937 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d7aabc-de19-4156-bf44-586f87ada6fc None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:05.525357 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f790a245-fa33-4eb5-a496-39386bfc5123 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:05.525637 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f790a245-fa33-4eb5-a496-39386bfc5123 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:05.525909 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f790a245-fa33-4eb5-a496-39386bfc5123 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:05.533550 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f790a245-fa33-4eb5-a496-39386bfc5123 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:05.535015 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f790a245-fa33-4eb5-a496-39386bfc5123 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:05.549479 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application [None req-f790a245-fa33-4eb5-a496-39386bfc5123 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 14:00:05.549479 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:00:05.549479 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 14:00:05.549479 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 14:00:05.549479 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 14:00:05.549479 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 14:00:05.549479 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 14:00:05.549479 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 14:00:05.549479 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 14:00:05.549479 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 14:00:05.549479 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 14:00:05.549479 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 14:00:05.549479 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 14:00:05.549479 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 14:00:05.549479 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 14:00:05.550935 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 14:00:05.550935 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 14:00:05.550935 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 14:00:05.550935 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 14:00:05.550935 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 14:00:05.550935 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 14:00:05.550935 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.get_or_create( May 03 14:00:05.550935 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 14:00:05.550935 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application with Lock( May 03 14:00:05.550935 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 14:00:05.550935 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._enter() May 03 14:00:05.550935 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 14:00:05.550935 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 14:00:05.550935 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 14:00:05.550935 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.creator() May 03 14:00:05.550935 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 14:00:05.550935 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application created_value = creator( May 03 14:00:05.551859 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 14:00:05.551859 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 14:00:05.551859 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 14:00:05.551859 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 14:00:05.551859 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 14:00:05.551859 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 14:00:05.551859 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 14:00:05.551859 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application May 03 14:00:05.551859 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 304/592] 10.222.0.36 () {56 vars in 1111 bytes} [Tue May 3 14:00:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 14:00:05.552368 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f790a245-fa33-4eb5-a496-39386bfc5123 None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:05.560845 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf73e3fe-466f-4692-a0ec-16a9e99b47a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:05.561551 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf73e3fe-466f-4692-a0ec-16a9e99b47a1 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:05.561832 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf73e3fe-466f-4692-a0ec-16a9e99b47a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:05.562105 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf73e3fe-466f-4692-a0ec-16a9e99b47a1 None admin] PATH_INFO: `/v3/domains` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:05.562841 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf73e3fe-466f-4692-a0ec-16a9e99b47a1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80012) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:00:05.563148 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf73e3fe-466f-4692-a0ec-16a9e99b47a1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:05.564546 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf73e3fe-466f-4692-a0ec-16a9e99b47a1 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:05.581425 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 289/593] 10.222.0.36 () {56 vars in 1109 bytes} [Tue May 3 14:00:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:00:05.582422 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf73e3fe-466f-4692-a0ec-16a9e99b47a1 None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:05.654151 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f790a245-fa33-4eb5-a496-39386bfc5123 None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:05.681143 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf73e3fe-466f-4692-a0ec-16a9e99b47a1 None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:05.687317 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2279cf14-58f4-407d-a44d-83ca4f6e7f2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:05.688116 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2279cf14-58f4-407d-a44d-83ca4f6e7f2b None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:05.688388 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2279cf14-58f4-407d-a44d-83ca4f6e7f2b None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:05.688656 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2279cf14-58f4-407d-a44d-83ca4f6e7f2b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:05.699349 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2279cf14-58f4-407d-a44d-83ca4f6e7f2b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:05.700962 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2279cf14-58f4-407d-a44d-83ca4f6e7f2b None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:05.714660 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf1a68a-2af5-4dba-9b6d-204f1f15a811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:05.715322 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf1a68a-2af5-4dba-9b6d-204f1f15a811 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:05.715598 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf1a68a-2af5-4dba-9b6d-204f1f15a811 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:05.715870 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf1a68a-2af5-4dba-9b6d-204f1f15a811 None admin] PATH_INFO: `/v3/projects` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:05.716686 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf1a68a-2af5-4dba-9b6d-204f1f15a811 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80012) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:00:05.716990 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf1a68a-2af5-4dba-9b6d-204f1f15a811 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:05.718349 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application [None req-2279cf14-58f4-407d-a44d-83ca4f6e7f2b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 14:00:05.718349 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:00:05.718349 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 14:00:05.718349 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 14:00:05.718349 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 14:00:05.718349 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 14:00:05.718349 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 14:00:05.718349 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 14:00:05.718349 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 14:00:05.718349 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 14:00:05.718349 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 14:00:05.718349 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 14:00:05.718349 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 14:00:05.718349 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 14:00:05.718349 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 14:00:05.720288 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 14:00:05.720288 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 14:00:05.720288 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 14:00:05.720288 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 14:00:05.720288 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 14:00:05.720288 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 14:00:05.720288 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.get_or_create( May 03 14:00:05.720288 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 14:00:05.720288 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application with Lock( May 03 14:00:05.720288 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 14:00:05.720288 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._enter() May 03 14:00:05.720288 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 14:00:05.720288 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 14:00:05.720288 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 14:00:05.720288 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.creator() May 03 14:00:05.720288 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 14:00:05.720288 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application created_value = creator( May 03 14:00:05.722478 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 14:00:05.722478 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 14:00:05.722478 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 14:00:05.722478 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application May 03 14:00:05.722988 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf1a68a-2af5-4dba-9b6d-204f1f15a811 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:05.726721 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 305/594] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 3 14:00:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 14:00:05.726721 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2279cf14-58f4-407d-a44d-83ca4f6e7f2b None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:05.730871 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 290/595] 10.222.0.36 () {56 vars in 1148 bytes} [Tue May 3 14:00:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:00:05.731746 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf1a68a-2af5-4dba-9b6d-204f1f15a811 None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:05.825251 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2279cf14-58f4-407d-a44d-83ca4f6e7f2b None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:05.830931 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf1a68a-2af5-4dba-9b6d-204f1f15a811 None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:05.859287 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adffbb8-6689-4e08-b671-198a69919eee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:05.860094 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adffbb8-6689-4e08-b671-198a69919eee None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:05.860372 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adffbb8-6689-4e08-b671-198a69919eee None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:05.860644 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adffbb8-6689-4e08-b671-198a69919eee None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:05.868295 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adffbb8-6689-4e08-b671-198a69919eee None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:05.869778 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adffbb8-6689-4e08-b671-198a69919eee None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:05.870514 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d62c422-8719-4456-8c33-9da71ae12f3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:05.871182 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d62c422-8719-4456-8c33-9da71ae12f3d None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:05.871615 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d62c422-8719-4456-8c33-9da71ae12f3d None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:05.871892 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d62c422-8719-4456-8c33-9da71ae12f3d None admin] PATH_INFO: `/v3/domains` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:05.873185 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d62c422-8719-4456-8c33-9da71ae12f3d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80012) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:00:05.873522 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d62c422-8719-4456-8c33-9da71ae12f3d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:05.874896 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d62c422-8719-4456-8c33-9da71ae12f3d None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:05.884415 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application [None req-1adffbb8-6689-4e08-b671-198a69919eee None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 03 14:00:05.884415 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:00:05.884415 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 14:00:05.884415 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 14:00:05.884415 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 14:00:05.884415 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 14:00:05.884415 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 14:00:05.884415 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 14:00:05.884415 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 14:00:05.884415 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 14:00:05.884415 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 14:00:05.884415 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 14:00:05.884415 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 14:00:05.884415 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 14:00:05.884415 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 14:00:05.884415 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 14:00:05.886308 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 14:00:05.886308 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 14:00:05.886308 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 14:00:05.886308 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 14:00:05.886308 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 14:00:05.886308 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 14:00:05.886308 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 14:00:05.886308 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 14:00:05.886308 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 14:00:05.886308 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.get_or_create( May 03 14:00:05.886308 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 14:00:05.886308 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application with Lock( May 03 14:00:05.886308 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 14:00:05.886308 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._enter() May 03 14:00:05.886308 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 14:00:05.886308 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 14:00:05.886308 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 14:00:05.886308 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.creator() May 03 14:00:05.888024 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 14:00:05.888024 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application created_value = creator( May 03 14:00:05.888024 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 14:00:05.888024 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 14:00:05.888024 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 14:00:05.888024 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 14:00:05.888024 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 14:00:05.888024 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 14:00:05.888024 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 03 14:00:05.888024 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application May 03 14:00:05.889137 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 291/596] 10.222.0.36 () {56 vars in 1109 bytes} [Tue May 3 14:00:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:00:05.889137 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d62c422-8719-4456-8c33-9da71ae12f3d None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:05.893526 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 306/597] 10.222.0.36 () {56 vars in 1102 bytes} [Tue May 3 14:00:05 2022] GET /identity/v3/users/neutron => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 14:00:05.893526 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adffbb8-6689-4e08-b671-198a69919eee None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:05.993939 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d62c422-8719-4456-8c33-9da71ae12f3d None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:06.025890 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63021086-84ee-4e36-9eb0-8f8216b9ed60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:06.026887 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63021086-84ee-4e36-9eb0-8f8216b9ed60 None admin] REQUEST_METHOD: `PUT` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:06.027246 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63021086-84ee-4e36-9eb0-8f8216b9ed60 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:06.027579 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63021086-84ee-4e36-9eb0-8f8216b9ed60 None admin] PATH_INFO: `/v3/projects/de541be478754087934323bdbe41a579/users/616de5e7daed46849efc75ad77ea054e/roles/b3902525744e454694820e2ea3b2e563` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:06.028516 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adffbb8-6689-4e08-b671-198a69919eee None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:06.042350 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63021086-84ee-4e36-9eb0-8f8216b9ed60 None admin] RBAC: Authorizing `identity:create_grant(project_id=de541be478754087934323bdbe41a579, user_id=616de5e7daed46849efc75ad77ea054e, role_id=b3902525744e454694820e2ea3b2e563)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:06.043907 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63021086-84ee-4e36-9eb0-8f8216b9ed60 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:06.059871 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 292/598] 10.222.0.36 () {58 vars in 1439 bytes} [Tue May 3 14:00:05 2022] PUT /identity/v3/projects/de541be478754087934323bdbe41a579/users/616de5e7daed46849efc75ad77ea054e/roles/b3902525744e454694820e2ea3b2e563 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:00:06.060936 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63021086-84ee-4e36-9eb0-8f8216b9ed60 None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:06.079261 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbb181e-7005-4a06-9a46-86f59d4f7e62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:06.080171 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbb181e-7005-4a06-9a46-86f59d4f7e62 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:06.080455 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbb181e-7005-4a06-9a46-86f59d4f7e62 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:06.080731 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbb181e-7005-4a06-9a46-86f59d4f7e62 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:06.088255 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbb181e-7005-4a06-9a46-86f59d4f7e62 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:06.090183 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbb181e-7005-4a06-9a46-86f59d4f7e62 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:06.105825 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application [None req-7fbb181e-7005-4a06-9a46-86f59d4f7e62 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 14:00:06.105825 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:00:06.105825 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 14:00:06.105825 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 14:00:06.105825 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 14:00:06.105825 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 14:00:06.105825 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 14:00:06.105825 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 14:00:06.105825 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 14:00:06.105825 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 14:00:06.105825 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 14:00:06.105825 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 14:00:06.105825 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 14:00:06.105825 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 14:00:06.105825 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 14:00:06.108059 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 14:00:06.108059 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 14:00:06.108059 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 14:00:06.108059 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 14:00:06.108059 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 14:00:06.108059 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 14:00:06.108059 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.get_or_create( May 03 14:00:06.108059 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 14:00:06.108059 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application with Lock( May 03 14:00:06.108059 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 14:00:06.108059 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._enter() May 03 14:00:06.108059 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 14:00:06.108059 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 14:00:06.108059 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 14:00:06.108059 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.creator() May 03 14:00:06.108059 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 14:00:06.108059 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application created_value = creator( May 03 14:00:06.110189 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 14:00:06.110189 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 14:00:06.110189 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 14:00:06.110189 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 14:00:06.110189 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 14:00:06.110189 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 14:00:06.110189 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 14:00:06.110189 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application May 03 14:00:06.117334 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 307/599] 10.222.0.36 () {56 vars in 1111 bytes} [Tue May 3 14:00:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 14:00:06.117334 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbb181e-7005-4a06-9a46-86f59d4f7e62 None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:06.181518 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63021086-84ee-4e36-9eb0-8f8216b9ed60 None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:06.213395 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbb181e-7005-4a06-9a46-86f59d4f7e62 None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:06.224640 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65a1090-216a-4973-a838-a2430cbde02e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:06.225683 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65a1090-216a-4973-a838-a2430cbde02e None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:06.225965 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65a1090-216a-4973-a838-a2430cbde02e None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:06.226527 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65a1090-216a-4973-a838-a2430cbde02e None admin] PATH_INFO: `/v3/users` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:06.227384 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65a1090-216a-4973-a838-a2430cbde02e None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80012) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:00:06.227840 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65a1090-216a-4973-a838-a2430cbde02e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:06.230029 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65a1090-216a-4973-a838-a2430cbde02e None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:06.252180 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697834e8-940c-4d57-b0c9-09248f2ab71d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:06.252814 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697834e8-940c-4d57-b0c9-09248f2ab71d None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:06.253000 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 293/600] 10.222.0.36 () {56 vars in 1139 bytes} [Tue May 3 14:00:06 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:00:06.257704 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697834e8-940c-4d57-b0c9-09248f2ab71d None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:06.257988 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697834e8-940c-4d57-b0c9-09248f2ab71d None admin] PATH_INFO: `/v3/projects` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:06.258849 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697834e8-940c-4d57-b0c9-09248f2ab71d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:00:06.259156 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697834e8-940c-4d57-b0c9-09248f2ab71d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:06.260768 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697834e8-940c-4d57-b0c9-09248f2ab71d None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:06.265127 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65a1090-216a-4973-a838-a2430cbde02e None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:06.284069 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 308/601] 10.222.0.36 () {56 vars in 1148 bytes} [Tue May 3 14:00:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:00:06.291781 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697834e8-940c-4d57-b0c9-09248f2ab71d None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:06.414435 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65a1090-216a-4973-a838-a2430cbde02e None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:06.439989 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697834e8-940c-4d57-b0c9-09248f2ab71d None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:06.452467 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd4588d-adf3-464c-b75c-0cf9ff1cbfcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:06.453706 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd4588d-adf3-464c-b75c-0cf9ff1cbfcc None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:06.454188 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd4588d-adf3-464c-b75c-0cf9ff1cbfcc None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:06.454657 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd4588d-adf3-464c-b75c-0cf9ff1cbfcc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:06.465855 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd4588d-adf3-464c-b75c-0cf9ff1cbfcc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:06.467975 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd4588d-adf3-464c-b75c-0cf9ff1cbfcc None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:06.482407 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5feb238-9d3e-482f-b161-a23cb85be37e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:06.483325 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5feb238-9d3e-482f-b161-a23cb85be37e None admin] REQUEST_METHOD: `PUT` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:06.483603 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5feb238-9d3e-482f-b161-a23cb85be37e None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:06.483879 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5feb238-9d3e-482f-b161-a23cb85be37e None admin] PATH_INFO: `/v3/projects/de541be478754087934323bdbe41a579/users/5b014f4c7ba1414cb8a597f5bc4033f7/roles/b3902525744e454694820e2ea3b2e563` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:06.487345 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application [None req-3dd4588d-adf3-464c-b75c-0cf9ff1cbfcc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 14:00:06.487345 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:00:06.487345 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 14:00:06.487345 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 14:00:06.487345 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 14:00:06.487345 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 14:00:06.487345 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 14:00:06.487345 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 14:00:06.487345 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 14:00:06.487345 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 14:00:06.487345 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 14:00:06.487345 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 14:00:06.487345 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 14:00:06.487345 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 14:00:06.487345 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 14:00:06.488217 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 14:00:06.488217 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 14:00:06.488217 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 14:00:06.488217 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 14:00:06.488217 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 14:00:06.488217 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 14:00:06.488217 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.get_or_create( May 03 14:00:06.488217 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 14:00:06.488217 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application with Lock( May 03 14:00:06.488217 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 14:00:06.488217 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._enter() May 03 14:00:06.488217 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 14:00:06.488217 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 14:00:06.488217 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 14:00:06.488217 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.creator() May 03 14:00:06.488217 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 14:00:06.488217 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application created_value = creator( May 03 14:00:06.489212 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 14:00:06.489212 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 14:00:06.489212 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 14:00:06.489212 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application May 03 14:00:06.495983 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 294/602] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 3 14:00:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 14:00:06.498610 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd4588d-adf3-464c-b75c-0cf9ff1cbfcc None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:06.512403 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5feb238-9d3e-482f-b161-a23cb85be37e None admin] RBAC: Authorizing `identity:create_grant(project_id=de541be478754087934323bdbe41a579, user_id=5b014f4c7ba1414cb8a597f5bc4033f7, role_id=b3902525744e454694820e2ea3b2e563)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:06.514217 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5feb238-9d3e-482f-b161-a23cb85be37e None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:06.545470 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 309/603] 10.222.0.36 () {58 vars in 1439 bytes} [Tue May 3 14:00:06 2022] PUT /identity/v3/projects/de541be478754087934323bdbe41a579/users/5b014f4c7ba1414cb8a597f5bc4033f7/roles/b3902525744e454694820e2ea3b2e563 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 14:00:06.643514 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd4588d-adf3-464c-b75c-0cf9ff1cbfcc None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:06.684907 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392f09e5-14e0-40fa-9c7b-b60db21c7b3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:06.686753 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392f09e5-14e0-40fa-9c7b-b60db21c7b3c None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:06.687243 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392f09e5-14e0-40fa-9c7b-b60db21c7b3c None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:06.687713 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392f09e5-14e0-40fa-9c7b-b60db21c7b3c None admin] PATH_INFO: `/v3/domains` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:06.688690 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392f09e5-14e0-40fa-9c7b-b60db21c7b3c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80012) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:00:06.689190 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392f09e5-14e0-40fa-9c7b-b60db21c7b3c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:06.690844 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392f09e5-14e0-40fa-9c7b-b60db21c7b3c None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:06.707705 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 295/604] 10.222.0.36 () {56 vars in 1109 bytes} [Tue May 3 14:00:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:00:06.714115 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5feb238-9d3e-482f-b161-a23cb85be37e None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:06.846577 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5feb238-9d3e-482f-b161-a23cb85be37e None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:06.889032 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b835b585-9a69-4579-b72c-db4782ee2f7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:06.890300 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b835b585-9a69-4579-b72c-db4782ee2f7f None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:06.890796 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b835b585-9a69-4579-b72c-db4782ee2f7f None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:06.891279 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b835b585-9a69-4579-b72c-db4782ee2f7f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:06.898754 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b835b585-9a69-4579-b72c-db4782ee2f7f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:06.900459 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b835b585-9a69-4579-b72c-db4782ee2f7f None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:06.914504 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application [None req-b835b585-9a69-4579-b72c-db4782ee2f7f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 14:00:06.914504 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:00:06.914504 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 14:00:06.914504 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 14:00:06.914504 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 14:00:06.914504 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 14:00:06.914504 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 14:00:06.914504 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 14:00:06.914504 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 14:00:06.914504 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 14:00:06.914504 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 14:00:06.914504 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 14:00:06.914504 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 14:00:06.914504 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 14:00:06.914504 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 14:00:06.915451 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 14:00:06.915451 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 14:00:06.915451 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 14:00:06.915451 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 14:00:06.915451 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 14:00:06.915451 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 14:00:06.915451 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.get_or_create( May 03 14:00:06.915451 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 14:00:06.915451 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application with Lock( May 03 14:00:06.915451 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 14:00:06.915451 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._enter() May 03 14:00:06.915451 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 14:00:06.915451 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 14:00:06.915451 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 14:00:06.915451 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.creator() May 03 14:00:06.915451 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 14:00:06.915451 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application created_value = creator( May 03 14:00:06.916360 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 14:00:06.916360 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 14:00:06.916360 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 14:00:06.916360 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 14:00:06.916360 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 14:00:06.916360 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 14:00:06.916360 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 14:00:06.916360 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application May 03 14:00:06.922842 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 310/605] 10.222.0.36 () {56 vars in 1111 bytes} [Tue May 3 14:00:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 14:00:06.924936 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392f09e5-14e0-40fa-9c7b-b60db21c7b3c None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:07.023766 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392f09e5-14e0-40fa-9c7b-b60db21c7b3c None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:07.077907 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e5b532-2dfb-4f0b-83bf-ecb7562c2003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:07.078938 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e5b532-2dfb-4f0b-83bf-ecb7562c2003 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:07.079420 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e5b532-2dfb-4f0b-83bf-ecb7562c2003 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:07.079892 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e5b532-2dfb-4f0b-83bf-ecb7562c2003 None admin] PATH_INFO: `/v3/projects` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:07.080892 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e5b532-2dfb-4f0b-83bf-ecb7562c2003 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80012) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:00:07.081421 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e5b532-2dfb-4f0b-83bf-ecb7562c2003 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:07.083076 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e5b532-2dfb-4f0b-83bf-ecb7562c2003 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:07.102903 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 296/606] 10.222.0.36 () {56 vars in 1148 bytes} [Tue May 3 14:00:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:00:07.109139 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b835b585-9a69-4579-b72c-db4782ee2f7f None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:07.210420 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b835b585-9a69-4579-b72c-db4782ee2f7f None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:07.244612 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c5fa03-8e7d-46ff-9a1a-f3143a071e69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:07.245954 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c5fa03-8e7d-46ff-9a1a-f3143a071e69 None admin] REQUEST_METHOD: `PUT` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:07.246434 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c5fa03-8e7d-46ff-9a1a-f3143a071e69 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:07.246903 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c5fa03-8e7d-46ff-9a1a-f3143a071e69 None admin] PATH_INFO: `/v3/projects/de541be478754087934323bdbe41a579/users/937bea4f355144b4a7ee11baabc3a4cb/roles/b3902525744e454694820e2ea3b2e563` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:07.266207 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c5fa03-8e7d-46ff-9a1a-f3143a071e69 None admin] RBAC: Authorizing `identity:create_grant(project_id=de541be478754087934323bdbe41a579, user_id=937bea4f355144b4a7ee11baabc3a4cb, role_id=b3902525744e454694820e2ea3b2e563)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:07.268076 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c5fa03-8e7d-46ff-9a1a-f3143a071e69 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:07.290601 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 311/607] 10.222.0.36 () {58 vars in 1439 bytes} [Tue May 3 14:00:07 2022] PUT /identity/v3/projects/de541be478754087934323bdbe41a579/users/937bea4f355144b4a7ee11baabc3a4cb/roles/b3902525744e454694820e2ea3b2e563 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:00:07.877337 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4980582e-7b02-442a-8433-6b9ba3dcbb85 None None] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:07.877868 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4980582e-7b02-442a-8433-6b9ba3dcbb85 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:07.877868 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4980582e-7b02-442a-8433-6b9ba3dcbb85 None None] PATH_INFO: `/` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:07.879487 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 297/608] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 3 14:00:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 14:00:07.884823 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deb476b-84dd-42e3-bda3-cd3ebbc552ee None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:07.885256 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deb476b-84dd-42e3-bda3-cd3ebbc552ee None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:07.885479 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deb476b-84dd-42e3-bda3-cd3ebbc552ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:07.902814 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-0deb476b-84dd-42e3-bda3-cd3ebbc552ee None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:00:07.904014 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-0deb476b-84dd-42e3-bda3-cd3ebbc552ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:00:07.989451 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 312/609] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 3 14:00:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 14:00:08.023658 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4980582e-7b02-442a-8433-6b9ba3dcbb85 None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:08.046051 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5a0e7c-3051-4ace-9c57-d1611fabb067 None None] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:08.046388 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5a0e7c-3051-4ace-9c57-d1611fabb067 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:08.046612 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5a0e7c-3051-4ace-9c57-d1611fabb067 None None] PATH_INFO: `/` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:08.050269 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 313/610] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 3 14:00:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 14:00:08.054796 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e7f0da-e54b-4640-8613-b8664fd977a8 None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:08.055057 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e7f0da-e54b-4640-8613-b8664fd977a8 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:08.055331 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e7f0da-e54b-4640-8613-b8664fd977a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:08.081426 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-29e7f0da-e54b-4640-8613-b8664fd977a8 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:00:08.082598 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-29e7f0da-e54b-4640-8613-b8664fd977a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:00:08.201132 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4980582e-7b02-442a-8433-6b9ba3dcbb85 None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:08.229999 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 314/611] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 3 14:00:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 03 14:00:08.252663 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4400cb0-a0fb-4690-a76c-57ccec65929e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:08.254233 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4400cb0-a0fb-4690-a76c-57ccec65929e None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:08.254233 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4400cb0-a0fb-4690-a76c-57ccec65929e None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:08.254233 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4400cb0-a0fb-4690-a76c-57ccec65929e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:08.270095 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4400cb0-a0fb-4690-a76c-57ccec65929e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 14:00:08.275864 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e7f0da-e54b-4640-8613-b8664fd977a8 None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:08.289127 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application [None req-a4400cb0-a0fb-4690-a76c-57ccec65929e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 03 14:00:08.289127 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:00:08.289127 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 14:00:08.289127 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 14:00:08.289127 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 14:00:08.289127 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 14:00:08.289127 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 14:00:08.289127 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 14:00:08.289127 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 14:00:08.289127 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 14:00:08.289127 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 14:00:08.289127 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 14:00:08.289127 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 14:00:08.289127 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 14:00:08.289127 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 14:00:08.289127 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 14:00:08.290171 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 14:00:08.290171 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 14:00:08.290171 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 14:00:08.290171 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 14:00:08.290171 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 14:00:08.290171 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 14:00:08.290171 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 14:00:08.290171 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 14:00:08.290171 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 14:00:08.290171 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.get_or_create( May 03 14:00:08.290171 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 14:00:08.290171 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application with Lock( May 03 14:00:08.290171 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 14:00:08.290171 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._enter() May 03 14:00:08.290171 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 14:00:08.290171 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 14:00:08.291906 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 14:00:08.291906 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.creator() May 03 14:00:08.291906 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 14:00:08.291906 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application created_value = creator( May 03 14:00:08.291906 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 14:00:08.291906 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 14:00:08.291906 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 14:00:08.291906 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 14:00:08.291906 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 14:00:08.291906 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 14:00:08.291906 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 03 14:00:08.291906 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application May 03 14:00:08.291906 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 298/612] 10.222.0.36 () {56 vars in 1102 bytes} [Tue May 3 14:00:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 14:00:08.296908 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4400cb0-a0fb-4690-a76c-57ccec65929e None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:08.388401 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e7f0da-e54b-4640-8613-b8664fd977a8 None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:08.420737 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4400cb0-a0fb-4690-a76c-57ccec65929e None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:08.434984 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94f7a26-06ec-4612-80a0-129565ecd9fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:08.435848 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94f7a26-06ec-4612-80a0-129565ecd9fe None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:08.436124 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94f7a26-06ec-4612-80a0-129565ecd9fe None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:08.436394 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94f7a26-06ec-4612-80a0-129565ecd9fe None admin] PATH_INFO: `/v3/roles/service` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:08.453589 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff03b35-15e5-4814-a872-27eda286eadc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:08.454181 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff03b35-15e5-4814-a872-27eda286eadc None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:08.454459 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff03b35-15e5-4814-a872-27eda286eadc None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:08.454731 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff03b35-15e5-4814-a872-27eda286eadc None admin] PATH_INFO: `/v3/roles` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:08.455115 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94f7a26-06ec-4612-80a0-129565ecd9fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 14:00:08.455465 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff03b35-15e5-4814-a872-27eda286eadc None admin] RBAC: Adding query filter params (name=service) {{(pid=80012) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:00:08.455766 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff03b35-15e5-4814-a872-27eda286eadc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:08.457183 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff03b35-15e5-4814-a872-27eda286eadc None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:08.465895 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 299/613] 10.222.0.36 () {56 vars in 1103 bytes} [Tue May 3 14:00:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:00:08.471099 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application [None req-a94f7a26-06ec-4612-80a0-129565ecd9fe None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 03 14:00:08.471099 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:00:08.471099 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 14:00:08.471099 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 14:00:08.471099 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 14:00:08.471099 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 14:00:08.471099 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 14:00:08.471099 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 14:00:08.471099 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 14:00:08.471099 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 14:00:08.471099 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 14:00:08.471099 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 14:00:08.471099 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 14:00:08.471099 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 14:00:08.471099 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 14:00:08.471099 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 14:00:08.473364 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 14:00:08.473364 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 14:00:08.473364 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 14:00:08.473364 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 14:00:08.473364 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 14:00:08.473364 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 14:00:08.473364 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 14:00:08.473364 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 14:00:08.473364 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 14:00:08.473364 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.get_or_create( May 03 14:00:08.473364 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 14:00:08.473364 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application with Lock( May 03 14:00:08.473364 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 14:00:08.473364 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._enter() May 03 14:00:08.473364 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 14:00:08.473364 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 14:00:08.475344 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 14:00:08.475344 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.creator() May 03 14:00:08.475344 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 14:00:08.475344 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application created_value = creator( May 03 14:00:08.475344 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 14:00:08.475344 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 14:00:08.475344 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 14:00:08.475344 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 14:00:08.475344 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 14:00:08.475344 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 14:00:08.475344 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 03 14:00:08.475344 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application May 03 14:00:08.477667 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff03b35-15e5-4814-a872-27eda286eadc None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:08.477826 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 315/614] 10.222.0.36 () {56 vars in 1102 bytes} [Tue May 3 14:00:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 14:00:08.477826 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94f7a26-06ec-4612-80a0-129565ecd9fe None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:08.582125 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff03b35-15e5-4814-a872-27eda286eadc None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:08.586362 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94f7a26-06ec-4612-80a0-129565ecd9fe None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:08.615828 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ad18de-3e31-4f99-9d20-0f9de2634fe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:08.616705 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ad18de-3e31-4f99-9d20-0f9de2634fe2 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:08.616949 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ad18de-3e31-4f99-9d20-0f9de2634fe2 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:08.617218 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ad18de-3e31-4f99-9d20-0f9de2634fe2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:08.628938 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ad18de-3e31-4f99-9d20-0f9de2634fe2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:08.630588 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ad18de-3e31-4f99-9d20-0f9de2634fe2 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:08.638058 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118644ce-7554-4a6c-98f5-0358e546b0a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:08.639240 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118644ce-7554-4a6c-98f5-0358e546b0a3 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:08.639729 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118644ce-7554-4a6c-98f5-0358e546b0a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:08.640222 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118644ce-7554-4a6c-98f5-0358e546b0a3 None admin] PATH_INFO: `/v3/roles` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:08.641184 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118644ce-7554-4a6c-98f5-0358e546b0a3 None admin] RBAC: Adding query filter params (name=service) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:00:08.641772 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118644ce-7554-4a6c-98f5-0358e546b0a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:08.643363 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118644ce-7554-4a6c-98f5-0358e546b0a3 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:08.648390 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application [None req-e7ad18de-3e31-4f99-9d20-0f9de2634fe2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 14:00:08.648390 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:00:08.648390 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 14:00:08.648390 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 14:00:08.648390 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 14:00:08.648390 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 14:00:08.648390 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 14:00:08.648390 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 14:00:08.648390 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 14:00:08.648390 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 14:00:08.648390 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 14:00:08.648390 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 14:00:08.648390 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 14:00:08.648390 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 14:00:08.648390 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 14:00:08.649280 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 14:00:08.649280 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 14:00:08.649280 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 14:00:08.649280 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 14:00:08.649280 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 14:00:08.649280 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 14:00:08.649280 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.get_or_create( May 03 14:00:08.649280 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 14:00:08.649280 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application with Lock( May 03 14:00:08.649280 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 14:00:08.649280 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._enter() May 03 14:00:08.649280 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 14:00:08.649280 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 14:00:08.649280 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 14:00:08.649280 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.creator() May 03 14:00:08.649280 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 14:00:08.649280 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application created_value = creator( May 03 14:00:08.650657 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 14:00:08.650657 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 14:00:08.650657 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 14:00:08.650657 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application May 03 14:00:08.650657 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 300/615] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 3 14:00:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 14:00:08.657327 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ad18de-3e31-4f99-9d20-0f9de2634fe2 None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:08.664845 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 316/616] 10.222.0.36 () {56 vars in 1103 bytes} [Tue May 3 14:00:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 14:00:08.670217 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118644ce-7554-4a6c-98f5-0358e546b0a3 None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:08.753956 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ad18de-3e31-4f99-9d20-0f9de2634fe2 None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:08.787966 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118644ce-7554-4a6c-98f5-0358e546b0a3 None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:08.788293 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39152dc-4a27-4346-873e-b7f16ab7309d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:08.788873 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39152dc-4a27-4346-873e-b7f16ab7309d None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:08.789154 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39152dc-4a27-4346-873e-b7f16ab7309d None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:08.789460 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39152dc-4a27-4346-873e-b7f16ab7309d None admin] PATH_INFO: `/v3/domains` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:08.790185 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39152dc-4a27-4346-873e-b7f16ab7309d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80012) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:00:08.790489 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39152dc-4a27-4346-873e-b7f16ab7309d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:08.792353 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39152dc-4a27-4346-873e-b7f16ab7309d None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:08.804587 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 301/617] 10.222.0.36 () {56 vars in 1109 bytes} [Tue May 3 14:00:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 14:00:08.810542 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cc091c-b51e-4ac5-9490-06acc7ec2774 None None] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:08.810864 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cc091c-b51e-4ac5-9490-06acc7ec2774 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:08.811115 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cc091c-b51e-4ac5-9490-06acc7ec2774 None None] PATH_INFO: `/` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:08.816592 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 302/618] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 3 14:00:08 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 14:00:08.816592 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cc091c-b51e-4ac5-9490-06acc7ec2774 None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:08.829229 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a210ca-3204-4647-84be-c6f1d7f63464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:08.830290 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a210ca-3204-4647-84be-c6f1d7f63464 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:08.830714 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a210ca-3204-4647-84be-c6f1d7f63464 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:08.831130 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a210ca-3204-4647-84be-c6f1d7f63464 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:08.842779 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a210ca-3204-4647-84be-c6f1d7f63464 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:08.844445 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a210ca-3204-4647-84be-c6f1d7f63464 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:08.862122 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application [None req-b6a210ca-3204-4647-84be-c6f1d7f63464 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 14:00:08.862122 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:00:08.862122 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 14:00:08.862122 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 14:00:08.862122 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 14:00:08.862122 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 14:00:08.862122 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 14:00:08.862122 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 14:00:08.862122 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 14:00:08.862122 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 14:00:08.862122 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 14:00:08.862122 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 14:00:08.862122 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 14:00:08.862122 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 14:00:08.862122 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 14:00:08.863274 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 14:00:08.863274 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 14:00:08.863274 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 14:00:08.863274 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 14:00:08.863274 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 14:00:08.863274 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 14:00:08.863274 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.get_or_create( May 03 14:00:08.863274 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 14:00:08.863274 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application with Lock( May 03 14:00:08.863274 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 14:00:08.863274 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._enter() May 03 14:00:08.863274 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 14:00:08.863274 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 14:00:08.863274 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 14:00:08.863274 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.creator() May 03 14:00:08.863274 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 14:00:08.863274 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application created_value = creator( May 03 14:00:08.864168 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 14:00:08.864168 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 14:00:08.864168 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 14:00:08.864168 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application May 03 14:00:08.870604 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 317/619] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 3 14:00:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 14:00:08.872108 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8707a48-34e9-4b71-a795-4fd37850a6f0 None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:08.872676 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8707a48-34e9-4b71-a795-4fd37850a6f0 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:08.873156 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8707a48-34e9-4b71-a795-4fd37850a6f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:08.890050 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-f8707a48-34e9-4b71-a795-4fd37850a6f0 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:00:08.891969 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-f8707a48-34e9-4b71-a795-4fd37850a6f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:00:08.922423 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cc091c-b51e-4ac5-9490-06acc7ec2774 None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:08.956715 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8157bf55-e49e-4b7d-b149-5d1e5ca493d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:08.957712 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8157bf55-e49e-4b7d-b149-5d1e5ca493d9 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:08.958131 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8157bf55-e49e-4b7d-b149-5d1e5ca493d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:08.958470 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8157bf55-e49e-4b7d-b149-5d1e5ca493d9 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:08.966782 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8157bf55-e49e-4b7d-b149-5d1e5ca493d9 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:08.967466 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 318/620] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 3 14:00:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 14:00:08.968406 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8157bf55-e49e-4b7d-b149-5d1e5ca493d9 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:08.968863 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8707a48-34e9-4b71-a795-4fd37850a6f0 None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:08.986014 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application [None req-8157bf55-e49e-4b7d-b149-5d1e5ca493d9 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 03 14:00:08.986014 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:00:08.986014 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 14:00:08.986014 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 14:00:08.986014 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 14:00:08.986014 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 14:00:08.986014 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 14:00:08.986014 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 14:00:08.986014 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 14:00:08.986014 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 14:00:08.986014 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 14:00:08.986014 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 14:00:08.986014 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 14:00:08.986014 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 14:00:08.986014 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 14:00:08.986014 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 14:00:08.987027 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 14:00:08.987027 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 14:00:08.987027 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 14:00:08.987027 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 14:00:08.987027 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 14:00:08.987027 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 14:00:08.987027 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 14:00:08.987027 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 14:00:08.987027 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 14:00:08.987027 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.get_or_create( May 03 14:00:08.987027 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 14:00:08.987027 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application with Lock( May 03 14:00:08.987027 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 14:00:08.987027 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._enter() May 03 14:00:08.987027 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 14:00:08.987027 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 14:00:08.987027 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 14:00:08.987027 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.creator() May 03 14:00:08.987996 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 14:00:08.987996 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application created_value = creator( May 03 14:00:08.987996 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 14:00:08.987996 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 14:00:08.987996 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 14:00:08.987996 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 14:00:08.987996 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 14:00:08.987996 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 14:00:08.987996 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 03 14:00:08.987996 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application May 03 14:00:08.987996 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 303/621] 10.222.0.36 () {56 vars in 1096 bytes} [Tue May 3 14:00:08 2022] GET /identity/v3/users/swift => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 14:00:08.994411 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8157bf55-e49e-4b7d-b149-5d1e5ca493d9 None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:09.111529 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8707a48-34e9-4b71-a795-4fd37850a6f0 None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:09.111884 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8157bf55-e49e-4b7d-b149-5d1e5ca493d9 None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:09.144904 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf79aa4e-4853-4883-b946-4e7066df538e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:09.145617 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf79aa4e-4853-4883-b946-4e7066df538e None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:09.145900 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf79aa4e-4853-4883-b946-4e7066df538e None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:09.146153 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf79aa4e-4853-4883-b946-4e7066df538e None admin] PATH_INFO: `/v3/users` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:09.147048 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf79aa4e-4853-4883-b946-4e7066df538e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80012) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:00:09.147362 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf79aa4e-4853-4883-b946-4e7066df538e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:09.148874 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf79aa4e-4853-4883-b946-4e7066df538e None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:09.154680 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ec9501-6ea2-4db4-9230-57ca9c54bce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:09.155938 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ec9501-6ea2-4db4-9230-57ca9c54bce6 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:09.156425 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ec9501-6ea2-4db4-9230-57ca9c54bce6 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:09.157074 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ec9501-6ea2-4db4-9230-57ca9c54bce6 None admin] PATH_INFO: `/v3/domains` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:09.158851 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ec9501-6ea2-4db4-9230-57ca9c54bce6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:00:09.159372 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ec9501-6ea2-4db4-9230-57ca9c54bce6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:09.160954 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ec9501-6ea2-4db4-9230-57ca9c54bce6 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:09.171273 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 304/622] 10.222.0.36 () {56 vars in 1135 bytes} [Tue May 3 14:00:08 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 14:00:09.171273 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf79aa4e-4853-4883-b946-4e7066df538e None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:09.181600 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 319/623] 10.222.0.36 () {56 vars in 1109 bytes} [Tue May 3 14:00:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:00:09.182354 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ec9501-6ea2-4db4-9230-57ca9c54bce6 None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:09.283692 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ec9501-6ea2-4db4-9230-57ca9c54bce6 None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:09.296549 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf79aa4e-4853-4883-b946-4e7066df538e None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:09.320291 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb95b88-c93e-4de2-84b4-3f40d5210b97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:09.321884 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb95b88-c93e-4de2-84b4-3f40d5210b97 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:09.322378 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb95b88-c93e-4de2-84b4-3f40d5210b97 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:09.323155 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb95b88-c93e-4de2-84b4-3f40d5210b97 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:09.334968 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ee08a9-f6ff-4f76-8c23-db3c811549b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:09.335776 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ee08a9-f6ff-4f76-8c23-db3c811549b3 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:09.336092 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ee08a9-f6ff-4f76-8c23-db3c811549b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:09.336313 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ee08a9-f6ff-4f76-8c23-db3c811549b3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:09.338436 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb95b88-c93e-4de2-84b4-3f40d5210b97 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:09.340359 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb95b88-c93e-4de2-84b4-3f40d5210b97 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:09.348048 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ee08a9-f6ff-4f76-8c23-db3c811549b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 14:00:09.355847 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application [None req-c4ee08a9-f6ff-4f76-8c23-db3c811549b3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 03 14:00:09.355847 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:00:09.355847 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 14:00:09.355847 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 14:00:09.355847 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 14:00:09.355847 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 14:00:09.355847 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 14:00:09.355847 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 14:00:09.355847 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 14:00:09.355847 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 14:00:09.355847 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 14:00:09.355847 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 14:00:09.355847 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 14:00:09.355847 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 14:00:09.355847 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 14:00:09.355847 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 14:00:09.356977 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 14:00:09.356977 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 14:00:09.356977 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 14:00:09.356977 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 14:00:09.356977 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 14:00:09.356977 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 14:00:09.356977 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 14:00:09.356977 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 14:00:09.356977 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 14:00:09.356977 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.get_or_create( May 03 14:00:09.356977 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 14:00:09.356977 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application with Lock( May 03 14:00:09.356977 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 14:00:09.356977 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._enter() May 03 14:00:09.356977 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 14:00:09.356977 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 14:00:09.358489 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 14:00:09.358489 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.creator() May 03 14:00:09.358489 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 14:00:09.358489 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application created_value = creator( May 03 14:00:09.358489 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 14:00:09.358489 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 14:00:09.358489 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 14:00:09.358489 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 14:00:09.358489 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 14:00:09.358489 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 14:00:09.358489 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 03 14:00:09.358489 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application May 03 14:00:09.361935 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 305/624] 10.222.0.36 () {56 vars in 1102 bytes} [Tue May 3 14:00:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 14:00:09.362811 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ee08a9-f6ff-4f76-8c23-db3c811549b3 None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:09.372613 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application [None req-1bb95b88-c93e-4de2-84b4-3f40d5210b97 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 14:00:09.372613 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:00:09.372613 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 14:00:09.372613 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 14:00:09.372613 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 14:00:09.372613 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 14:00:09.372613 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 14:00:09.372613 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 14:00:09.372613 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 14:00:09.372613 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 14:00:09.372613 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 14:00:09.372613 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 14:00:09.372613 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 14:00:09.372613 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 14:00:09.372613 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 14:00:09.373627 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 14:00:09.373627 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 14:00:09.373627 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 14:00:09.373627 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 14:00:09.373627 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 14:00:09.373627 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 14:00:09.373627 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.get_or_create( May 03 14:00:09.373627 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 14:00:09.373627 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application with Lock( May 03 14:00:09.373627 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 14:00:09.373627 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._enter() May 03 14:00:09.373627 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 14:00:09.373627 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 14:00:09.373627 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 14:00:09.373627 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.creator() May 03 14:00:09.373627 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 14:00:09.373627 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application created_value = creator( May 03 14:00:09.374558 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 14:00:09.374558 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 14:00:09.374558 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 14:00:09.374558 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application May 03 14:00:09.377219 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 320/625] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 3 14:00:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 14:00:09.378585 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb95b88-c93e-4de2-84b4-3f40d5210b97 None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:09.460553 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ee08a9-f6ff-4f76-8c23-db3c811549b3 None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:09.488381 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb95b88-c93e-4de2-84b4-3f40d5210b97 None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:09.492671 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8117fd4e-8355-4582-83c3-10a8e8f00161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:09.493499 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8117fd4e-8355-4582-83c3-10a8e8f00161 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:09.493795 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8117fd4e-8355-4582-83c3-10a8e8f00161 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:09.494053 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8117fd4e-8355-4582-83c3-10a8e8f00161 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:09.501509 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8117fd4e-8355-4582-83c3-10a8e8f00161 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:09.502945 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8117fd4e-8355-4582-83c3-10a8e8f00161 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:09.516906 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application [None req-8117fd4e-8355-4582-83c3-10a8e8f00161 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 03 14:00:09.516906 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:00:09.516906 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 14:00:09.516906 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 14:00:09.516906 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 14:00:09.516906 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 14:00:09.516906 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 14:00:09.516906 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 14:00:09.516906 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 14:00:09.516906 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 14:00:09.516906 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 14:00:09.516906 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 14:00:09.516906 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 14:00:09.516906 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 14:00:09.516906 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 14:00:09.516906 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 14:00:09.517912 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 14:00:09.517912 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 14:00:09.517912 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 14:00:09.517912 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 14:00:09.517912 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 14:00:09.517912 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 14:00:09.517912 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 14:00:09.517912 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 14:00:09.517912 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 14:00:09.517912 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.get_or_create( May 03 14:00:09.517912 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 14:00:09.517912 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application with Lock( May 03 14:00:09.517912 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 14:00:09.517912 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._enter() May 03 14:00:09.517912 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 14:00:09.517912 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 14:00:09.517912 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 14:00:09.517912 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.creator() May 03 14:00:09.518873 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 14:00:09.518873 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application created_value = creator( May 03 14:00:09.518873 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 14:00:09.518873 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 14:00:09.518873 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 14:00:09.518873 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 14:00:09.518873 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 14:00:09.518873 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 14:00:09.518873 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 03 14:00:09.518873 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application May 03 14:00:09.518873 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 306/626] 10.222.0.36 () {56 vars in 1093 bytes} [Tue May 3 14:00:09 2022] GET /identity/v3/users/nova => generated 82 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 14:00:09.519478 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8117fd4e-8355-4582-83c3-10a8e8f00161 None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:09.523574 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190f6f59-25a5-4b65-8467-879c8fa8fae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:09.524270 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190f6f59-25a5-4b65-8467-879c8fa8fae0 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:09.524550 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190f6f59-25a5-4b65-8467-879c8fa8fae0 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:09.524823 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190f6f59-25a5-4b65-8467-879c8fa8fae0 None admin] PATH_INFO: `/v3/roles` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:09.525602 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190f6f59-25a5-4b65-8467-879c8fa8fae0 None admin] RBAC: Adding query filter params (name=service) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:00:09.525905 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190f6f59-25a5-4b65-8467-879c8fa8fae0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:09.527275 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190f6f59-25a5-4b65-8467-879c8fa8fae0 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:09.540125 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 321/627] 10.222.0.36 () {56 vars in 1103 bytes} [Tue May 3 14:00:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:00:09.540125 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9517cb4b-391f-4cf2-9283-bca6d9d6d2c1 None None] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:09.540125 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9517cb4b-391f-4cf2-9283-bca6d9d6d2c1 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:09.540125 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9517cb4b-391f-4cf2-9283-bca6d9d6d2c1 None None] PATH_INFO: `/` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:09.540125 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 322/628] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 3 14:00:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 14:00:09.540125 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9517cb4b-391f-4cf2-9283-bca6d9d6d2c1 None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:09.631865 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8117fd4e-8355-4582-83c3-10a8e8f00161 None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:09.640533 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9517cb4b-391f-4cf2-9283-bca6d9d6d2c1 None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:09.663543 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9357da-3360-4775-8917-45a8f1b9b61a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:09.664189 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9357da-3360-4775-8917-45a8f1b9b61a None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:09.664478 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9357da-3360-4775-8917-45a8f1b9b61a None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:09.664745 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9357da-3360-4775-8917-45a8f1b9b61a None admin] PATH_INFO: `/v3/domains` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:09.665482 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9357da-3360-4775-8917-45a8f1b9b61a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80012) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:00:09.665779 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9357da-3360-4775-8917-45a8f1b9b61a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:09.667144 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9357da-3360-4775-8917-45a8f1b9b61a None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:09.673494 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3f5406-7d7c-47c4-95ac-ae3a288a1ccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:09.674163 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3f5406-7d7c-47c4-95ac-ae3a288a1ccf None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:09.674491 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3f5406-7d7c-47c4-95ac-ae3a288a1ccf None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:09.674813 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3f5406-7d7c-47c4-95ac-ae3a288a1ccf None admin] PATH_INFO: `/v3/users` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:09.675649 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3f5406-7d7c-47c4-95ac-ae3a288a1ccf None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:00:09.675952 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3f5406-7d7c-47c4-95ac-ae3a288a1ccf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:09.677435 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3f5406-7d7c-47c4-95ac-ae3a288a1ccf None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:09.682900 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 307/629] 10.222.0.36 () {56 vars in 1109 bytes} [Tue May 3 14:00:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:00:09.682900 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9357da-3360-4775-8917-45a8f1b9b61a None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:09.705031 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 323/630] 10.222.0.36 () {56 vars in 1133 bytes} [Tue May 3 14:00:09 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:00:09.706824 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3153ec84-a763-4f22-ba37-c42aa23b0846 None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:09.707572 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3153ec84-a763-4f22-ba37-c42aa23b0846 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:09.707944 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3153ec84-a763-4f22-ba37-c42aa23b0846 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:09.725733 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-3153ec84-a763-4f22-ba37-c42aa23b0846 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:00:09.726872 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-3153ec84-a763-4f22-ba37-c42aa23b0846 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:00:09.783076 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9357da-3360-4775-8917-45a8f1b9b61a None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:09.801313 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 324/631] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 3 14:00:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 14:00:09.801313 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3153ec84-a763-4f22-ba37-c42aa23b0846 None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:09.827875 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e205812-6a56-40bc-b275-31e6028f436c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:09.829062 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e205812-6a56-40bc-b275-31e6028f436c None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:09.829387 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e205812-6a56-40bc-b275-31e6028f436c None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:09.829663 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e205812-6a56-40bc-b275-31e6028f436c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:09.839722 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e205812-6a56-40bc-b275-31e6028f436c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:09.841250 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e205812-6a56-40bc-b275-31e6028f436c None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:09.858515 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application [None req-3e205812-6a56-40bc-b275-31e6028f436c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 14:00:09.858515 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:00:09.858515 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 14:00:09.858515 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 14:00:09.858515 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 14:00:09.858515 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 14:00:09.858515 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 14:00:09.858515 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 14:00:09.858515 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 14:00:09.858515 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 14:00:09.858515 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 14:00:09.858515 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 14:00:09.858515 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 14:00:09.858515 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 14:00:09.858515 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 14:00:09.859429 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 14:00:09.859429 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 14:00:09.859429 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 14:00:09.859429 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 14:00:09.859429 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 14:00:09.859429 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 14:00:09.859429 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.get_or_create( May 03 14:00:09.859429 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 14:00:09.859429 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application with Lock( May 03 14:00:09.859429 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 14:00:09.859429 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._enter() May 03 14:00:09.859429 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 14:00:09.859429 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 14:00:09.859429 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 14:00:09.859429 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.creator() May 03 14:00:09.859429 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 14:00:09.859429 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application created_value = creator( May 03 14:00:09.860375 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 14:00:09.860375 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 14:00:09.860375 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 14:00:09.860375 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application May 03 14:00:09.860375 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 308/632] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 3 14:00:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 14:00:09.861110 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e205812-6a56-40bc-b275-31e6028f436c None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:09.896246 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3153ec84-a763-4f22-ba37-c42aa23b0846 None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:09.928954 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286d4209-92cb-4746-b818-37c595685f7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:09.929799 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286d4209-92cb-4746-b818-37c595685f7d None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:09.930075 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286d4209-92cb-4746-b818-37c595685f7d None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:09.930346 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286d4209-92cb-4746-b818-37c595685f7d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:09.939109 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286d4209-92cb-4746-b818-37c595685f7d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:09.940586 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286d4209-92cb-4746-b818-37c595685f7d None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:09.955472 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application [None req-286d4209-92cb-4746-b818-37c595685f7d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 14:00:09.955472 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:00:09.955472 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 14:00:09.955472 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 14:00:09.955472 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 14:00:09.955472 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 14:00:09.955472 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 14:00:09.955472 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 14:00:09.955472 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 14:00:09.955472 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 14:00:09.955472 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 14:00:09.955472 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 14:00:09.955472 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 14:00:09.955472 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 14:00:09.955472 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 14:00:09.956518 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 14:00:09.956518 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 14:00:09.956518 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 14:00:09.956518 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 14:00:09.956518 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 14:00:09.956518 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 14:00:09.956518 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.get_or_create( May 03 14:00:09.956518 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 14:00:09.956518 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application with Lock( May 03 14:00:09.956518 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 14:00:09.956518 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._enter() May 03 14:00:09.956518 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 14:00:09.956518 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 14:00:09.956518 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 14:00:09.956518 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.creator() May 03 14:00:09.956518 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 14:00:09.956518 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application created_value = creator( May 03 14:00:09.957469 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 14:00:09.957469 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 14:00:09.957469 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 14:00:09.957469 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 14:00:09.957469 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 14:00:09.957469 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 14:00:09.957469 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 14:00:09.957469 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application May 03 14:00:09.957469 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 325/633] 10.222.0.36 () {56 vars in 1111 bytes} [Tue May 3 14:00:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 14:00:09.958083 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286d4209-92cb-4746-b818-37c595685f7d None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:09.971617 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e205812-6a56-40bc-b275-31e6028f436c None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:10.004315 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d272912a-3ec2-4193-9bc6-b713feb961be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:10.004959 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d272912a-3ec2-4193-9bc6-b713feb961be None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:10.005233 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d272912a-3ec2-4193-9bc6-b713feb961be None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:10.005530 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d272912a-3ec2-4193-9bc6-b713feb961be None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:10.062909 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286d4209-92cb-4746-b818-37c595685f7d None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:10.074987 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d272912a-3ec2-4193-9bc6-b713feb961be None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:10.077373 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d272912a-3ec2-4193-9bc6-b713feb961be None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:10.096042 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ebc6fe-8076-49ff-8cec-ec397f37800f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:10.096848 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ebc6fe-8076-49ff-8cec-ec397f37800f None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:10.097124 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ebc6fe-8076-49ff-8cec-ec397f37800f None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:10.097425 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ebc6fe-8076-49ff-8cec-ec397f37800f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:10.108202 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ebc6fe-8076-49ff-8cec-ec397f37800f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 14:00:10.115901 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application [None req-11ebc6fe-8076-49ff-8cec-ec397f37800f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 03 14:00:10.115901 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:00:10.115901 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 14:00:10.115901 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 14:00:10.115901 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 14:00:10.115901 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 14:00:10.115901 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 14:00:10.115901 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 14:00:10.115901 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 14:00:10.115901 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 14:00:10.115901 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 14:00:10.115901 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 14:00:10.115901 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 14:00:10.115901 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 14:00:10.115901 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 14:00:10.115901 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 14:00:10.116890 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 14:00:10.116890 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 14:00:10.116890 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 14:00:10.116890 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 14:00:10.116890 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 14:00:10.116890 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 14:00:10.116890 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 14:00:10.116890 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 14:00:10.116890 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 14:00:10.116890 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.get_or_create( May 03 14:00:10.116890 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 14:00:10.116890 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application with Lock( May 03 14:00:10.116890 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 14:00:10.116890 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._enter() May 03 14:00:10.116890 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 14:00:10.116890 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 14:00:10.117814 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 14:00:10.117814 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.creator() May 03 14:00:10.117814 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 14:00:10.117814 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application created_value = creator( May 03 14:00:10.117814 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 14:00:10.117814 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 14:00:10.117814 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 14:00:10.117814 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 14:00:10.117814 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 14:00:10.117814 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 14:00:10.117814 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 03 14:00:10.117814 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application May 03 14:00:10.121942 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 326/634] 10.222.0.36 () {56 vars in 1102 bytes} [Tue May 3 14:00:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 14:00:10.122709 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ebc6fe-8076-49ff-8cec-ec397f37800f None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:10.174168 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 309/635] 10.222.0.36 () {58 vars in 1282 bytes} [Tue May 3 14:00:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 03 14:00:10.174918 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d272912a-3ec2-4193-9bc6-b713feb961be None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:10.217691 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ebc6fe-8076-49ff-8cec-ec397f37800f None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:10.251755 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd132484-7b16-4ece-bb37-fa18a25e64c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:10.252409 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd132484-7b16-4ece-bb37-fa18a25e64c3 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:10.252681 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd132484-7b16-4ece-bb37-fa18a25e64c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:10.252975 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd132484-7b16-4ece-bb37-fa18a25e64c3 None admin] PATH_INFO: `/v3/domains` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:10.253723 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd132484-7b16-4ece-bb37-fa18a25e64c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:00:10.254021 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd132484-7b16-4ece-bb37-fa18a25e64c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:10.255385 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd132484-7b16-4ece-bb37-fa18a25e64c3 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:10.266806 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 327/636] 10.222.0.36 () {56 vars in 1109 bytes} [Tue May 3 14:00:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:00:10.267564 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd132484-7b16-4ece-bb37-fa18a25e64c3 None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:10.274109 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d272912a-3ec2-4193-9bc6-b713feb961be None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:10.307498 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f85757-887a-4fe8-95a2-d272f60cb849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:10.308144 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f85757-887a-4fe8-95a2-d272f60cb849 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:10.308394 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f85757-887a-4fe8-95a2-d272f60cb849 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:10.308688 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f85757-887a-4fe8-95a2-d272f60cb849 None admin] PATH_INFO: `/v3/projects` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:10.309501 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f85757-887a-4fe8-95a2-d272f60cb849 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80012) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:00:10.309812 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f85757-887a-4fe8-95a2-d272f60cb849 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:10.311567 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f85757-887a-4fe8-95a2-d272f60cb849 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:10.322583 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 310/637] 10.222.0.36 () {56 vars in 1148 bytes} [Tue May 3 14:00:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:00:10.323792 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32349049-2089-4833-95cc-86bf813667b5 None None] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:10.324084 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32349049-2089-4833-95cc-86bf813667b5 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:10.324362 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32349049-2089-4833-95cc-86bf813667b5 None None] PATH_INFO: `/` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:10.325795 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 311/638] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 3 14:00:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 14:00:10.330329 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32349049-2089-4833-95cc-86bf813667b5 None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:10.362936 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd132484-7b16-4ece-bb37-fa18a25e64c3 None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:10.394355 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a190b7-a1f0-4b7f-b8da-ceff1138f0aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:10.395018 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a190b7-a1f0-4b7f-b8da-ceff1138f0aa None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:10.395298 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a190b7-a1f0-4b7f-b8da-ceff1138f0aa None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:10.395571 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a190b7-a1f0-4b7f-b8da-ceff1138f0aa None admin] PATH_INFO: `/v3/roles` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:10.396308 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a190b7-a1f0-4b7f-b8da-ceff1138f0aa None admin] RBAC: Adding query filter params (name=service) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:00:10.396609 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a190b7-a1f0-4b7f-b8da-ceff1138f0aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:10.398016 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a190b7-a1f0-4b7f-b8da-ceff1138f0aa None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:10.410460 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 328/639] 10.222.0.36 () {56 vars in 1103 bytes} [Tue May 3 14:00:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:00:10.410460 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a190b7-a1f0-4b7f-b8da-ceff1138f0aa None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:10.424389 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32349049-2089-4833-95cc-86bf813667b5 None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:10.455876 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0a1a3b-38e0-4d97-abaf-97eefd78ed48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:10.456668 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0a1a3b-38e0-4d97-abaf-97eefd78ed48 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:10.456953 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0a1a3b-38e0-4d97-abaf-97eefd78ed48 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:10.457222 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0a1a3b-38e0-4d97-abaf-97eefd78ed48 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:10.467517 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0a1a3b-38e0-4d97-abaf-97eefd78ed48 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:10.468976 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0a1a3b-38e0-4d97-abaf-97eefd78ed48 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:10.485140 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application [None req-3e0a1a3b-38e0-4d97-abaf-97eefd78ed48 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 14:00:10.485140 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:00:10.485140 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 14:00:10.485140 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 14:00:10.485140 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 14:00:10.485140 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 14:00:10.485140 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 14:00:10.485140 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 14:00:10.485140 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 14:00:10.485140 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 14:00:10.485140 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 14:00:10.485140 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 14:00:10.485140 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 14:00:10.485140 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 14:00:10.485140 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 14:00:10.486184 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 14:00:10.486184 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 14:00:10.486184 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 14:00:10.486184 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 14:00:10.486184 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 14:00:10.486184 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 14:00:10.486184 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.get_or_create( May 03 14:00:10.486184 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 14:00:10.486184 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application with Lock( May 03 14:00:10.486184 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 14:00:10.486184 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._enter() May 03 14:00:10.486184 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 14:00:10.486184 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 14:00:10.486184 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 14:00:10.486184 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.creator() May 03 14:00:10.486184 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 14:00:10.486184 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application created_value = creator( May 03 14:00:10.487085 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 14:00:10.487085 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 14:00:10.487085 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 14:00:10.487085 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application May 03 14:00:10.487085 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 312/640] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 3 14:00:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 14:00:10.487085 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0a1a3b-38e0-4d97-abaf-97eefd78ed48 None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:10.502535 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a190b7-a1f0-4b7f-b8da-ceff1138f0aa None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:10.534906 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91a57c9-52bc-40a7-9e6e-8db65f0fa640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:10.535696 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91a57c9-52bc-40a7-9e6e-8db65f0fa640 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:10.535976 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91a57c9-52bc-40a7-9e6e-8db65f0fa640 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:10.536252 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91a57c9-52bc-40a7-9e6e-8db65f0fa640 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:10.544389 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91a57c9-52bc-40a7-9e6e-8db65f0fa640 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:10.545922 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91a57c9-52bc-40a7-9e6e-8db65f0fa640 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:10.559767 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application [None req-c91a57c9-52bc-40a7-9e6e-8db65f0fa640 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 03 14:00:10.559767 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:00:10.559767 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 14:00:10.559767 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 14:00:10.559767 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 14:00:10.559767 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 14:00:10.559767 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 14:00:10.559767 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 14:00:10.559767 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 14:00:10.559767 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 14:00:10.559767 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 14:00:10.559767 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 14:00:10.559767 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 14:00:10.559767 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 14:00:10.559767 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 14:00:10.559767 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 14:00:10.561485 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 14:00:10.561485 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 14:00:10.561485 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 14:00:10.561485 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 14:00:10.561485 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 14:00:10.561485 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 14:00:10.561485 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 14:00:10.561485 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 14:00:10.561485 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 14:00:10.561485 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.get_or_create( May 03 14:00:10.561485 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 14:00:10.561485 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application with Lock( May 03 14:00:10.561485 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 14:00:10.561485 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._enter() May 03 14:00:10.561485 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 14:00:10.561485 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 14:00:10.561485 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 14:00:10.561485 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.creator() May 03 14:00:10.562725 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 14:00:10.562725 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application created_value = creator( May 03 14:00:10.562725 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 14:00:10.562725 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 14:00:10.562725 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 14:00:10.562725 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 14:00:10.562725 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 14:00:10.562725 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 14:00:10.562725 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 03 14:00:10.562725 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application May 03 14:00:10.562725 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 329/641] 10.222.0.36 () {56 vars in 1099 bytes} [Tue May 3 14:00:10 2022] GET /identity/v3/users/glance => generated 84 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 14:00:10.562725 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3407276-4fc7-43ec-b4ee-a7baa882f305 None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:10.563627 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3407276-4fc7-43ec-b4ee-a7baa882f305 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:10.563627 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3407276-4fc7-43ec-b4ee-a7baa882f305 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:10.579643 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-b3407276-4fc7-43ec-b4ee-a7baa882f305 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:00:10.580841 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-b3407276-4fc7-43ec-b4ee-a7baa882f305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:00:10.587118 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0a1a3b-38e0-4d97-abaf-97eefd78ed48 None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:10.620622 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89792bc2-ef1a-4874-bcb8-1f13da32b62f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:10.621524 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89792bc2-ef1a-4874-bcb8-1f13da32b62f None admin] REQUEST_METHOD: `PUT` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:10.621797 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89792bc2-ef1a-4874-bcb8-1f13da32b62f None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:10.622065 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89792bc2-ef1a-4874-bcb8-1f13da32b62f None admin] PATH_INFO: `/v3/projects/de541be478754087934323bdbe41a579/users/e1180e29180d44418390cf22d3e0bd6f/roles/b3902525744e454694820e2ea3b2e563` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:10.636263 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89792bc2-ef1a-4874-bcb8-1f13da32b62f None admin] RBAC: Authorizing `identity:create_grant(project_id=de541be478754087934323bdbe41a579, user_id=e1180e29180d44418390cf22d3e0bd6f, role_id=b3902525744e454694820e2ea3b2e563)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:10.637742 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89792bc2-ef1a-4874-bcb8-1f13da32b62f None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:10.646405 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 330/642] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 3 14:00:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 14:00:10.647315 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3407276-4fc7-43ec-b4ee-a7baa882f305 None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:10.651168 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 313/643] 10.222.0.36 () {58 vars in 1439 bytes} [Tue May 3 14:00:10 2022] PUT /identity/v3/projects/de541be478754087934323bdbe41a579/users/e1180e29180d44418390cf22d3e0bd6f/roles/b3902525744e454694820e2ea3b2e563 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:00:10.652176 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89792bc2-ef1a-4874-bcb8-1f13da32b62f None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:10.755824 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3407276-4fc7-43ec-b4ee-a7baa882f305 None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:10.769610 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89792bc2-ef1a-4874-bcb8-1f13da32b62f None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:10.792161 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817541b5-b16e-4c2f-8574-a4c2298a655b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:10.793250 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817541b5-b16e-4c2f-8574-a4c2298a655b None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:10.793558 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817541b5-b16e-4c2f-8574-a4c2298a655b None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:10.793835 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817541b5-b16e-4c2f-8574-a4c2298a655b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:10.804590 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817541b5-b16e-4c2f-8574-a4c2298a655b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:10.806085 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817541b5-b16e-4c2f-8574-a4c2298a655b None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:10.810822 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43426fae-b558-4d4c-aa31-94a0d15e0bd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:10.811499 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43426fae-b558-4d4c-aa31-94a0d15e0bd2 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:10.811782 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43426fae-b558-4d4c-aa31-94a0d15e0bd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:10.812053 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43426fae-b558-4d4c-aa31-94a0d15e0bd2 None admin] PATH_INFO: `/v3/domains` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:10.812782 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43426fae-b558-4d4c-aa31-94a0d15e0bd2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80012) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:00:10.813085 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43426fae-b558-4d4c-aa31-94a0d15e0bd2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:10.815445 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43426fae-b558-4d4c-aa31-94a0d15e0bd2 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:10.824430 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application [None req-817541b5-b16e-4c2f-8574-a4c2298a655b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 14:00:10.824430 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:00:10.824430 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 14:00:10.824430 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 14:00:10.824430 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 14:00:10.824430 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 14:00:10.824430 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 14:00:10.824430 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 14:00:10.824430 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 14:00:10.824430 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 14:00:10.824430 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 14:00:10.824430 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 14:00:10.824430 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 14:00:10.824430 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 14:00:10.824430 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 14:00:10.825560 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 14:00:10.825560 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 14:00:10.825560 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 14:00:10.825560 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 14:00:10.825560 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 14:00:10.825560 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 14:00:10.825560 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.get_or_create( May 03 14:00:10.825560 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 14:00:10.825560 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application with Lock( May 03 14:00:10.825560 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 14:00:10.825560 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._enter() May 03 14:00:10.825560 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 14:00:10.825560 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 14:00:10.825560 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 14:00:10.825560 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.creator() May 03 14:00:10.825560 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 14:00:10.825560 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application created_value = creator( May 03 14:00:10.826586 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 14:00:10.826586 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 14:00:10.826586 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 14:00:10.826586 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application May 03 14:00:10.832128 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 314/644] 10.222.0.36 () {56 vars in 1109 bytes} [Tue May 3 14:00:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:00:10.832128 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43426fae-b558-4d4c-aa31-94a0d15e0bd2 None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:10.832386 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 331/645] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 3 14:00:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 14:00:10.832386 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817541b5-b16e-4c2f-8574-a4c2298a655b None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:10.930385 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43426fae-b558-4d4c-aa31-94a0d15e0bd2 None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:10.932264 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817541b5-b16e-4c2f-8574-a4c2298a655b None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:10.962271 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39d7f8f-3331-41e9-a9ae-142f428b3be6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:10.963020 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39d7f8f-3331-41e9-a9ae-142f428b3be6 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:10.963300 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39d7f8f-3331-41e9-a9ae-142f428b3be6 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:10.963573 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39d7f8f-3331-41e9-a9ae-142f428b3be6 None admin] PATH_INFO: `/v3/users` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:10.964714 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39d7f8f-3331-41e9-a9ae-142f428b3be6 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80012) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:00:10.965016 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39d7f8f-3331-41e9-a9ae-142f428b3be6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:10.966084 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fadacb-9bce-4cc2-9d95-ec0874747ca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:10.966517 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39d7f8f-3331-41e9-a9ae-142f428b3be6 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:10.966870 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fadacb-9bce-4cc2-9d95-ec0874747ca0 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:10.967148 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fadacb-9bce-4cc2-9d95-ec0874747ca0 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:10.967419 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fadacb-9bce-4cc2-9d95-ec0874747ca0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:10.977437 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fadacb-9bce-4cc2-9d95-ec0874747ca0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 14:00:10.988395 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 315/646] 10.222.0.36 () {56 vars in 1137 bytes} [Tue May 3 14:00:10 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:00:10.988395 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39d7f8f-3331-41e9-a9ae-142f428b3be6 None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:10.988988 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application [None req-46fadacb-9bce-4cc2-9d95-ec0874747ca0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 03 14:00:10.988988 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:00:10.988988 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 14:00:10.988988 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 14:00:10.988988 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 14:00:10.988988 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 14:00:10.988988 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 14:00:10.988988 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 14:00:10.988988 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 14:00:10.988988 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 14:00:10.988988 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 14:00:10.988988 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 14:00:10.988988 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 14:00:10.988988 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 14:00:10.988988 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 14:00:10.988988 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 14:00:10.989905 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 14:00:10.989905 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 14:00:10.989905 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 14:00:10.989905 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 14:00:10.989905 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 14:00:10.989905 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 14:00:10.989905 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 14:00:10.989905 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 14:00:10.989905 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 14:00:10.989905 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.get_or_create( May 03 14:00:10.989905 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 14:00:10.989905 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application with Lock( May 03 14:00:10.989905 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 14:00:10.989905 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._enter() May 03 14:00:10.989905 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 14:00:10.989905 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 14:00:10.990773 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 14:00:10.990773 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.creator() May 03 14:00:10.990773 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 14:00:10.990773 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application created_value = creator( May 03 14:00:10.990773 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 14:00:10.990773 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 14:00:10.990773 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 14:00:10.990773 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 14:00:10.990773 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 14:00:10.990773 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 14:00:10.990773 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 03 14:00:10.990773 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application May 03 14:00:10.990773 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 332/647] 10.222.0.36 () {56 vars in 1102 bytes} [Tue May 3 14:00:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 14:00:10.990773 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fadacb-9bce-4cc2-9d95-ec0874747ca0 None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:11.086795 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fadacb-9bce-4cc2-9d95-ec0874747ca0 None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:11.096799 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39d7f8f-3331-41e9-a9ae-142f428b3be6 None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:11.123960 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353555ca-cbc2-4b5a-9ff2-8f7ffa0a1029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:11.124751 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353555ca-cbc2-4b5a-9ff2-8f7ffa0a1029 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:11.125236 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353555ca-cbc2-4b5a-9ff2-8f7ffa0a1029 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:11.125386 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353555ca-cbc2-4b5a-9ff2-8f7ffa0a1029 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:11.129521 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc0e583-8165-441f-8059-651123308b3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:11.130182 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc0e583-8165-441f-8059-651123308b3f None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:11.130460 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc0e583-8165-441f-8059-651123308b3f None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:11.130807 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc0e583-8165-441f-8059-651123308b3f None admin] PATH_INFO: `/v3/domains` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:11.131527 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc0e583-8165-441f-8059-651123308b3f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80012) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:00:11.131831 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc0e583-8165-441f-8059-651123308b3f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:11.131938 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353555ca-cbc2-4b5a-9ff2-8f7ffa0a1029 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:11.133215 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc0e583-8165-441f-8059-651123308b3f None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:11.133403 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353555ca-cbc2-4b5a-9ff2-8f7ffa0a1029 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:11.149012 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 316/648] 10.222.0.36 () {56 vars in 1109 bytes} [Tue May 3 14:00:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:00:11.149012 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc0e583-8165-441f-8059-651123308b3f None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:11.149237 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application [None req-353555ca-cbc2-4b5a-9ff2-8f7ffa0a1029 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 14:00:11.149237 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:00:11.149237 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 14:00:11.149237 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 14:00:11.149237 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 14:00:11.149237 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 14:00:11.149237 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 14:00:11.149237 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 14:00:11.149237 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 14:00:11.149237 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 14:00:11.149237 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 14:00:11.149237 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 14:00:11.149237 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 14:00:11.149237 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 14:00:11.149237 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 14:00:11.150181 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 14:00:11.150181 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 14:00:11.150181 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 14:00:11.150181 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 14:00:11.150181 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 14:00:11.150181 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 14:00:11.150181 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.get_or_create( May 03 14:00:11.150181 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 14:00:11.150181 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application with Lock( May 03 14:00:11.150181 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 14:00:11.150181 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._enter() May 03 14:00:11.150181 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 14:00:11.150181 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 14:00:11.150181 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 14:00:11.150181 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.creator() May 03 14:00:11.150181 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 14:00:11.150181 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application created_value = creator( May 03 14:00:11.151083 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 14:00:11.151083 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 14:00:11.151083 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 14:00:11.151083 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 14:00:11.151083 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 14:00:11.151083 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 14:00:11.151083 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 14:00:11.151083 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application May 03 14:00:11.151083 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 333/649] 10.222.0.36 () {56 vars in 1111 bytes} [Tue May 3 14:00:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 14:00:11.151083 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353555ca-cbc2-4b5a-9ff2-8f7ffa0a1029 None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:11.244846 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353555ca-cbc2-4b5a-9ff2-8f7ffa0a1029 None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:11.245080 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc0e583-8165-441f-8059-651123308b3f None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:11.277125 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c5d5f0-9124-4a07-93e9-40428a4472d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:11.277815 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c5d5f0-9124-4a07-93e9-40428a4472d3 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:11.278087 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c5d5f0-9124-4a07-93e9-40428a4472d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:11.278356 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c5d5f0-9124-4a07-93e9-40428a4472d3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:11.279227 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a421835-8751-4625-b0ac-88be89c7b2de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:11.279883 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a421835-8751-4625-b0ac-88be89c7b2de None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:11.280165 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a421835-8751-4625-b0ac-88be89c7b2de None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:11.280533 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a421835-8751-4625-b0ac-88be89c7b2de None admin] PATH_INFO: `/v3/roles` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:11.281323 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a421835-8751-4625-b0ac-88be89c7b2de None admin] RBAC: Adding query filter params (name=service) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:00:11.281638 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a421835-8751-4625-b0ac-88be89c7b2de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:11.283030 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a421835-8751-4625-b0ac-88be89c7b2de None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:11.293380 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 334/650] 10.222.0.36 () {56 vars in 1103 bytes} [Tue May 3 14:00:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:00:11.293380 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a421835-8751-4625-b0ac-88be89c7b2de None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:11.350008 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c5d5f0-9124-4a07-93e9-40428a4472d3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:11.351360 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c5d5f0-9124-4a07-93e9-40428a4472d3 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:11.401550 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a421835-8751-4625-b0ac-88be89c7b2de None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:11.434296 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b4b1b7-f10c-4d52-9849-99bdf7569bb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:11.435221 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b4b1b7-f10c-4d52-9849-99bdf7569bb4 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:11.435491 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b4b1b7-f10c-4d52-9849-99bdf7569bb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:11.435756 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b4b1b7-f10c-4d52-9849-99bdf7569bb4 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:11.443387 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b4b1b7-f10c-4d52-9849-99bdf7569bb4 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:11.445061 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b4b1b7-f10c-4d52-9849-99bdf7569bb4 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:11.449588 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 317/651] 10.222.0.36 () {58 vars in 1282 bytes} [Tue May 3 14:00:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 03 14:00:11.450502 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c5d5f0-9124-4a07-93e9-40428a4472d3 None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:11.462078 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application [None req-07b4b1b7-f10c-4d52-9849-99bdf7569bb4 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 03 14:00:11.462078 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:00:11.462078 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 14:00:11.462078 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 14:00:11.462078 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 14:00:11.462078 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 14:00:11.462078 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 14:00:11.462078 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 14:00:11.462078 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 14:00:11.462078 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 14:00:11.462078 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 14:00:11.462078 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 14:00:11.462078 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 14:00:11.462078 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 14:00:11.462078 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 14:00:11.462078 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 14:00:11.463115 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 14:00:11.463115 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 14:00:11.463115 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 14:00:11.463115 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 14:00:11.463115 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 14:00:11.463115 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 14:00:11.463115 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 14:00:11.463115 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 14:00:11.463115 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 14:00:11.463115 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.get_or_create( May 03 14:00:11.463115 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 14:00:11.463115 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application with Lock( May 03 14:00:11.463115 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 14:00:11.463115 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._enter() May 03 14:00:11.463115 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 14:00:11.463115 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 14:00:11.463115 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 14:00:11.463115 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.creator() May 03 14:00:11.464397 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 14:00:11.464397 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application created_value = creator( May 03 14:00:11.464397 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 14:00:11.464397 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 14:00:11.464397 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 14:00:11.464397 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 14:00:11.464397 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 14:00:11.464397 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 14:00:11.464397 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 03 14:00:11.464397 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application May 03 14:00:11.468660 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 335/652] 10.222.0.36 () {56 vars in 1099 bytes} [Tue May 3 14:00:11 2022] GET /identity/v3/users/cinder => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 14:00:11.469197 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b4b1b7-f10c-4d52-9849-99bdf7569bb4 None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:11.548620 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c5d5f0-9124-4a07-93e9-40428a4472d3 None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:11.566622 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b4b1b7-f10c-4d52-9849-99bdf7569bb4 None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:11.581495 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd97214-ff32-4b7a-bd52-d216481e125a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:11.582163 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd97214-ff32-4b7a-bd52-d216481e125a None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:11.582445 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd97214-ff32-4b7a-bd52-d216481e125a None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:11.582722 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd97214-ff32-4b7a-bd52-d216481e125a None admin] PATH_INFO: `/v3/projects` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:11.583510 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd97214-ff32-4b7a-bd52-d216481e125a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80012) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:00:11.583821 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd97214-ff32-4b7a-bd52-d216481e125a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:11.585242 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd97214-ff32-4b7a-bd52-d216481e125a None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:11.597329 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 318/653] 10.222.0.36 () {56 vars in 1148 bytes} [Tue May 3 14:00:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:00:11.597738 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd97214-ff32-4b7a-bd52-d216481e125a None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:11.606142 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b145436-4e79-4061-86e2-d8ba60a45543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:11.606932 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b145436-4e79-4061-86e2-d8ba60a45543 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:11.607213 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b145436-4e79-4061-86e2-d8ba60a45543 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:11.607499 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b145436-4e79-4061-86e2-d8ba60a45543 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:11.618461 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b145436-4e79-4061-86e2-d8ba60a45543 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:11.620143 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b145436-4e79-4061-86e2-d8ba60a45543 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:11.638113 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application [None req-4b145436-4e79-4061-86e2-d8ba60a45543 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 14:00:11.638113 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:00:11.638113 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 14:00:11.638113 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 14:00:11.638113 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 14:00:11.638113 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 14:00:11.638113 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 14:00:11.638113 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 14:00:11.638113 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 14:00:11.638113 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 14:00:11.638113 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 14:00:11.638113 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 14:00:11.638113 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 14:00:11.638113 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 14:00:11.638113 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 14:00:11.639278 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 14:00:11.639278 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 14:00:11.639278 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 14:00:11.639278 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 14:00:11.639278 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 14:00:11.639278 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 14:00:11.639278 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.get_or_create( May 03 14:00:11.639278 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 14:00:11.639278 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application with Lock( May 03 14:00:11.639278 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 14:00:11.639278 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._enter() May 03 14:00:11.639278 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 14:00:11.639278 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 14:00:11.639278 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 14:00:11.639278 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.creator() May 03 14:00:11.639278 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 14:00:11.639278 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application created_value = creator( May 03 14:00:11.645403 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 14:00:11.645403 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 14:00:11.645403 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 14:00:11.645403 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application May 03 14:00:11.645403 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 336/654] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 3 14:00:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 14:00:11.645403 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b145436-4e79-4061-86e2-d8ba60a45543 None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:11.704975 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd97214-ff32-4b7a-bd52-d216481e125a None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:11.738731 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859e651e-e5a1-4117-90b5-f5788b86b9f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:11.739691 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859e651e-e5a1-4117-90b5-f5788b86b9f1 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:11.740282 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859e651e-e5a1-4117-90b5-f5788b86b9f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:11.740651 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859e651e-e5a1-4117-90b5-f5788b86b9f1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:11.747896 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b145436-4e79-4061-86e2-d8ba60a45543 None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:11.751446 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859e651e-e5a1-4117-90b5-f5788b86b9f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:11.752900 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859e651e-e5a1-4117-90b5-f5788b86b9f1 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:11.780150 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application [None req-859e651e-e5a1-4117-90b5-f5788b86b9f1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 14:00:11.780150 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:00:11.780150 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 14:00:11.780150 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 14:00:11.780150 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 14:00:11.780150 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 14:00:11.780150 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 14:00:11.780150 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 14:00:11.780150 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 14:00:11.780150 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 14:00:11.780150 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 14:00:11.780150 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 14:00:11.780150 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 14:00:11.780150 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 14:00:11.780150 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 14:00:11.781151 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 14:00:11.781151 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 14:00:11.781151 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 14:00:11.781151 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 14:00:11.781151 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 14:00:11.781151 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 14:00:11.781151 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.get_or_create( May 03 14:00:11.781151 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 14:00:11.781151 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application with Lock( May 03 14:00:11.781151 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 14:00:11.781151 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._enter() May 03 14:00:11.781151 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 14:00:11.781151 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 14:00:11.781151 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 14:00:11.781151 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.creator() May 03 14:00:11.781151 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 14:00:11.781151 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application created_value = creator( May 03 14:00:11.782146 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 14:00:11.782146 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 14:00:11.782146 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 14:00:11.782146 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application May 03 14:00:11.782146 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 319/655] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 3 14:00:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 14:00:11.782441 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859e651e-e5a1-4117-90b5-f5788b86b9f1 None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:11.787220 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bc8b9a-2ec3-4573-bb5d-0fde0033f9e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:11.787966 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bc8b9a-2ec3-4573-bb5d-0fde0033f9e4 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:11.788252 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bc8b9a-2ec3-4573-bb5d-0fde0033f9e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:11.788531 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bc8b9a-2ec3-4573-bb5d-0fde0033f9e4 None admin] PATH_INFO: `/v3/users` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:11.789414 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bc8b9a-2ec3-4573-bb5d-0fde0033f9e4 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:00:11.789726 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bc8b9a-2ec3-4573-bb5d-0fde0033f9e4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:11.791166 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bc8b9a-2ec3-4573-bb5d-0fde0033f9e4 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:11.808823 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 337/656] 10.222.0.36 () {56 vars in 1137 bytes} [Tue May 3 14:00:11 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:00:11.809702 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bc8b9a-2ec3-4573-bb5d-0fde0033f9e4 None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:11.887952 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859e651e-e5a1-4117-90b5-f5788b86b9f1 None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:11.909489 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bc8b9a-2ec3-4573-bb5d-0fde0033f9e4 None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:11.919679 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09f3be4-aff1-489c-85a0-a814f571a577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:11.920397 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09f3be4-aff1-489c-85a0-a814f571a577 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:11.920757 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09f3be4-aff1-489c-85a0-a814f571a577 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:11.921092 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09f3be4-aff1-489c-85a0-a814f571a577 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:11.921996 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09f3be4-aff1-489c-85a0-a814f571a577 None admin] RBAC: Adding query filter params (role.id=b3902525744e454694820e2ea3b2e563, scope.project.id=de541be478754087934323bdbe41a579, user.id=63489e658c094a2598a2ac62159d2fda) {{(pid=80012) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:00:11.922353 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09f3be4-aff1-489c-85a0-a814f571a577 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:11.923856 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09f3be4-aff1-489c-85a0-a814f571a577 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:11.938979 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 320/657] 10.222.0.36 () {56 vars in 1374 bytes} [Tue May 3 14:00:11 2022] GET /identity/v3/role_assignments?user.id=63489e658c094a2598a2ac62159d2fda&scope.project.id=de541be478754087934323bdbe41a579&role.id=b3902525744e454694820e2ea3b2e563 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:00:11.938979 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09f3be4-aff1-489c-85a0-a814f571a577 None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:11.958370 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1965c3d9-6152-40c4-8f3e-cabde434b5c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:11.959075 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1965c3d9-6152-40c4-8f3e-cabde434b5c5 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:11.959359 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1965c3d9-6152-40c4-8f3e-cabde434b5c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:11.959638 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1965c3d9-6152-40c4-8f3e-cabde434b5c5 None admin] PATH_INFO: `/v3/domains` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:11.960386 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1965c3d9-6152-40c4-8f3e-cabde434b5c5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:00:11.960697 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1965c3d9-6152-40c4-8f3e-cabde434b5c5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:11.962237 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1965c3d9-6152-40c4-8f3e-cabde434b5c5 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:11.975347 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 338/658] 10.222.0.36 () {56 vars in 1109 bytes} [Tue May 3 14:00:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:00:11.976229 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1965c3d9-6152-40c4-8f3e-cabde434b5c5 None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:12.045450 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09f3be4-aff1-489c-85a0-a814f571a577 None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:12.082368 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498548e1-31bc-4760-83d6-5153d1259905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:12.083959 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498548e1-31bc-4760-83d6-5153d1259905 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:12.084497 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498548e1-31bc-4760-83d6-5153d1259905 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:12.085139 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498548e1-31bc-4760-83d6-5153d1259905 None admin] PATH_INFO: `/v3/domains` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:12.086786 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498548e1-31bc-4760-83d6-5153d1259905 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80012) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:00:12.087343 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498548e1-31bc-4760-83d6-5153d1259905 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:12.088511 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1965c3d9-6152-40c4-8f3e-cabde434b5c5 None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:12.089515 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498548e1-31bc-4760-83d6-5153d1259905 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:12.115048 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 321/659] 10.222.0.36 () {56 vars in 1109 bytes} [Tue May 3 14:00:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:00:12.116091 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498548e1-31bc-4760-83d6-5153d1259905 None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:12.132179 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cca42d-84d8-4df6-9ea1-201b168934b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:12.133207 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cca42d-84d8-4df6-9ea1-201b168934b1 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:12.133736 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cca42d-84d8-4df6-9ea1-201b168934b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:12.134200 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cca42d-84d8-4df6-9ea1-201b168934b1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:12.220355 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cca42d-84d8-4df6-9ea1-201b168934b1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:12.222085 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cca42d-84d8-4df6-9ea1-201b168934b1 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:12.230264 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498548e1-31bc-4760-83d6-5153d1259905 None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:12.271770 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95998fd-22a1-4ef8-a04c-75a7dc0a7e1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:12.272962 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95998fd-22a1-4ef8-a04c-75a7dc0a7e1e None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:12.273488 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95998fd-22a1-4ef8-a04c-75a7dc0a7e1e None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:12.273966 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95998fd-22a1-4ef8-a04c-75a7dc0a7e1e None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:12.281596 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95998fd-22a1-4ef8-a04c-75a7dc0a7e1e None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:12.283370 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95998fd-22a1-4ef8-a04c-75a7dc0a7e1e None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:12.300050 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application [None req-c95998fd-22a1-4ef8-a04c-75a7dc0a7e1e None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 03 14:00:12.300050 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:00:12.300050 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 14:00:12.300050 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 14:00:12.300050 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 14:00:12.300050 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 14:00:12.300050 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 14:00:12.300050 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 14:00:12.300050 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 14:00:12.300050 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 14:00:12.300050 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 14:00:12.300050 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 14:00:12.300050 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 14:00:12.300050 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 14:00:12.300050 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 14:00:12.300050 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 14:00:12.301065 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 14:00:12.301065 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 14:00:12.301065 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 14:00:12.301065 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 14:00:12.301065 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 14:00:12.301065 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 14:00:12.301065 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 14:00:12.301065 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 14:00:12.301065 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 14:00:12.301065 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.get_or_create( May 03 14:00:12.301065 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 14:00:12.301065 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application with Lock( May 03 14:00:12.301065 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 14:00:12.301065 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._enter() May 03 14:00:12.301065 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 14:00:12.301065 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 14:00:12.301065 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 14:00:12.301065 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.creator() May 03 14:00:12.302056 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 14:00:12.302056 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application created_value = creator( May 03 14:00:12.302056 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 14:00:12.302056 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 14:00:12.302056 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 14:00:12.302056 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 14:00:12.302056 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 14:00:12.302056 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 14:00:12.302056 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 03 14:00:12.302056 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application May 03 14:00:12.304694 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 322/660] 10.222.0.36 () {56 vars in 1102 bytes} [Tue May 3 14:00:12 2022] GET /identity/v3/users/neutron => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 14:00:12.305717 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95998fd-22a1-4ef8-a04c-75a7dc0a7e1e None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:12.336323 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 339/661] 10.222.0.36 () {58 vars in 1282 bytes} [Tue May 3 14:00:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 03 14:00:12.337126 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cca42d-84d8-4df6-9ea1-201b168934b1 None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:12.403822 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95998fd-22a1-4ef8-a04c-75a7dc0a7e1e None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:12.435297 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cca42d-84d8-4df6-9ea1-201b168934b1 None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:12.437792 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b13418-4aa3-4c30-bba6-9fe3f20f295d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:12.438811 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b13418-4aa3-4c30-bba6-9fe3f20f295d None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:12.439303 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b13418-4aa3-4c30-bba6-9fe3f20f295d None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:12.439764 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b13418-4aa3-4c30-bba6-9fe3f20f295d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:12.446890 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b13418-4aa3-4c30-bba6-9fe3f20f295d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:12.448641 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b13418-4aa3-4c30-bba6-9fe3f20f295d None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:12.462718 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application [None req-54b13418-4aa3-4c30-bba6-9fe3f20f295d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 14:00:12.462718 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:00:12.462718 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 14:00:12.462718 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 14:00:12.462718 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 14:00:12.462718 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 14:00:12.462718 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 14:00:12.462718 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 14:00:12.462718 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 14:00:12.462718 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 14:00:12.462718 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 14:00:12.462718 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 14:00:12.462718 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 14:00:12.462718 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 14:00:12.462718 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 14:00:12.463660 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 14:00:12.463660 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 14:00:12.463660 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 14:00:12.463660 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 14:00:12.463660 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 14:00:12.463660 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 14:00:12.463660 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.get_or_create( May 03 14:00:12.463660 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 14:00:12.463660 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application with Lock( May 03 14:00:12.463660 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 14:00:12.463660 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._enter() May 03 14:00:12.463660 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 14:00:12.463660 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 14:00:12.463660 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 14:00:12.463660 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.creator() May 03 14:00:12.463660 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 14:00:12.463660 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application created_value = creator( May 03 14:00:12.464897 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 14:00:12.464897 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 14:00:12.464897 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 14:00:12.464897 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 14:00:12.464897 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 14:00:12.464897 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 14:00:12.464897 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 14:00:12.464897 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application May 03 14:00:12.467760 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 323/662] 10.222.0.36 () {56 vars in 1111 bytes} [Tue May 3 14:00:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 14:00:12.469115 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b13418-4aa3-4c30-bba6-9fe3f20f295d None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:12.470146 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5056089f-e068-4499-8df4-12054cfed8a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:12.470855 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5056089f-e068-4499-8df4-12054cfed8a4 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:12.471082 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5056089f-e068-4499-8df4-12054cfed8a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:12.471352 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5056089f-e068-4499-8df4-12054cfed8a4 None admin] PATH_INFO: `/v3/users` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:12.472291 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5056089f-e068-4499-8df4-12054cfed8a4 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:00:12.472598 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5056089f-e068-4499-8df4-12054cfed8a4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:12.474354 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5056089f-e068-4499-8df4-12054cfed8a4 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:12.491786 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 340/663] 10.222.0.36 () {56 vars in 1139 bytes} [Tue May 3 14:00:12 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:00:12.497022 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5056089f-e068-4499-8df4-12054cfed8a4 None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:12.568483 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b13418-4aa3-4c30-bba6-9fe3f20f295d None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:12.593887 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5056089f-e068-4499-8df4-12054cfed8a4 None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:12.606440 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c59a33f-ac79-4f9e-8d80-4b61142753ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:12.607700 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c59a33f-ac79-4f9e-8d80-4b61142753ee None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:12.608234 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c59a33f-ac79-4f9e-8d80-4b61142753ee None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:12.608700 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c59a33f-ac79-4f9e-8d80-4b61142753ee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:12.621388 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c59a33f-ac79-4f9e-8d80-4b61142753ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:12.624996 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c59a33f-ac79-4f9e-8d80-4b61142753ee None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:12.627865 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985bdd25-0c53-4500-8ace-440f370fb087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:12.628638 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985bdd25-0c53-4500-8ace-440f370fb087 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:12.628849 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985bdd25-0c53-4500-8ace-440f370fb087 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:12.629073 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985bdd25-0c53-4500-8ace-440f370fb087 None admin] PATH_INFO: `/v3/projects` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:12.629908 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985bdd25-0c53-4500-8ace-440f370fb087 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:00:12.630466 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985bdd25-0c53-4500-8ace-440f370fb087 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:12.631620 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985bdd25-0c53-4500-8ace-440f370fb087 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:12.644540 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 341/664] 10.222.0.36 () {56 vars in 1148 bytes} [Tue May 3 14:00:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:00:12.645623 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985bdd25-0c53-4500-8ace-440f370fb087 None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:12.646662 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application [None req-5c59a33f-ac79-4f9e-8d80-4b61142753ee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 14:00:12.646662 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:00:12.646662 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 14:00:12.646662 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 14:00:12.646662 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 14:00:12.646662 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 14:00:12.646662 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 14:00:12.646662 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 14:00:12.646662 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 14:00:12.646662 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 14:00:12.646662 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 14:00:12.646662 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 14:00:12.646662 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 14:00:12.646662 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 14:00:12.646662 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 14:00:12.647543 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 14:00:12.647543 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 14:00:12.647543 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 14:00:12.647543 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 14:00:12.647543 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 14:00:12.647543 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 14:00:12.647543 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.get_or_create( May 03 14:00:12.647543 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 14:00:12.647543 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application with Lock( May 03 14:00:12.647543 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 14:00:12.647543 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._enter() May 03 14:00:12.647543 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 14:00:12.647543 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 14:00:12.647543 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 14:00:12.647543 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.creator() May 03 14:00:12.647543 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 14:00:12.647543 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application created_value = creator( May 03 14:00:12.648481 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 14:00:12.648481 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 14:00:12.648481 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 14:00:12.648481 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application May 03 14:00:12.650749 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 324/665] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 3 14:00:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 14:00:12.651819 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c59a33f-ac79-4f9e-8d80-4b61142753ee None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:12.748645 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985bdd25-0c53-4500-8ace-440f370fb087 None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:12.753635 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c59a33f-ac79-4f9e-8d80-4b61142753ee None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:12.782704 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c417617a-75da-400a-8a81-62aacd329991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:12.783211 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c417617a-75da-400a-8a81-62aacd329991 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:12.783490 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c417617a-75da-400a-8a81-62aacd329991 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:12.783767 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c417617a-75da-400a-8a81-62aacd329991 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:12.788343 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59609cd8-2254-4f8c-8b61-b93994467f7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:12.789233 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59609cd8-2254-4f8c-8b61-b93994467f7b None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:12.789775 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59609cd8-2254-4f8c-8b61-b93994467f7b None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:12.790242 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59609cd8-2254-4f8c-8b61-b93994467f7b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:12.791275 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59609cd8-2254-4f8c-8b61-b93994467f7b None admin] RBAC: Adding query filter params (role.id=b3902525744e454694820e2ea3b2e563, scope.project.id=de541be478754087934323bdbe41a579, user.id=616de5e7daed46849efc75ad77ea054e) {{(pid=80012) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:00:12.791847 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59609cd8-2254-4f8c-8b61-b93994467f7b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:12.793560 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59609cd8-2254-4f8c-8b61-b93994467f7b None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:12.800172 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 325/666] 10.222.0.36 () {56 vars in 1374 bytes} [Tue May 3 14:00:12 2022] GET /identity/v3/role_assignments?user.id=616de5e7daed46849efc75ad77ea054e&scope.project.id=de541be478754087934323bdbe41a579&role.id=b3902525744e454694820e2ea3b2e563 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:00:12.801312 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59609cd8-2254-4f8c-8b61-b93994467f7b None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:12.855251 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c417617a-75da-400a-8a81-62aacd329991 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:12.856961 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c417617a-75da-400a-8a81-62aacd329991 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:12.903829 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59609cd8-2254-4f8c-8b61-b93994467f7b None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:12.945122 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484994f1-1da0-4f57-bc29-6e3e50c9dfaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:12.945839 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484994f1-1da0-4f57-bc29-6e3e50c9dfaf None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:12.946686 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484994f1-1da0-4f57-bc29-6e3e50c9dfaf None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:12.946985 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484994f1-1da0-4f57-bc29-6e3e50c9dfaf None admin] PATH_INFO: `/v3/domains` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:12.948025 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484994f1-1da0-4f57-bc29-6e3e50c9dfaf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80012) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:00:12.948339 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484994f1-1da0-4f57-bc29-6e3e50c9dfaf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:12.950352 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484994f1-1da0-4f57-bc29-6e3e50c9dfaf None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:12.959659 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 342/667] 10.222.0.36 () {58 vars in 1282 bytes} [Tue May 3 14:00:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 03 14:00:12.966285 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 326/668] 10.222.0.36 () {56 vars in 1109 bytes} [Tue May 3 14:00:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:00:12.966742 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4329f1e-23b4-400d-acb0-c253cc4fdf7a None None] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:12.967351 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4329f1e-23b4-400d-acb0-c253cc4fdf7a None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:12.967636 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4329f1e-23b4-400d-acb0-c253cc4fdf7a None None] PATH_INFO: `/` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:12.969176 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 343/669] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 3 14:00:12 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 14:00:12.974371 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484994f1-1da0-4f57-bc29-6e3e50c9dfaf None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:12.974685 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4329f1e-23b4-400d-acb0-c253cc4fdf7a None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:13.098499 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484994f1-1da0-4f57-bc29-6e3e50c9dfaf None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:13.102169 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4329f1e-23b4-400d-acb0-c253cc4fdf7a None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:13.140130 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdaa74b-eeb8-4df4-82ce-92970db8c604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:13.141023 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdaa74b-eeb8-4df4-82ce-92970db8c604 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:13.141363 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdaa74b-eeb8-4df4-82ce-92970db8c604 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:13.141612 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdaa74b-eeb8-4df4-82ce-92970db8c604 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:13.143160 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e61f17-116d-4d3b-8045-b4011522bc89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:13.143968 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e61f17-116d-4d3b-8045-b4011522bc89 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:13.144245 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e61f17-116d-4d3b-8045-b4011522bc89 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:13.144526 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e61f17-116d-4d3b-8045-b4011522bc89 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:13.151382 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e61f17-116d-4d3b-8045-b4011522bc89 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:13.152827 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e61f17-116d-4d3b-8045-b4011522bc89 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:13.153093 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdaa74b-eeb8-4df4-82ce-92970db8c604 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:13.155111 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdaa74b-eeb8-4df4-82ce-92970db8c604 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:13.168332 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application [None req-a1e61f17-116d-4d3b-8045-b4011522bc89 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 14:00:13.168332 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:00:13.168332 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 14:00:13.168332 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 14:00:13.168332 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 14:00:13.168332 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 14:00:13.168332 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 14:00:13.168332 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 14:00:13.168332 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 14:00:13.168332 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 14:00:13.168332 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 14:00:13.168332 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 14:00:13.168332 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 14:00:13.168332 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 14:00:13.168332 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 14:00:13.169388 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 14:00:13.169388 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 14:00:13.169388 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 14:00:13.169388 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 14:00:13.169388 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 14:00:13.169388 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 14:00:13.169388 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.get_or_create( May 03 14:00:13.169388 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 14:00:13.169388 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application with Lock( May 03 14:00:13.169388 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 14:00:13.169388 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._enter() May 03 14:00:13.169388 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 14:00:13.169388 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 14:00:13.169388 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 14:00:13.169388 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.creator() May 03 14:00:13.169388 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 14:00:13.169388 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application created_value = creator( May 03 14:00:13.170447 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 14:00:13.170447 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 14:00:13.170447 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 14:00:13.170447 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 14:00:13.170447 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 14:00:13.170447 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 14:00:13.170447 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 14:00:13.170447 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application May 03 14:00:13.172644 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application [None req-0cdaa74b-eeb8-4df4-82ce-92970db8c604 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 14:00:13.172644 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:00:13.172644 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 14:00:13.172644 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 14:00:13.172644 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 14:00:13.172644 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 14:00:13.172644 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 14:00:13.172644 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 14:00:13.172644 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 14:00:13.172644 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 14:00:13.172644 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 14:00:13.172644 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 14:00:13.172644 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 14:00:13.172644 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 14:00:13.172644 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 14:00:13.174758 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 14:00:13.174758 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 14:00:13.174758 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 14:00:13.174758 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 14:00:13.174758 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 14:00:13.174758 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 14:00:13.174758 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.get_or_create( May 03 14:00:13.174758 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 14:00:13.174758 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application with Lock( May 03 14:00:13.174758 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 14:00:13.174758 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._enter() May 03 14:00:13.174758 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 14:00:13.174758 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 14:00:13.174758 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 14:00:13.174758 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.creator() May 03 14:00:13.174758 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 14:00:13.174758 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application created_value = creator( May 03 14:00:13.176847 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 14:00:13.176847 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 14:00:13.176847 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 14:00:13.176847 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application May 03 14:00:13.176847 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 327/670] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 3 14:00:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 14:00:13.176847 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f1d2e7-efa8-48d5-bc5d-d8fa26296a1b None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:13.176847 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f1d2e7-efa8-48d5-bc5d-d8fa26296a1b None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:13.176847 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f1d2e7-efa8-48d5-bc5d-d8fa26296a1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:13.179427 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 344/671] 10.222.0.36 () {56 vars in 1111 bytes} [Tue May 3 14:00:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 14:00:13.184189 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e61f17-116d-4d3b-8045-b4011522bc89 None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:13.197441 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-35f1d2e7-efa8-48d5-bc5d-d8fa26296a1b None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:00:13.198592 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-35f1d2e7-efa8-48d5-bc5d-d8fa26296a1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:00:13.278933 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 328/672] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 3 14:00:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 14:00:13.279890 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f1d2e7-efa8-48d5-bc5d-d8fa26296a1b None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:13.304162 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e61f17-116d-4d3b-8045-b4011522bc89 None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:13.351576 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8a6eb3-861a-4097-ac5b-4bf674d6db25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:13.352160 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8a6eb3-861a-4097-ac5b-4bf674d6db25 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:13.352428 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8a6eb3-861a-4097-ac5b-4bf674d6db25 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:13.352695 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8a6eb3-861a-4097-ac5b-4bf674d6db25 None admin] PATH_INFO: `/v3/domains` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:13.353438 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8a6eb3-861a-4097-ac5b-4bf674d6db25 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:00:13.353738 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8a6eb3-861a-4097-ac5b-4bf674d6db25 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:13.355106 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8a6eb3-861a-4097-ac5b-4bf674d6db25 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:13.371356 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 345/673] 10.222.0.36 () {56 vars in 1109 bytes} [Tue May 3 14:00:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:00:13.371356 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8a6eb3-861a-4097-ac5b-4bf674d6db25 None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:13.396327 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f1d2e7-efa8-48d5-bc5d-d8fa26296a1b None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:13.435639 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e1c33e-6154-4ef6-95b7-f9c08813b442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:13.436309 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e1c33e-6154-4ef6-95b7-f9c08813b442 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:13.436581 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e1c33e-6154-4ef6-95b7-f9c08813b442 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:13.436856 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e1c33e-6154-4ef6-95b7-f9c08813b442 None admin] PATH_INFO: `/v3/projects` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:13.437659 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e1c33e-6154-4ef6-95b7-f9c08813b442 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80012) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:00:13.437963 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e1c33e-6154-4ef6-95b7-f9c08813b442 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:13.439401 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e1c33e-6154-4ef6-95b7-f9c08813b442 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:13.455668 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 329/674] 10.222.0.36 () {56 vars in 1148 bytes} [Tue May 3 14:00:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:00:13.456565 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e1c33e-6154-4ef6-95b7-f9c08813b442 None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:13.499924 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8a6eb3-861a-4097-ac5b-4bf674d6db25 None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:13.542325 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c962f6-f230-4f4c-8652-a73503cb6e4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:13.543774 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c962f6-f230-4f4c-8652-a73503cb6e4e None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:13.544559 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c962f6-f230-4f4c-8652-a73503cb6e4e None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:13.545179 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c962f6-f230-4f4c-8652-a73503cb6e4e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:13.557708 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c962f6-f230-4f4c-8652-a73503cb6e4e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 14:00:13.565551 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e1c33e-6154-4ef6-95b7-f9c08813b442 None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:13.568548 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application [None req-24c962f6-f230-4f4c-8652-a73503cb6e4e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 03 14:00:13.568548 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:00:13.568548 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 14:00:13.568548 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 14:00:13.568548 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 14:00:13.568548 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 14:00:13.568548 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 14:00:13.568548 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 14:00:13.568548 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 14:00:13.568548 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 14:00:13.568548 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 14:00:13.568548 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 14:00:13.568548 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 14:00:13.568548 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 14:00:13.568548 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 14:00:13.568548 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 14:00:13.569722 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 14:00:13.569722 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 14:00:13.569722 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 14:00:13.569722 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 14:00:13.569722 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 14:00:13.569722 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 14:00:13.569722 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 14:00:13.569722 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 14:00:13.569722 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 14:00:13.569722 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.get_or_create( May 03 14:00:13.569722 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 14:00:13.569722 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application with Lock( May 03 14:00:13.569722 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 14:00:13.569722 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._enter() May 03 14:00:13.569722 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 14:00:13.569722 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 14:00:13.570764 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 14:00:13.570764 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.creator() May 03 14:00:13.570764 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 14:00:13.570764 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application created_value = creator( May 03 14:00:13.570764 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 14:00:13.570764 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 14:00:13.570764 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 14:00:13.570764 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 14:00:13.570764 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 14:00:13.570764 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 14:00:13.570764 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 03 14:00:13.570764 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application May 03 14:00:13.573167 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 346/675] 10.222.0.36 () {56 vars in 1102 bytes} [Tue May 3 14:00:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 14:00:13.574176 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c962f6-f230-4f4c-8652-a73503cb6e4e None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:13.606535 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642937a0-c028-49b2-a7ec-0073d15fe0cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:13.608843 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642937a0-c028-49b2-a7ec-0073d15fe0cb None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:13.608843 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642937a0-c028-49b2-a7ec-0073d15fe0cb None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:13.608843 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642937a0-c028-49b2-a7ec-0073d15fe0cb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:13.615565 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642937a0-c028-49b2-a7ec-0073d15fe0cb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:13.617191 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642937a0-c028-49b2-a7ec-0073d15fe0cb None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:13.632025 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application [None req-642937a0-c028-49b2-a7ec-0073d15fe0cb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 14:00:13.632025 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:00:13.632025 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 14:00:13.632025 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 14:00:13.632025 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 14:00:13.632025 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 14:00:13.632025 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 14:00:13.632025 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 14:00:13.632025 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 14:00:13.632025 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 14:00:13.632025 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 14:00:13.632025 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 14:00:13.632025 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 14:00:13.632025 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 14:00:13.632025 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 14:00:13.633181 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 14:00:13.633181 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 14:00:13.633181 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 14:00:13.633181 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 14:00:13.633181 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 14:00:13.633181 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 14:00:13.633181 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.get_or_create( May 03 14:00:13.633181 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 14:00:13.633181 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application with Lock( May 03 14:00:13.633181 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 14:00:13.633181 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._enter() May 03 14:00:13.633181 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 14:00:13.633181 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 14:00:13.633181 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 14:00:13.633181 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.creator() May 03 14:00:13.633181 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 14:00:13.633181 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application created_value = creator( May 03 14:00:13.634387 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 14:00:13.634387 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 14:00:13.634387 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 14:00:13.634387 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 14:00:13.634387 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 14:00:13.634387 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 14:00:13.634387 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 14:00:13.634387 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application May 03 14:00:13.641197 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 330/676] 10.222.0.36 () {56 vars in 1111 bytes} [Tue May 3 14:00:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 14:00:13.642282 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642937a0-c028-49b2-a7ec-0073d15fe0cb None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:13.684625 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c962f6-f230-4f4c-8652-a73503cb6e4e None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:13.719121 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e12d95-0173-44da-adb6-b5b046e24d64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:13.720218 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e12d95-0173-44da-adb6-b5b046e24d64 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:13.720340 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e12d95-0173-44da-adb6-b5b046e24d64 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:13.720715 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e12d95-0173-44da-adb6-b5b046e24d64 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:13.721681 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e12d95-0173-44da-adb6-b5b046e24d64 None admin] RBAC: Adding query filter params (role.id=b3902525744e454694820e2ea3b2e563, scope.project.id=de541be478754087934323bdbe41a579, user.id=5b014f4c7ba1414cb8a597f5bc4033f7) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:00:13.722081 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e12d95-0173-44da-adb6-b5b046e24d64 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:13.723651 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e12d95-0173-44da-adb6-b5b046e24d64 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:13.730477 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 347/677] 10.222.0.36 () {56 vars in 1374 bytes} [Tue May 3 14:00:13 2022] GET /identity/v3/role_assignments?user.id=5b014f4c7ba1414cb8a597f5bc4033f7&scope.project.id=de541be478754087934323bdbe41a579&role.id=b3902525744e454694820e2ea3b2e563 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:00:13.738136 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e12d95-0173-44da-adb6-b5b046e24d64 None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:13.742901 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642937a0-c028-49b2-a7ec-0073d15fe0cb None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:13.778360 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a67b25c-2d53-4935-b811-e746d3ffb1eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:13.779421 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a67b25c-2d53-4935-b811-e746d3ffb1eb None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:13.779859 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a67b25c-2d53-4935-b811-e746d3ffb1eb None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:13.780445 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a67b25c-2d53-4935-b811-e746d3ffb1eb None admin] PATH_INFO: `/v3/roles` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:13.781380 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a67b25c-2d53-4935-b811-e746d3ffb1eb None admin] RBAC: Adding query filter params (name=service) {{(pid=80012) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:00:13.781861 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a67b25c-2d53-4935-b811-e746d3ffb1eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:13.783419 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a67b25c-2d53-4935-b811-e746d3ffb1eb None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:13.792988 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 331/678] 10.222.0.36 () {56 vars in 1103 bytes} [Tue May 3 14:00:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:00:13.802725 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a67b25c-2d53-4935-b811-e746d3ffb1eb None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:13.876612 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e12d95-0173-44da-adb6-b5b046e24d64 None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:13.912550 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc96d39-e09d-4e4a-b37b-9306eae1429d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:13.913230 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc96d39-e09d-4e4a-b37b-9306eae1429d None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:13.913543 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc96d39-e09d-4e4a-b37b-9306eae1429d None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:13.913821 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc96d39-e09d-4e4a-b37b-9306eae1429d None admin] PATH_INFO: `/v3/projects` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:13.914629 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc96d39-e09d-4e4a-b37b-9306eae1429d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:00:13.914936 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc96d39-e09d-4e4a-b37b-9306eae1429d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:13.916396 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc96d39-e09d-4e4a-b37b-9306eae1429d None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:13.929986 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 348/679] 10.222.0.36 () {56 vars in 1148 bytes} [Tue May 3 14:00:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:00:13.936531 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc96d39-e09d-4e4a-b37b-9306eae1429d None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:14.044727 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a67b25c-2d53-4935-b811-e746d3ffb1eb None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:14.050710 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc96d39-e09d-4e4a-b37b-9306eae1429d None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:14.089714 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f5e639-469e-4d31-ba43-27b9e4b2befe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:14.090518 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f5e639-469e-4d31-ba43-27b9e4b2befe None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:14.090793 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f5e639-469e-4d31-ba43-27b9e4b2befe None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:14.091133 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f5e639-469e-4d31-ba43-27b9e4b2befe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:14.100529 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693f4680-73d2-4b8b-b3e3-304db54cdf65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:14.101647 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693f4680-73d2-4b8b-b3e3-304db54cdf65 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:14.101936 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693f4680-73d2-4b8b-b3e3-304db54cdf65 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:14.102209 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693f4680-73d2-4b8b-b3e3-304db54cdf65 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:14.103036 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693f4680-73d2-4b8b-b3e3-304db54cdf65 None admin] RBAC: Adding query filter params (role.id=b3902525744e454694820e2ea3b2e563, scope.project.id=de541be478754087934323bdbe41a579, user.id=937bea4f355144b4a7ee11baabc3a4cb) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:00:14.103340 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693f4680-73d2-4b8b-b3e3-304db54cdf65 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:14.105148 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693f4680-73d2-4b8b-b3e3-304db54cdf65 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:14.106922 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f5e639-469e-4d31-ba43-27b9e4b2befe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:14.110022 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f5e639-469e-4d31-ba43-27b9e4b2befe None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:14.114037 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 349/680] 10.222.0.36 () {56 vars in 1374 bytes} [Tue May 3 14:00:13 2022] GET /identity/v3/role_assignments?user.id=937bea4f355144b4a7ee11baabc3a4cb&scope.project.id=de541be478754087934323bdbe41a579&role.id=b3902525744e454694820e2ea3b2e563 => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 14:00:14.131689 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application [None req-00f5e639-469e-4d31-ba43-27b9e4b2befe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 14:00:14.131689 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:00:14.131689 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 14:00:14.131689 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 14:00:14.131689 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 14:00:14.131689 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 14:00:14.131689 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 14:00:14.131689 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 14:00:14.131689 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 14:00:14.131689 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 14:00:14.131689 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 14:00:14.131689 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 14:00:14.131689 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 14:00:14.131689 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 14:00:14.131689 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 14:00:14.132679 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 14:00:14.132679 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 14:00:14.132679 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 14:00:14.132679 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 14:00:14.132679 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 14:00:14.132679 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 14:00:14.132679 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.get_or_create( May 03 14:00:14.132679 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 14:00:14.132679 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application with Lock( May 03 14:00:14.132679 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 14:00:14.132679 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._enter() May 03 14:00:14.132679 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 14:00:14.132679 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 14:00:14.132679 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 14:00:14.132679 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.creator() May 03 14:00:14.132679 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 14:00:14.132679 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application created_value = creator( May 03 14:00:14.133660 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 14:00:14.133660 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 14:00:14.133660 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 14:00:14.133660 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application May 03 14:00:14.136161 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 332/681] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 3 14:00:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 334 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 14:00:14.142385 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693f4680-73d2-4b8b-b3e3-304db54cdf65 None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:14.254452 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693f4680-73d2-4b8b-b3e3-304db54cdf65 None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:14.294503 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc07f3e-0bbd-4c09-88a2-2e06cd990a07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:14.295567 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc07f3e-0bbd-4c09-88a2-2e06cd990a07 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:14.296053 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc07f3e-0bbd-4c09-88a2-2e06cd990a07 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:14.296552 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc07f3e-0bbd-4c09-88a2-2e06cd990a07 None admin] PATH_INFO: `/v3/domains` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:14.297505 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc07f3e-0bbd-4c09-88a2-2e06cd990a07 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:00:14.298013 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc07f3e-0bbd-4c09-88a2-2e06cd990a07 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:14.299627 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc07f3e-0bbd-4c09-88a2-2e06cd990a07 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:14.312613 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 350/682] 10.222.0.36 () {56 vars in 1109 bytes} [Tue May 3 14:00:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:00:14.318548 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f5e639-469e-4d31-ba43-27b9e4b2befe None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:14.427331 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f5e639-469e-4d31-ba43-27b9e4b2befe None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:14.453319 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff07cec5-99e3-43b0-84d6-0f25660ed362 None None] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:14.454072 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff07cec5-99e3-43b0-84d6-0f25660ed362 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:14.454565 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff07cec5-99e3-43b0-84d6-0f25660ed362 None None] PATH_INFO: `/` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:14.456428 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 351/683] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 3 14:00:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 14:00:14.462690 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05418268-522b-4a17-8afe-cb64b1548ebf None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:14.463411 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05418268-522b-4a17-8afe-cb64b1548ebf None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:14.464310 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05418268-522b-4a17-8afe-cb64b1548ebf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:14.464707 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c7ebd1-699e-4fff-a4ad-830703679653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:14.465536 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c7ebd1-699e-4fff-a4ad-830703679653 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:14.465814 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c7ebd1-699e-4fff-a4ad-830703679653 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:14.466229 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c7ebd1-699e-4fff-a4ad-830703679653 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:14.475577 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c7ebd1-699e-4fff-a4ad-830703679653 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:14.477025 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c7ebd1-699e-4fff-a4ad-830703679653 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:14.483381 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-05418268-522b-4a17-8afe-cb64b1548ebf None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:00:14.484825 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-05418268-522b-4a17-8afe-cb64b1548ebf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:00:14.492505 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application [None req-99c7ebd1-699e-4fff-a4ad-830703679653 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 03 14:00:14.492505 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:00:14.492505 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 14:00:14.492505 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 14:00:14.492505 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 14:00:14.492505 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 14:00:14.492505 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 14:00:14.492505 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 14:00:14.492505 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 14:00:14.492505 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 14:00:14.492505 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 14:00:14.492505 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 14:00:14.492505 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 14:00:14.492505 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 14:00:14.492505 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 14:00:14.492505 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 14:00:14.493547 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 14:00:14.493547 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 14:00:14.493547 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 14:00:14.493547 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 14:00:14.493547 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 14:00:14.493547 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 14:00:14.493547 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 14:00:14.493547 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 14:00:14.493547 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 14:00:14.493547 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.get_or_create( May 03 14:00:14.493547 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 14:00:14.493547 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application with Lock( May 03 14:00:14.493547 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 14:00:14.493547 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._enter() May 03 14:00:14.493547 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 14:00:14.493547 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 14:00:14.493547 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 14:00:14.493547 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.creator() May 03 14:00:14.494534 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 14:00:14.494534 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application created_value = creator( May 03 14:00:14.494534 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 14:00:14.494534 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 14:00:14.494534 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 14:00:14.494534 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 14:00:14.494534 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 14:00:14.494534 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 14:00:14.494534 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 03 14:00:14.494534 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application May 03 14:00:14.494534 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 333/684] 10.222.0.36 () {56 vars in 1096 bytes} [Tue May 3 14:00:14 2022] GET /identity/v3/users/swift => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 14:00:14.502445 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c7ebd1-699e-4fff-a4ad-830703679653 None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:14.566958 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 352/685] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 3 14:00:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 14:00:14.592301 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05418268-522b-4a17-8afe-cb64b1548ebf None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:14.623261 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c7ebd1-699e-4fff-a4ad-830703679653 None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:14.656988 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e00fe8-b2f6-4764-9816-243a5436fcac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:14.657702 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e00fe8-b2f6-4764-9816-243a5436fcac None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:14.657983 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e00fe8-b2f6-4764-9816-243a5436fcac None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:14.658261 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e00fe8-b2f6-4764-9816-243a5436fcac None admin] PATH_INFO: `/v3/users` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:14.659109 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e00fe8-b2f6-4764-9816-243a5436fcac None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80012) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:00:14.659424 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e00fe8-b2f6-4764-9816-243a5436fcac None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:14.660850 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e00fe8-b2f6-4764-9816-243a5436fcac None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:14.678789 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 334/686] 10.222.0.36 () {56 vars in 1135 bytes} [Tue May 3 14:00:14 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 14:00:14.688782 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e00fe8-b2f6-4764-9816-243a5436fcac None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:14.728434 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05418268-522b-4a17-8afe-cb64b1548ebf None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:14.789923 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fbc98f-4b6c-4c25-bd05-4518eef4b90b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:14.791122 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fbc98f-4b6c-4c25-bd05-4518eef4b90b None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:14.791603 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fbc98f-4b6c-4c25-bd05-4518eef4b90b None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:14.792071 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fbc98f-4b6c-4c25-bd05-4518eef4b90b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:14.810735 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fbc98f-4b6c-4c25-bd05-4518eef4b90b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 14:00:14.825358 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application [None req-d2fbc98f-4b6c-4c25-bd05-4518eef4b90b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 03 14:00:14.825358 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:00:14.825358 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 14:00:14.825358 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 14:00:14.825358 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 14:00:14.825358 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 14:00:14.825358 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 14:00:14.825358 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 14:00:14.825358 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 14:00:14.825358 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 14:00:14.825358 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 14:00:14.825358 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 14:00:14.825358 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 14:00:14.825358 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 14:00:14.825358 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 14:00:14.825358 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 14:00:14.826522 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 14:00:14.826522 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 14:00:14.826522 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 14:00:14.826522 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 14:00:14.826522 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 14:00:14.826522 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 14:00:14.826522 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 14:00:14.826522 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 14:00:14.826522 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 14:00:14.826522 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.get_or_create( May 03 14:00:14.826522 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 14:00:14.826522 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application with Lock( May 03 14:00:14.826522 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 14:00:14.826522 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._enter() May 03 14:00:14.826522 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 14:00:14.826522 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 14:00:14.827425 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 14:00:14.827425 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.creator() May 03 14:00:14.827425 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 14:00:14.827425 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application created_value = creator( May 03 14:00:14.827425 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 14:00:14.827425 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 14:00:14.827425 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 14:00:14.827425 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 14:00:14.827425 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 14:00:14.827425 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 14:00:14.827425 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 03 14:00:14.827425 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application May 03 14:00:14.828095 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 353/687] 10.222.0.36 () {56 vars in 1096 bytes} [Tue May 3 14:00:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 14:00:14.828967 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fbc98f-4b6c-4c25-bd05-4518eef4b90b None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:14.851654 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e00fe8-b2f6-4764-9816-243a5436fcac None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:14.888030 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1350319e-1f15-4115-940a-462d930d6e54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:14.889496 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1350319e-1f15-4115-940a-462d930d6e54 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:14.890015 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1350319e-1f15-4115-940a-462d930d6e54 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:14.892251 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1350319e-1f15-4115-940a-462d930d6e54 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:15.015193 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1350319e-1f15-4115-940a-462d930d6e54 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:15.017397 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1350319e-1f15-4115-940a-462d930d6e54 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:15.021363 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fbc98f-4b6c-4c25-bd05-4518eef4b90b None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:15.096395 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512dc2f9-bf02-463a-9a17-5bc658f707b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:15.097162 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512dc2f9-bf02-463a-9a17-5bc658f707b7 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:15.097369 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512dc2f9-bf02-463a-9a17-5bc658f707b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:15.097641 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512dc2f9-bf02-463a-9a17-5bc658f707b7 None admin] PATH_INFO: `/v3/roles` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:15.098453 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512dc2f9-bf02-463a-9a17-5bc658f707b7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:00:15.098698 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512dc2f9-bf02-463a-9a17-5bc658f707b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:15.100074 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512dc2f9-bf02-463a-9a17-5bc658f707b7 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:15.132005 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 354/688] 10.222.0.36 () {56 vars in 1099 bytes} [Tue May 3 14:00:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 14:00:15.146407 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512dc2f9-bf02-463a-9a17-5bc658f707b7 None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:15.151288 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 335/689] 10.222.0.36 () {58 vars in 1282 bytes} [Tue May 3 14:00:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 03 14:00:15.162441 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1350319e-1f15-4115-940a-462d930d6e54 None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:15.268029 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1350319e-1f15-4115-940a-462d930d6e54 None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:15.314952 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f08ad3-cf91-4124-b086-1119caa4d638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:15.316158 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f08ad3-cf91-4124-b086-1119caa4d638 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:15.316651 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f08ad3-cf91-4124-b086-1119caa4d638 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:15.317128 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f08ad3-cf91-4124-b086-1119caa4d638 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:15.338558 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f08ad3-cf91-4124-b086-1119caa4d638 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:15.340668 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f08ad3-cf91-4124-b086-1119caa4d638 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:15.343504 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512dc2f9-bf02-463a-9a17-5bc658f707b7 None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:15.369554 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application [None req-e3f08ad3-cf91-4124-b086-1119caa4d638 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 14:00:15.369554 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:00:15.369554 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 14:00:15.369554 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 14:00:15.369554 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 14:00:15.369554 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 14:00:15.369554 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 14:00:15.369554 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 14:00:15.369554 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 14:00:15.369554 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 14:00:15.369554 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 14:00:15.369554 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 14:00:15.369554 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 14:00:15.369554 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 14:00:15.369554 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 14:00:15.370545 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 14:00:15.370545 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 14:00:15.370545 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 14:00:15.370545 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 14:00:15.370545 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 14:00:15.370545 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 14:00:15.370545 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.get_or_create( May 03 14:00:15.370545 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 14:00:15.370545 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application with Lock( May 03 14:00:15.370545 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 14:00:15.370545 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._enter() May 03 14:00:15.370545 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 14:00:15.370545 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 14:00:15.370545 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 14:00:15.370545 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.creator() May 03 14:00:15.370545 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 14:00:15.370545 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application created_value = creator( May 03 14:00:15.371466 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 14:00:15.371466 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 14:00:15.371466 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 14:00:15.371466 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application May 03 14:00:15.376641 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aceaa45-9f39-4ea5-a93f-c3bbb94cf4da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:15.377437 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aceaa45-9f39-4ea5-a93f-c3bbb94cf4da None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:15.377641 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aceaa45-9f39-4ea5-a93f-c3bbb94cf4da None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:15.377839 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 336/690] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 3 14:00:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 14:00:15.377939 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aceaa45-9f39-4ea5-a93f-c3bbb94cf4da None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:15.382805 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f08ad3-cf91-4124-b086-1119caa4d638 None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:15.389195 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aceaa45-9f39-4ea5-a93f-c3bbb94cf4da None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:15.390700 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aceaa45-9f39-4ea5-a93f-c3bbb94cf4da None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:15.409937 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application [None req-6aceaa45-9f39-4ea5-a93f-c3bbb94cf4da None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 14:00:15.409937 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:00:15.409937 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 14:00:15.409937 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 14:00:15.409937 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 14:00:15.409937 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 14:00:15.409937 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 14:00:15.409937 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 14:00:15.409937 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 14:00:15.409937 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 14:00:15.409937 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 14:00:15.409937 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 14:00:15.409937 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 14:00:15.409937 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 14:00:15.409937 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 14:00:15.411223 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 14:00:15.411223 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 14:00:15.411223 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 14:00:15.411223 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 14:00:15.411223 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 14:00:15.411223 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 14:00:15.411223 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.get_or_create( May 03 14:00:15.411223 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 14:00:15.411223 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application with Lock( May 03 14:00:15.411223 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 14:00:15.411223 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._enter() May 03 14:00:15.411223 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 14:00:15.411223 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 14:00:15.411223 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 14:00:15.411223 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.creator() May 03 14:00:15.411223 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 14:00:15.411223 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application created_value = creator( May 03 14:00:15.412139 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 14:00:15.412139 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 14:00:15.412139 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 14:00:15.412139 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application May 03 14:00:15.412139 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 355/691] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 3 14:00:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 14:00:15.417323 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aceaa45-9f39-4ea5-a93f-c3bbb94cf4da None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:15.514783 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f08ad3-cf91-4124-b086-1119caa4d638 None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:15.534119 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aceaa45-9f39-4ea5-a93f-c3bbb94cf4da None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:15.555696 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316e9a04-28e7-4ae8-af71-c3ba268836c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:15.556533 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316e9a04-28e7-4ae8-af71-c3ba268836c5 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:15.556820 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316e9a04-28e7-4ae8-af71-c3ba268836c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:15.557097 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316e9a04-28e7-4ae8-af71-c3ba268836c5 None admin] PATH_INFO: `/v3/domains` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:15.558172 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316e9a04-28e7-4ae8-af71-c3ba268836c5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80012) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:00:15.558484 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316e9a04-28e7-4ae8-af71-c3ba268836c5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:15.560326 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316e9a04-28e7-4ae8-af71-c3ba268836c5 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:15.568944 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fe77dd-fd6e-428b-83c1-d7eb7f656d95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:15.569987 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fe77dd-fd6e-428b-83c1-d7eb7f656d95 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:15.570488 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fe77dd-fd6e-428b-83c1-d7eb7f656d95 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:15.570971 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fe77dd-fd6e-428b-83c1-d7eb7f656d95 None admin] PATH_INFO: `/v3/domains` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:15.571929 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fe77dd-fd6e-428b-83c1-d7eb7f656d95 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:00:15.572460 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fe77dd-fd6e-428b-83c1-d7eb7f656d95 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:15.574104 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fe77dd-fd6e-428b-83c1-d7eb7f656d95 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:15.577478 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 337/692] 10.222.0.36 () {56 vars in 1109 bytes} [Tue May 3 14:00:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 14:00:15.580385 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505b3f76-9642-47b8-9213-ba59b5a20df3 None None] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:15.580973 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505b3f76-9642-47b8-9213-ba59b5a20df3 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:15.581474 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505b3f76-9642-47b8-9213-ba59b5a20df3 None None] PATH_INFO: `/` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:15.583456 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 338/693] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 3 14:00:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 14:00:15.584497 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505b3f76-9642-47b8-9213-ba59b5a20df3 None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:15.600789 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 356/694] 10.222.0.36 () {56 vars in 1109 bytes} [Tue May 3 14:00:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 14:00:15.600789 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3ab54c-a12f-452e-ba37-11acf7c573fc None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:15.600789 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3ab54c-a12f-452e-ba37-11acf7c573fc None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:15.600789 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3ab54c-a12f-452e-ba37-11acf7c573fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:15.619094 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-3e3ab54c-a12f-452e-ba37-11acf7c573fc None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:00:15.620282 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-3e3ab54c-a12f-452e-ba37-11acf7c573fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:00:15.693371 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 357/695] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 3 14:00:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 14:00:15.694292 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505b3f76-9642-47b8-9213-ba59b5a20df3 None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:15.695366 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3ab54c-a12f-452e-ba37-11acf7c573fc None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:15.737002 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa9f67a-bc80-4a45-966b-8807f57e7b84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:15.738184 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa9f67a-bc80-4a45-966b-8807f57e7b84 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:15.738687 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa9f67a-bc80-4a45-966b-8807f57e7b84 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:15.739156 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa9f67a-bc80-4a45-966b-8807f57e7b84 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:15.746353 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa9f67a-bc80-4a45-966b-8807f57e7b84 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:15.748097 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa9f67a-bc80-4a45-966b-8807f57e7b84 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:15.762436 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application [None req-ffa9f67a-bc80-4a45-966b-8807f57e7b84 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 14:00:15.762436 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:00:15.762436 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 14:00:15.762436 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 14:00:15.762436 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 14:00:15.762436 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 14:00:15.762436 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 14:00:15.762436 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 14:00:15.762436 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 14:00:15.762436 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 14:00:15.762436 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 14:00:15.762436 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 14:00:15.762436 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 14:00:15.762436 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 14:00:15.762436 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 14:00:15.763607 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 14:00:15.763607 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 14:00:15.763607 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 14:00:15.763607 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 14:00:15.763607 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 14:00:15.763607 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 14:00:15.763607 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.get_or_create( May 03 14:00:15.763607 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 14:00:15.763607 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application with Lock( May 03 14:00:15.763607 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 14:00:15.763607 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._enter() May 03 14:00:15.763607 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 14:00:15.763607 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 14:00:15.763607 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 14:00:15.763607 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.creator() May 03 14:00:15.763607 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 14:00:15.763607 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application created_value = creator( May 03 14:00:15.764521 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 14:00:15.764521 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 14:00:15.764521 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 14:00:15.764521 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 14:00:15.764521 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 14:00:15.764521 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 14:00:15.764521 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 14:00:15.764521 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application May 03 14:00:15.767030 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 339/696] 10.222.0.36 () {56 vars in 1111 bytes} [Tue May 3 14:00:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 14:00:15.768023 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa9f67a-bc80-4a45-966b-8807f57e7b84 None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:15.806706 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3ab54c-a12f-452e-ba37-11acf7c573fc None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:15.841236 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c1b8ce-6b6b-4f1f-b2a2-83603d7cfe29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:15.841850 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c1b8ce-6b6b-4f1f-b2a2-83603d7cfe29 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:15.842125 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c1b8ce-6b6b-4f1f-b2a2-83603d7cfe29 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:15.842403 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c1b8ce-6b6b-4f1f-b2a2-83603d7cfe29 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:15.849758 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c1b8ce-6b6b-4f1f-b2a2-83603d7cfe29 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:15.851214 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c1b8ce-6b6b-4f1f-b2a2-83603d7cfe29 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:15.865749 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application [None req-33c1b8ce-6b6b-4f1f-b2a2-83603d7cfe29 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 03 14:00:15.865749 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:00:15.865749 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 14:00:15.865749 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 14:00:15.865749 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 14:00:15.865749 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 14:00:15.865749 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 14:00:15.865749 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 14:00:15.865749 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 14:00:15.865749 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 14:00:15.865749 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 14:00:15.865749 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 14:00:15.865749 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 14:00:15.865749 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 14:00:15.865749 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 14:00:15.865749 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 14:00:15.866746 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 14:00:15.866746 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 14:00:15.866746 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 14:00:15.866746 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 14:00:15.866746 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 14:00:15.866746 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 14:00:15.866746 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 14:00:15.866746 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 14:00:15.866746 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 14:00:15.866746 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.get_or_create( May 03 14:00:15.866746 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 14:00:15.866746 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application with Lock( May 03 14:00:15.866746 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 14:00:15.866746 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._enter() May 03 14:00:15.866746 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 14:00:15.866746 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 14:00:15.866746 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 14:00:15.866746 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.creator() May 03 14:00:15.867701 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 14:00:15.867701 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application created_value = creator( May 03 14:00:15.867701 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 14:00:15.867701 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 14:00:15.867701 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 14:00:15.867701 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 14:00:15.867701 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 14:00:15.867701 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 14:00:15.867701 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 03 14:00:15.867701 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application May 03 14:00:15.871588 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 358/697] 10.222.0.36 () {56 vars in 1093 bytes} [Tue May 3 14:00:15 2022] GET /identity/v3/users/nova => generated 82 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 14:00:15.872496 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c1b8ce-6b6b-4f1f-b2a2-83603d7cfe29 None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:15.872716 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa9f67a-bc80-4a45-966b-8807f57e7b84 None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:15.907452 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f730aafd-32c5-4992-97eb-7095c84a1357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:15.908634 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f730aafd-32c5-4992-97eb-7095c84a1357 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:15.909137 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f730aafd-32c5-4992-97eb-7095c84a1357 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:15.909641 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f730aafd-32c5-4992-97eb-7095c84a1357 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:15.920440 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f730aafd-32c5-4992-97eb-7095c84a1357 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:15.922218 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f730aafd-32c5-4992-97eb-7095c84a1357 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:15.939980 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application [None req-f730aafd-32c5-4992-97eb-7095c84a1357 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 14:00:15.939980 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:00:15.939980 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 14:00:15.939980 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 14:00:15.939980 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 14:00:15.939980 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 14:00:15.939980 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 14:00:15.939980 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 14:00:15.939980 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 14:00:15.939980 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 14:00:15.939980 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 14:00:15.939980 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 14:00:15.939980 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 14:00:15.939980 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 14:00:15.939980 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 14:00:15.941026 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 14:00:15.941026 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 14:00:15.941026 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 14:00:15.941026 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 14:00:15.941026 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 14:00:15.941026 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 14:00:15.941026 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.get_or_create( May 03 14:00:15.941026 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 14:00:15.941026 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application with Lock( May 03 14:00:15.941026 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 14:00:15.941026 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._enter() May 03 14:00:15.941026 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 14:00:15.941026 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 14:00:15.941026 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 14:00:15.941026 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.creator() May 03 14:00:15.941026 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 14:00:15.941026 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application created_value = creator( May 03 14:00:15.941970 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 14:00:15.941970 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 14:00:15.941970 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 14:00:15.941970 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application May 03 14:00:15.944378 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 340/698] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 3 14:00:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 14:00:15.945398 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f730aafd-32c5-4992-97eb-7095c84a1357 None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:15.978845 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c1b8ce-6b6b-4f1f-b2a2-83603d7cfe29 None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:16.013044 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf011d8f-94dd-419c-9550-09f76bef40fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:16.013744 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf011d8f-94dd-419c-9550-09f76bef40fc None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:16.014024 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf011d8f-94dd-419c-9550-09f76bef40fc None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:16.014295 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf011d8f-94dd-419c-9550-09f76bef40fc None admin] PATH_INFO: `/v3/projects` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:16.015090 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf011d8f-94dd-419c-9550-09f76bef40fc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:00:16.015398 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf011d8f-94dd-419c-9550-09f76bef40fc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:16.017210 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf011d8f-94dd-419c-9550-09f76bef40fc None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:16.033449 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 359/699] 10.222.0.36 () {56 vars in 1148 bytes} [Tue May 3 14:00:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:00:16.034395 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf011d8f-94dd-419c-9550-09f76bef40fc None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:16.046960 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f730aafd-32c5-4992-97eb-7095c84a1357 None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:16.085035 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b038d99a-6f3d-4b3f-9abd-fd489aa38bcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:16.086016 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b038d99a-6f3d-4b3f-9abd-fd489aa38bcd None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:16.086441 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b038d99a-6f3d-4b3f-9abd-fd489aa38bcd None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:16.086876 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b038d99a-6f3d-4b3f-9abd-fd489aa38bcd None admin] PATH_INFO: `/v3/users` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:16.087871 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b038d99a-6f3d-4b3f-9abd-fd489aa38bcd None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80012) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:00:16.088351 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b038d99a-6f3d-4b3f-9abd-fd489aa38bcd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:16.090252 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b038d99a-6f3d-4b3f-9abd-fd489aa38bcd None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:16.108953 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 341/700] 10.222.0.36 () {56 vars in 1133 bytes} [Tue May 3 14:00:15 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:00:16.110049 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b038d99a-6f3d-4b3f-9abd-fd489aa38bcd None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:16.139537 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf011d8f-94dd-419c-9550-09f76bef40fc None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:16.173135 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a895c7e4-ef70-422c-bb90-f16bd747f9f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:16.173840 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a895c7e4-ef70-422c-bb90-f16bd747f9f7 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:16.174122 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a895c7e4-ef70-422c-bb90-f16bd747f9f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:16.174397 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a895c7e4-ef70-422c-bb90-f16bd747f9f7 None admin] PATH_INFO: `/v3/domains` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:16.175127 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a895c7e4-ef70-422c-bb90-f16bd747f9f7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:00:16.175432 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a895c7e4-ef70-422c-bb90-f16bd747f9f7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:16.177039 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a895c7e4-ef70-422c-bb90-f16bd747f9f7 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:16.194106 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 360/701] 10.222.0.36 () {56 vars in 1109 bytes} [Tue May 3 14:00:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:00:16.195045 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a895c7e4-ef70-422c-bb90-f16bd747f9f7 None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:16.210795 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b038d99a-6f3d-4b3f-9abd-fd489aa38bcd None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:16.245233 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f4ea65-d567-4e9b-8a69-4de0d1b8ada1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:16.246166 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f4ea65-d567-4e9b-8a69-4de0d1b8ada1 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:16.246615 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f4ea65-d567-4e9b-8a69-4de0d1b8ada1 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:16.247029 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f4ea65-d567-4e9b-8a69-4de0d1b8ada1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:16.248038 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f4ea65-d567-4e9b-8a69-4de0d1b8ada1 None admin] RBAC: Adding query filter params (role.id=b3902525744e454694820e2ea3b2e563, scope.project.id=de541be478754087934323bdbe41a579, user.id=e1180e29180d44418390cf22d3e0bd6f) {{(pid=80012) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:00:16.248496 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f4ea65-d567-4e9b-8a69-4de0d1b8ada1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:16.250090 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f4ea65-d567-4e9b-8a69-4de0d1b8ada1 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:16.256595 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 342/702] 10.222.0.36 () {56 vars in 1374 bytes} [Tue May 3 14:00:16 2022] GET /identity/v3/role_assignments?user.id=e1180e29180d44418390cf22d3e0bd6f&scope.project.id=de541be478754087934323bdbe41a579&role.id=b3902525744e454694820e2ea3b2e563 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:00:16.257610 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f4ea65-d567-4e9b-8a69-4de0d1b8ada1 None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:16.328811 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a895c7e4-ef70-422c-bb90-f16bd747f9f7 None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:16.362057 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f4ea65-d567-4e9b-8a69-4de0d1b8ada1 None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:16.391952 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62aafe3c-c83f-4590-9123-8b2d33707767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:16.392490 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62aafe3c-c83f-4590-9123-8b2d33707767 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:16.392772 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62aafe3c-c83f-4590-9123-8b2d33707767 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:16.393047 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62aafe3c-c83f-4590-9123-8b2d33707767 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:16.400341 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe222d8-6d5a-4127-8a6e-2091b3ce403c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:16.401199 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe222d8-6d5a-4127-8a6e-2091b3ce403c None admin] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:16.401665 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe222d8-6d5a-4127-8a6e-2091b3ce403c None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:16.402206 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe222d8-6d5a-4127-8a6e-2091b3ce403c None admin] PATH_INFO: `/v3/users` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:16.403114 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe222d8-6d5a-4127-8a6e-2091b3ce403c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:16.405256 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe222d8-6d5a-4127-8a6e-2091b3ce403c None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:16.441210 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 343/703] 10.222.0.36 () {60 vars in 1132 bytes} [Tue May 3 14:00:16 2022] POST /identity/v3/users => generated 254 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 14:00:16.483136 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62aafe3c-c83f-4590-9123-8b2d33707767 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:16.485200 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62aafe3c-c83f-4590-9123-8b2d33707767 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:16.615579 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 361/704] 10.222.0.36 () {58 vars in 1282 bytes} [Tue May 3 14:00:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 03 14:00:16.620973 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe222d8-6d5a-4127-8a6e-2091b3ce403c None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:16.738602 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe222d8-6d5a-4127-8a6e-2091b3ce403c None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:16.746890 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c735e7aa-a51a-47f6-add0-d370cc77655d None None] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:16.747201 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c735e7aa-a51a-47f6-add0-d370cc77655d None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:16.747531 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c735e7aa-a51a-47f6-add0-d370cc77655d None None] PATH_INFO: `/` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:16.748907 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 362/705] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 3 14:00:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 14:00:16.754285 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014c8f34-56ad-43ea-bbfc-2cca81fab279 None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:16.754566 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014c8f34-56ad-43ea-bbfc-2cca81fab279 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:16.754840 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014c8f34-56ad-43ea-bbfc-2cca81fab279 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:16.773091 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-014c8f34-56ad-43ea-bbfc-2cca81fab279 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:00:16.774496 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-014c8f34-56ad-43ea-bbfc-2cca81fab279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:00:16.778756 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a53f68-9909-412d-a8d5-b6a497792e0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:16.779251 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a53f68-9909-412d-a8d5-b6a497792e0d None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:16.779534 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a53f68-9909-412d-a8d5-b6a497792e0d None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:16.779808 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a53f68-9909-412d-a8d5-b6a497792e0d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:16.790598 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a53f68-9909-412d-a8d5-b6a497792e0d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:16.791985 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a53f68-9909-412d-a8d5-b6a497792e0d None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:16.809849 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application [None req-27a53f68-9909-412d-a8d5-b6a497792e0d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 14:00:16.809849 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:00:16.809849 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 14:00:16.809849 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 14:00:16.809849 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 14:00:16.809849 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 14:00:16.809849 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 14:00:16.809849 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 14:00:16.809849 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 14:00:16.809849 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 14:00:16.809849 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 14:00:16.809849 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 14:00:16.809849 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 14:00:16.809849 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 14:00:16.809849 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 14:00:16.810857 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 14:00:16.810857 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 14:00:16.810857 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 14:00:16.810857 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 14:00:16.810857 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 14:00:16.810857 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 14:00:16.810857 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.get_or_create( May 03 14:00:16.810857 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 14:00:16.810857 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application with Lock( May 03 14:00:16.810857 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 14:00:16.810857 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._enter() May 03 14:00:16.810857 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 14:00:16.810857 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 14:00:16.810857 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 14:00:16.810857 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.creator() May 03 14:00:16.810857 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 14:00:16.810857 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application created_value = creator( May 03 14:00:16.812200 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 14:00:16.812200 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 14:00:16.812200 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 14:00:16.812200 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application May 03 14:00:16.812200 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 344/706] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 3 14:00:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 14:00:16.816940 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a53f68-9909-412d-a8d5-b6a497792e0d None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:16.863326 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 363/707] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 3 14:00:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 14:00:16.870346 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb86ffcb-e6a0-4c31-b419-871c646ca80d None None] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:16.872892 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb86ffcb-e6a0-4c31-b419-871c646ca80d None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:16.873572 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb86ffcb-e6a0-4c31-b419-871c646ca80d None None] PATH_INFO: `/` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:16.875421 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 364/708] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 3 14:00:16 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 14:00:16.881488 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73961769-92b5-4e06-bb96-277fad265b81 None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:16.883431 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73961769-92b5-4e06-bb96-277fad265b81 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:16.883943 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73961769-92b5-4e06-bb96-277fad265b81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:16.909706 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-73961769-92b5-4e06-bb96-277fad265b81 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:00:16.911161 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-73961769-92b5-4e06-bb96-277fad265b81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:00:16.943203 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a53f68-9909-412d-a8d5-b6a497792e0d None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:16.980274 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f28749-d8d5-49e8-9dbe-60145b471673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:16.981417 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f28749-d8d5-49e8-9dbe-60145b471673 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:16.981963 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f28749-d8d5-49e8-9dbe-60145b471673 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:16.982498 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f28749-d8d5-49e8-9dbe-60145b471673 None admin] PATH_INFO: `/v3/domains` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:16.983596 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f28749-d8d5-49e8-9dbe-60145b471673 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80012) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:00:16.984144 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f28749-d8d5-49e8-9dbe-60145b471673 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:16.985805 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f28749-d8d5-49e8-9dbe-60145b471673 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:17.000925 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 345/709] 10.222.0.36 () {56 vars in 1109 bytes} [Tue May 3 14:00:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 14:00:17.002457 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f28749-d8d5-49e8-9dbe-60145b471673 None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:17.118688 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f28749-d8d5-49e8-9dbe-60145b471673 None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:17.122027 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 365/710] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 3 14:00:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 03 14:00:17.122459 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73961769-92b5-4e06-bb96-277fad265b81 None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:17.156408 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f388cb7-3aea-4880-8c40-3bce78dc944a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:17.157962 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f388cb7-3aea-4880-8c40-3bce78dc944a None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:17.158513 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f388cb7-3aea-4880-8c40-3bce78dc944a None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:17.158983 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f388cb7-3aea-4880-8c40-3bce78dc944a None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:17.160283 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f388cb7-3aea-4880-8c40-3bce78dc944a None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:17.162338 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f388cb7-3aea-4880-8c40-3bce78dc944a None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:17.180725 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application [None req-5f388cb7-3aea-4880-8c40-3bce78dc944a None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 03 14:00:17.180725 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:00:17.180725 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 03 14:00:17.180725 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 03 14:00:17.180725 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 03 14:00:17.180725 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 03 14:00:17.180725 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 03 14:00:17.180725 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 14:00:17.180725 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 03 14:00:17.180725 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application May 03 14:00:17.180725 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 03 14:00:17.180725 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application May 03 14:00:17.180725 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:00:17.180725 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 14:00:17.180725 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 14:00:17.180725 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 14:00:17.182200 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 14:00:17.182200 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 14:00:17.182200 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 14:00:17.182200 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 14:00:17.182200 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 14:00:17.182200 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 14:00:17.182200 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 14:00:17.182200 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 03 14:00:17.182200 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._get_service(service_id) May 03 14:00:17.182200 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 03 14:00:17.182200 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 03 14:00:17.182200 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 14:00:17.182200 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 14:00:17.182200 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 14:00:17.182200 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 14:00:17.182200 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 14:00:17.189758 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.get_or_create( May 03 14:00:17.189758 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 14:00:17.189758 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application with Lock( May 03 14:00:17.189758 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 14:00:17.189758 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._enter() May 03 14:00:17.189758 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 14:00:17.189758 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 14:00:17.189758 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 14:00:17.189758 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.creator() May 03 14:00:17.189758 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 14:00:17.189758 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application created_value = creator( May 03 14:00:17.189758 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 03 14:00:17.189758 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 14:00:17.189758 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 03 14:00:17.189758 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application May 03 14:00:17.189758 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 346/711] 10.222.0.36 () {56 vars in 1129 bytes} [Tue May 3 14:00:17 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 14:00:17.190658 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f388cb7-3aea-4880-8c40-3bce78dc944a None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:17.255646 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73961769-92b5-4e06-bb96-277fad265b81 None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:17.287073 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8066d22-787a-4ee6-b20b-4456746d7b1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:17.287863 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8066d22-787a-4ee6-b20b-4456746d7b1b None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:17.288139 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8066d22-787a-4ee6-b20b-4456746d7b1b None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:17.288409 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8066d22-787a-4ee6-b20b-4456746d7b1b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:17.295282 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8066d22-787a-4ee6-b20b-4456746d7b1b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:17.296791 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8066d22-787a-4ee6-b20b-4456746d7b1b None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:17.306677 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f388cb7-3aea-4880-8c40-3bce78dc944a None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:17.315765 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application [None req-c8066d22-787a-4ee6-b20b-4456746d7b1b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 14:00:17.315765 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:00:17.315765 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 14:00:17.315765 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 14:00:17.315765 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 14:00:17.315765 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 14:00:17.315765 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 14:00:17.315765 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 14:00:17.315765 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 14:00:17.315765 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 14:00:17.315765 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 14:00:17.315765 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 14:00:17.315765 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 14:00:17.315765 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 14:00:17.315765 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 14:00:17.316921 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 14:00:17.316921 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 14:00:17.316921 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 14:00:17.316921 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 14:00:17.316921 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 14:00:17.316921 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 14:00:17.316921 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.get_or_create( May 03 14:00:17.316921 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 14:00:17.316921 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application with Lock( May 03 14:00:17.316921 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 14:00:17.316921 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._enter() May 03 14:00:17.316921 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 14:00:17.316921 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 14:00:17.316921 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 14:00:17.316921 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.creator() May 03 14:00:17.316921 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 14:00:17.316921 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application created_value = creator( May 03 14:00:17.318068 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 14:00:17.318068 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 14:00:17.318068 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 14:00:17.318068 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 14:00:17.318068 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 14:00:17.318068 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 14:00:17.318068 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 14:00:17.318068 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application May 03 14:00:17.324471 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 366/712] 10.222.0.36 () {56 vars in 1111 bytes} [Tue May 3 14:00:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 14:00:17.325828 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8066d22-787a-4ee6-b20b-4456746d7b1b None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:17.350888 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a876dc13-a2dd-41f8-b2ae-44d392511994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:17.352532 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a876dc13-a2dd-41f8-b2ae-44d392511994 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:17.352963 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a876dc13-a2dd-41f8-b2ae-44d392511994 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:17.353460 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a876dc13-a2dd-41f8-b2ae-44d392511994 None admin] PATH_INFO: `/v3/services/network` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:17.354697 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a876dc13-a2dd-41f8-b2ae-44d392511994 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:17.356695 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a876dc13-a2dd-41f8-b2ae-44d392511994 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:17.373924 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application [None req-a876dc13-a2dd-41f8-b2ae-44d392511994 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 03 14:00:17.373924 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:00:17.373924 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 03 14:00:17.373924 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 03 14:00:17.373924 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 03 14:00:17.373924 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 03 14:00:17.373924 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 03 14:00:17.373924 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 14:00:17.373924 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 03 14:00:17.373924 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application May 03 14:00:17.373924 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 03 14:00:17.373924 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application May 03 14:00:17.373924 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:00:17.373924 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 14:00:17.373924 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 14:00:17.373924 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 14:00:17.373924 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 14:00:17.375227 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 14:00:17.375227 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 14:00:17.375227 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 14:00:17.375227 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 14:00:17.375227 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 14:00:17.375227 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 14:00:17.375227 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 03 14:00:17.375227 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._get_service(service_id) May 03 14:00:17.375227 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 03 14:00:17.375227 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 03 14:00:17.375227 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 14:00:17.375227 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 14:00:17.375227 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 14:00:17.375227 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 14:00:17.375227 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 14:00:17.375227 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.get_or_create( May 03 14:00:17.376301 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 14:00:17.376301 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application with Lock( May 03 14:00:17.376301 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 14:00:17.376301 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._enter() May 03 14:00:17.376301 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 14:00:17.376301 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 14:00:17.376301 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 14:00:17.376301 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.creator() May 03 14:00:17.376301 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 14:00:17.376301 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application created_value = creator( May 03 14:00:17.376301 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 03 14:00:17.376301 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 14:00:17.376301 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 03 14:00:17.376301 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application May 03 14:00:17.383551 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 347/713] 10.222.0.36 () {56 vars in 1111 bytes} [Tue May 3 14:00:17 2022] GET /identity/v3/services/network => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 14:00:17.383551 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a876dc13-a2dd-41f8-b2ae-44d392511994 None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:17.451794 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8066d22-787a-4ee6-b20b-4456746d7b1b None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:17.489319 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a876dc13-a2dd-41f8-b2ae-44d392511994 None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:17.493481 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6c7785-9590-47d7-ab03-1ffdf7248e4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:17.494586 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6c7785-9590-47d7-ab03-1ffdf7248e4e None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:17.494864 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6c7785-9590-47d7-ab03-1ffdf7248e4e None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:17.495138 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6c7785-9590-47d7-ab03-1ffdf7248e4e None admin] PATH_INFO: `/v3/services` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:17.496201 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6c7785-9590-47d7-ab03-1ffdf7248e4e None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:00:17.496511 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6c7785-9590-47d7-ab03-1ffdf7248e4e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:17.498561 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6c7785-9590-47d7-ab03-1ffdf7248e4e None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:17.504646 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 367/714] 10.222.0.36 () {56 vars in 1124 bytes} [Tue May 3 14:00:17 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:00:17.505465 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6c7785-9590-47d7-ab03-1ffdf7248e4e None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:17.523670 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f79e7e-87ab-4750-9d67-d31bf0141c60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:17.524704 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f79e7e-87ab-4750-9d67-d31bf0141c60 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:17.525199 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f79e7e-87ab-4750-9d67-d31bf0141c60 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:17.525712 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f79e7e-87ab-4750-9d67-d31bf0141c60 None admin] PATH_INFO: `/v3/projects` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:17.526748 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f79e7e-87ab-4750-9d67-d31bf0141c60 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80012) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:00:17.527261 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f79e7e-87ab-4750-9d67-d31bf0141c60 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:17.528949 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f79e7e-87ab-4750-9d67-d31bf0141c60 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:17.541795 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 348/715] 10.222.0.36 () {56 vars in 1148 bytes} [Tue May 3 14:00:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:00:17.542978 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f79e7e-87ab-4750-9d67-d31bf0141c60 None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:17.604128 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6c7785-9590-47d7-ab03-1ffdf7248e4e None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:17.636846 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcffcccd-3154-499f-ab54-3acfe74dd900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:17.637472 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcffcccd-3154-499f-ab54-3acfe74dd900 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:17.637775 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcffcccd-3154-499f-ab54-3acfe74dd900 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:17.638303 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcffcccd-3154-499f-ab54-3acfe74dd900 None admin] PATH_INFO: `/v3/services` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:17.638935 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcffcccd-3154-499f-ab54-3acfe74dd900 None admin] RBAC: Adding query filter params (name=network) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:00:17.639237 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcffcccd-3154-499f-ab54-3acfe74dd900 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:17.640608 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcffcccd-3154-499f-ab54-3acfe74dd900 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:17.641451 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f79e7e-87ab-4750-9d67-d31bf0141c60 None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:17.649586 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 368/716] 10.222.0.36 () {56 vars in 1112 bytes} [Tue May 3 14:00:17 2022] GET /identity/v3/services?name=network => generated 124 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:00:17.649586 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcffcccd-3154-499f-ab54-3acfe74dd900 None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:17.692929 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80023e27-1abf-41b1-9e02-d89b05c9dbfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:17.693696 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80023e27-1abf-41b1-9e02-d89b05c9dbfc None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:17.693979 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80023e27-1abf-41b1-9e02-d89b05c9dbfc None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:17.694259 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80023e27-1abf-41b1-9e02-d89b05c9dbfc None admin] PATH_INFO: `/v3/services` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:17.695022 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80023e27-1abf-41b1-9e02-d89b05c9dbfc None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80012) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:00:17.695327 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80023e27-1abf-41b1-9e02-d89b05c9dbfc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:17.696751 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80023e27-1abf-41b1-9e02-d89b05c9dbfc None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:17.713314 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 349/717] 10.222.0.36 () {56 vars in 1124 bytes} [Tue May 3 14:00:17 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:00:17.713314 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80023e27-1abf-41b1-9e02-d89b05c9dbfc None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:17.821443 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcffcccd-3154-499f-ab54-3acfe74dd900 None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:17.857199 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc015769-ac8b-4aa1-b8b4-b1e3b3b8912e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:17.857905 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc015769-ac8b-4aa1-b8b4-b1e3b3b8912e None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:17.858179 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc015769-ac8b-4aa1-b8b4-b1e3b3b8912e None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:17.858453 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc015769-ac8b-4aa1-b8b4-b1e3b3b8912e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:17.859283 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc015769-ac8b-4aa1-b8b4-b1e3b3b8912e None admin] RBAC: Adding query filter params (role.id=36abe9b50fd8479c86c4f8f70fd85aa3, scope.project.id=de541be478754087934323bdbe41a579, user.id=63489e658c094a2598a2ac62159d2fda) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:00:17.859590 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc015769-ac8b-4aa1-b8b4-b1e3b3b8912e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:17.861055 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc015769-ac8b-4aa1-b8b4-b1e3b3b8912e None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:17.876657 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 369/718] 10.222.0.36 () {56 vars in 1374 bytes} [Tue May 3 14:00:17 2022] GET /identity/v3/role_assignments?user.id=63489e658c094a2598a2ac62159d2fda&scope.project.id=de541be478754087934323bdbe41a579&role.id=36abe9b50fd8479c86c4f8f70fd85aa3 => generated 259 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:00:17.889668 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80023e27-1abf-41b1-9e02-d89b05c9dbfc None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:17.926536 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6116231-e7cd-4969-89a3-8a9cc96e6063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:17.927278 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6116231-e7cd-4969-89a3-8a9cc96e6063 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:17.927563 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6116231-e7cd-4969-89a3-8a9cc96e6063 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:17.927836 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6116231-e7cd-4969-89a3-8a9cc96e6063 None admin] PATH_INFO: `/v3/services` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:17.928568 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6116231-e7cd-4969-89a3-8a9cc96e6063 None admin] RBAC: Adding query filter params (type=network) {{(pid=80012) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:00:17.928874 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6116231-e7cd-4969-89a3-8a9cc96e6063 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:17.930361 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6116231-e7cd-4969-89a3-8a9cc96e6063 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:17.936115 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 350/719] 10.222.0.36 () {56 vars in 1112 bytes} [Tue May 3 14:00:17 2022] GET /identity/v3/services?type=network => generated 124 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:00:19.195480 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafa5ab7-5eb8-4c0d-98d5-9c7252b3155d None None] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:19.196002 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafa5ab7-5eb8-4c0d-98d5-9c7252b3155d None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:19.197056 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafa5ab7-5eb8-4c0d-98d5-9c7252b3155d None None] PATH_INFO: `/` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:19.198790 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 370/720] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 3 14:00:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 14:00:19.204498 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98117512-4578-4e72-bbd6-fa4dc7ca98f5 None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:19.204988 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98117512-4578-4e72-bbd6-fa4dc7ca98f5 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:19.205067 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98117512-4578-4e72-bbd6-fa4dc7ca98f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:19.226438 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-98117512-4578-4e72-bbd6-fa4dc7ca98f5 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:00:19.227647 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-98117512-4578-4e72-bbd6-fa4dc7ca98f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:00:19.309036 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 351/721] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 3 14:00:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 14:00:19.309231 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18a37f0-d9dc-47e0-8ef6-447dae71427e None None] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:19.309231 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18a37f0-d9dc-47e0-8ef6-447dae71427e None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:19.309930 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18a37f0-d9dc-47e0-8ef6-447dae71427e None None] PATH_INFO: `/` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:19.313383 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 371/722] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 3 14:00:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 14:00:19.318554 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7148a85-e5c6-4041-90a3-834f6dd92b47 None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:19.318783 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7148a85-e5c6-4041-90a3-834f6dd92b47 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:19.319042 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7148a85-e5c6-4041-90a3-834f6dd92b47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:19.332143 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18a37f0-d9dc-47e0-8ef6-447dae71427e None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:19.346446 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-b7148a85-e5c6-4041-90a3-834f6dd92b47 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:00:19.347632 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-b7148a85-e5c6-4041-90a3-834f6dd92b47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:00:19.468401 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 352/723] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 3 14:00:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 14:00:19.490846 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7148a85-e5c6-4041-90a3-834f6dd92b47 None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:19.500716 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18a37f0-d9dc-47e0-8ef6-447dae71427e None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:19.538150 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7efcf7-4d1c-4195-bdbd-bfe45888c574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:19.538952 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7efcf7-4d1c-4195-bdbd-bfe45888c574 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:19.539228 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7efcf7-4d1c-4195-bdbd-bfe45888c574 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:19.539498 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7efcf7-4d1c-4195-bdbd-bfe45888c574 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:19.566903 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7efcf7-4d1c-4195-bdbd-bfe45888c574 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 14:00:19.574862 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application [None req-ef7efcf7-4d1c-4195-bdbd-bfe45888c574 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 03 14:00:19.574862 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:00:19.574862 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 14:00:19.574862 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 14:00:19.574862 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 14:00:19.574862 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 14:00:19.574862 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 14:00:19.574862 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 14:00:19.574862 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 14:00:19.574862 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 14:00:19.574862 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 14:00:19.574862 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 14:00:19.574862 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 14:00:19.574862 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 14:00:19.574862 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 14:00:19.574862 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 14:00:19.577484 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 14:00:19.577484 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 14:00:19.577484 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 14:00:19.577484 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 14:00:19.577484 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 14:00:19.577484 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 14:00:19.577484 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 14:00:19.577484 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 14:00:19.577484 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 14:00:19.577484 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.get_or_create( May 03 14:00:19.577484 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 14:00:19.577484 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application with Lock( May 03 14:00:19.577484 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 14:00:19.577484 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._enter() May 03 14:00:19.577484 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 14:00:19.577484 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 14:00:19.578351 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 14:00:19.578351 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.creator() May 03 14:00:19.578351 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 14:00:19.578351 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application created_value = creator( May 03 14:00:19.578351 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 14:00:19.578351 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 14:00:19.578351 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 14:00:19.578351 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 14:00:19.578351 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 14:00:19.578351 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 14:00:19.578351 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 03 14:00:19.578351 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application May 03 14:00:19.578351 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 372/724] 10.222.0.36 () {56 vars in 1096 bytes} [Tue May 3 14:00:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 14:00:19.586285 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7efcf7-4d1c-4195-bdbd-bfe45888c574 None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:19.693045 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7148a85-e5c6-4041-90a3-834f6dd92b47 None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:19.755833 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7efcf7-4d1c-4195-bdbd-bfe45888c574 None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:19.778025 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924f7373-661b-4b04-9e87-b8d55976c1b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:19.778878 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924f7373-661b-4b04-9e87-b8d55976c1b7 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:19.779161 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924f7373-661b-4b04-9e87-b8d55976c1b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:19.779437 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924f7373-661b-4b04-9e87-b8d55976c1b7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:19.789606 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1870559b-753f-42ab-bded-d6312dd05c32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:19.790271 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1870559b-753f-42ab-bded-d6312dd05c32 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:19.790549 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1870559b-753f-42ab-bded-d6312dd05c32 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:19.790821 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1870559b-753f-42ab-bded-d6312dd05c32 None admin] PATH_INFO: `/v3/roles` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:19.791560 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1870559b-753f-42ab-bded-d6312dd05c32 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:00:19.791859 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1870559b-753f-42ab-bded-d6312dd05c32 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:19.793223 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1870559b-753f-42ab-bded-d6312dd05c32 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:19.801993 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 373/725] 10.222.0.36 () {56 vars in 1099 bytes} [Tue May 3 14:00:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:00:19.802875 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924f7373-661b-4b04-9e87-b8d55976c1b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 14:00:19.807647 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1870559b-753f-42ab-bded-d6312dd05c32 None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:19.821607 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application [None req-924f7373-661b-4b04-9e87-b8d55976c1b7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 03 14:00:19.821607 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:00:19.821607 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 14:00:19.821607 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 14:00:19.821607 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 14:00:19.821607 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 14:00:19.821607 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 14:00:19.821607 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 14:00:19.821607 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 14:00:19.821607 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 14:00:19.821607 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 14:00:19.821607 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 14:00:19.821607 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 14:00:19.821607 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 14:00:19.821607 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 14:00:19.821607 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 14:00:19.822616 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 14:00:19.822616 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 14:00:19.822616 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 14:00:19.822616 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 14:00:19.822616 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 14:00:19.822616 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 14:00:19.822616 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 14:00:19.822616 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 14:00:19.822616 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 14:00:19.822616 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.get_or_create( May 03 14:00:19.822616 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 14:00:19.822616 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application with Lock( May 03 14:00:19.822616 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 14:00:19.822616 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._enter() May 03 14:00:19.822616 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 14:00:19.822616 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 14:00:19.823479 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 14:00:19.823479 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.creator() May 03 14:00:19.823479 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 14:00:19.823479 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application created_value = creator( May 03 14:00:19.823479 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 14:00:19.823479 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 14:00:19.823479 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 14:00:19.823479 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 14:00:19.823479 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 14:00:19.823479 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 14:00:19.823479 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 03 14:00:19.823479 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application May 03 14:00:19.827641 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 353/726] 10.222.0.36 () {56 vars in 1102 bytes} [Tue May 3 14:00:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 336 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 14:00:19.829822 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924f7373-661b-4b04-9e87-b8d55976c1b7 None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:19.935718 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1870559b-753f-42ab-bded-d6312dd05c32 None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:19.969224 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be09296e-5de5-4d56-ad11-5a71feb9160e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:19.970065 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be09296e-5de5-4d56-ad11-5a71feb9160e None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:19.970343 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be09296e-5de5-4d56-ad11-5a71feb9160e None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:19.970615 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be09296e-5de5-4d56-ad11-5a71feb9160e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:19.981317 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be09296e-5de5-4d56-ad11-5a71feb9160e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:19.982907 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be09296e-5de5-4d56-ad11-5a71feb9160e None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:20.000432 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application [None req-be09296e-5de5-4d56-ad11-5a71feb9160e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 14:00:20.000432 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:00:20.000432 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 14:00:20.000432 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 14:00:20.000432 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 14:00:20.000432 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 14:00:20.000432 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 14:00:20.000432 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 14:00:20.000432 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 14:00:20.000432 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 14:00:20.000432 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 14:00:20.000432 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 14:00:20.000432 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 14:00:20.000432 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 14:00:20.000432 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 14:00:20.001445 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 14:00:20.001445 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 14:00:20.001445 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 14:00:20.001445 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 14:00:20.001445 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 14:00:20.001445 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 14:00:20.001445 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.get_or_create( May 03 14:00:20.001445 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 14:00:20.001445 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application with Lock( May 03 14:00:20.001445 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 14:00:20.001445 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._enter() May 03 14:00:20.001445 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 14:00:20.001445 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 14:00:20.001445 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 14:00:20.001445 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.creator() May 03 14:00:20.001445 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 14:00:20.001445 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application created_value = creator( May 03 14:00:20.002358 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 14:00:20.002358 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 14:00:20.002358 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 14:00:20.002358 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application May 03 14:00:20.002358 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 374/727] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 3 14:00:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 14:00:20.010394 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be09296e-5de5-4d56-ad11-5a71feb9160e None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:20.053115 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924f7373-661b-4b04-9e87-b8d55976c1b7 None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:20.109016 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27bcaea-2ddd-4704-b845-5660cf7d430f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:20.110007 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27bcaea-2ddd-4704-b845-5660cf7d430f None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:20.110461 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27bcaea-2ddd-4704-b845-5660cf7d430f None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:20.110901 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27bcaea-2ddd-4704-b845-5660cf7d430f None admin] PATH_INFO: `/v3/roles` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:20.111851 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27bcaea-2ddd-4704-b845-5660cf7d430f None admin] RBAC: Adding query filter params (name=service) {{(pid=80012) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:00:20.112335 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27bcaea-2ddd-4704-b845-5660cf7d430f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:20.113941 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27bcaea-2ddd-4704-b845-5660cf7d430f None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:20.122782 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 354/728] 10.222.0.36 () {56 vars in 1103 bytes} [Tue May 3 14:00:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:00:20.128323 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27bcaea-2ddd-4704-b845-5660cf7d430f None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:20.175745 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be09296e-5de5-4d56-ad11-5a71feb9160e None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:20.220783 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950e3768-4ff1-4964-a4e5-83bec0cf08f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:20.221582 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950e3768-4ff1-4964-a4e5-83bec0cf08f4 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:20.221782 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950e3768-4ff1-4964-a4e5-83bec0cf08f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:20.222060 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950e3768-4ff1-4964-a4e5-83bec0cf08f4 None admin] PATH_INFO: `/v3/domains` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:20.222819 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950e3768-4ff1-4964-a4e5-83bec0cf08f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:00:20.223083 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950e3768-4ff1-4964-a4e5-83bec0cf08f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:20.224457 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950e3768-4ff1-4964-a4e5-83bec0cf08f4 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:20.231748 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27bcaea-2ddd-4704-b845-5660cf7d430f None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:20.236939 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 375/729] 10.222.0.36 () {56 vars in 1109 bytes} [Tue May 3 14:00:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:00:20.253381 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950e3768-4ff1-4964-a4e5-83bec0cf08f4 None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:20.271590 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9531497-0ef2-4a15-9e10-6be2f7761a0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:20.272757 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9531497-0ef2-4a15-9e10-6be2f7761a0b None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:20.273242 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9531497-0ef2-4a15-9e10-6be2f7761a0b None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:20.273857 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9531497-0ef2-4a15-9e10-6be2f7761a0b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:20.285095 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9531497-0ef2-4a15-9e10-6be2f7761a0b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:20.286890 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9531497-0ef2-4a15-9e10-6be2f7761a0b None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:20.304673 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application [None req-a9531497-0ef2-4a15-9e10-6be2f7761a0b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 14:00:20.304673 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:00:20.304673 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 14:00:20.304673 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 14:00:20.304673 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 14:00:20.304673 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 14:00:20.304673 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 14:00:20.304673 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 14:00:20.304673 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 14:00:20.304673 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 14:00:20.304673 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 14:00:20.304673 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 14:00:20.304673 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 14:00:20.304673 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 14:00:20.304673 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 14:00:20.305695 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 14:00:20.305695 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 14:00:20.305695 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 14:00:20.305695 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 14:00:20.305695 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 14:00:20.305695 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 14:00:20.305695 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.get_or_create( May 03 14:00:20.305695 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 14:00:20.305695 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application with Lock( May 03 14:00:20.305695 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 14:00:20.305695 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._enter() May 03 14:00:20.305695 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 14:00:20.305695 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 14:00:20.305695 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 14:00:20.305695 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.creator() May 03 14:00:20.305695 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 14:00:20.305695 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application created_value = creator( May 03 14:00:20.306618 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 14:00:20.306618 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 14:00:20.306618 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 14:00:20.306618 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application May 03 14:00:20.308880 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 355/730] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 3 14:00:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 14:00:20.322396 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9531497-0ef2-4a15-9e10-6be2f7761a0b None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:20.419573 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950e3768-4ff1-4964-a4e5-83bec0cf08f4 None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:20.501635 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3790ac24-1a08-4c10-b57a-6f2e547382af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:20.502458 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3790ac24-1a08-4c10-b57a-6f2e547382af None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:20.502736 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3790ac24-1a08-4c10-b57a-6f2e547382af None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:20.503008 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3790ac24-1a08-4c10-b57a-6f2e547382af None admin] PATH_INFO: `/v3/users/swift` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:20.516645 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3790ac24-1a08-4c10-b57a-6f2e547382af None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:20.518130 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3790ac24-1a08-4c10-b57a-6f2e547382af None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:20.527430 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9531497-0ef2-4a15-9e10-6be2f7761a0b None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:20.543421 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application [None req-3790ac24-1a08-4c10-b57a-6f2e547382af None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 03 14:00:20.543421 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:00:20.543421 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 14:00:20.543421 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 14:00:20.543421 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 14:00:20.543421 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 14:00:20.543421 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 14:00:20.543421 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 14:00:20.543421 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 14:00:20.543421 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 14:00:20.543421 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 14:00:20.543421 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 14:00:20.543421 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 14:00:20.543421 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 14:00:20.543421 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 14:00:20.543421 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 14:00:20.544570 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 14:00:20.544570 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 14:00:20.544570 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 14:00:20.544570 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 14:00:20.544570 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 14:00:20.544570 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 14:00:20.544570 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 14:00:20.544570 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 14:00:20.544570 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 14:00:20.544570 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.get_or_create( May 03 14:00:20.544570 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 14:00:20.544570 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application with Lock( May 03 14:00:20.544570 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 14:00:20.544570 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._enter() May 03 14:00:20.544570 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 14:00:20.544570 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 14:00:20.544570 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 14:00:20.544570 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.creator() May 03 14:00:20.545576 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 14:00:20.545576 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application created_value = creator( May 03 14:00:20.545576 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 14:00:20.545576 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 14:00:20.545576 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 14:00:20.545576 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 14:00:20.545576 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 14:00:20.545576 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 14:00:20.545576 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 03 14:00:20.545576 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application May 03 14:00:20.545576 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 376/731] 10.222.0.36 () {56 vars in 1096 bytes} [Tue May 3 14:00:20 2022] GET /identity/v3/users/swift => generated 83 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 14:00:20.546681 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636d7557-9c76-4646-af12-aa6f28eb81c5 None None] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:20.546849 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636d7557-9c76-4646-af12-aa6f28eb81c5 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:20.547997 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636d7557-9c76-4646-af12-aa6f28eb81c5 None None] PATH_INFO: `/` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:20.552360 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 377/732] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 3 14:00:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 14:00:20.553137 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636d7557-9c76-4646-af12-aa6f28eb81c5 None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:20.564474 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91b5814-f755-4aff-9cda-6b878eabdd45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:20.565144 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91b5814-f755-4aff-9cda-6b878eabdd45 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:20.565465 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91b5814-f755-4aff-9cda-6b878eabdd45 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:20.565739 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91b5814-f755-4aff-9cda-6b878eabdd45 None admin] PATH_INFO: `/v3/domains` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:20.566466 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91b5814-f755-4aff-9cda-6b878eabdd45 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80012) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:00:20.566771 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91b5814-f755-4aff-9cda-6b878eabdd45 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:20.568137 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91b5814-f755-4aff-9cda-6b878eabdd45 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:20.580337 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 356/733] 10.222.0.36 () {56 vars in 1109 bytes} [Tue May 3 14:00:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:00:20.581708 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ce5020-c26d-47ca-bd2b-52b82a33f8c5 None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:20.581984 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ce5020-c26d-47ca-bd2b-52b82a33f8c5 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:20.582274 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ce5020-c26d-47ca-bd2b-52b82a33f8c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:20.600161 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-83ce5020-c26d-47ca-bd2b-52b82a33f8c5 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:00:20.601381 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-83ce5020-c26d-47ca-bd2b-52b82a33f8c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:00:20.663880 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636d7557-9c76-4646-af12-aa6f28eb81c5 None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:20.671276 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 357/734] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 3 14:00:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 14:00:20.671918 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ce5020-c26d-47ca-bd2b-52b82a33f8c5 None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:20.698145 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e51a9d-11e3-4e7a-9950-fb06ab805446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:20.698816 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e51a9d-11e3-4e7a-9950-fb06ab805446 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:20.699119 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e51a9d-11e3-4e7a-9950-fb06ab805446 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:20.699324 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e51a9d-11e3-4e7a-9950-fb06ab805446 None admin] PATH_INFO: `/v3/users` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:20.700653 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e51a9d-11e3-4e7a-9950-fb06ab805446 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:00:20.700960 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e51a9d-11e3-4e7a-9950-fb06ab805446 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:20.702421 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e51a9d-11e3-4e7a-9950-fb06ab805446 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:20.724732 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 378/735] 10.222.0.36 () {56 vars in 1135 bytes} [Tue May 3 14:00:20 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:00:20.724732 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444b1805-af9d-4dee-98ff-3d07539e82a5 None None] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:20.724732 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444b1805-af9d-4dee-98ff-3d07539e82a5 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:20.724732 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444b1805-af9d-4dee-98ff-3d07539e82a5 None None] PATH_INFO: `/` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:20.726079 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 379/736] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 3 14:00:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 14:00:20.729362 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444b1805-af9d-4dee-98ff-3d07539e82a5 None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:20.779753 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ce5020-c26d-47ca-bd2b-52b82a33f8c5 None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:20.811387 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0da0cb7-1d7a-42a5-a144-afed8174cca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:20.812208 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0da0cb7-1d7a-42a5-a144-afed8174cca2 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:20.812489 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0da0cb7-1d7a-42a5-a144-afed8174cca2 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:20.812769 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0da0cb7-1d7a-42a5-a144-afed8174cca2 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:20.819666 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0da0cb7-1d7a-42a5-a144-afed8174cca2 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:20.821244 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0da0cb7-1d7a-42a5-a144-afed8174cca2 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:20.825268 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444b1805-af9d-4dee-98ff-3d07539e82a5 None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:20.836841 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application [None req-d0da0cb7-1d7a-42a5-a144-afed8174cca2 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 03 14:00:20.836841 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:00:20.836841 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 14:00:20.836841 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 14:00:20.836841 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 14:00:20.836841 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 14:00:20.836841 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 14:00:20.836841 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 14:00:20.836841 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 14:00:20.836841 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 14:00:20.836841 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 14:00:20.836841 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 14:00:20.836841 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 14:00:20.836841 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 14:00:20.836841 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 14:00:20.836841 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 14:00:20.837916 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 14:00:20.837916 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 14:00:20.837916 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 14:00:20.837916 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 14:00:20.837916 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 14:00:20.837916 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 14:00:20.837916 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 14:00:20.837916 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 14:00:20.837916 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 14:00:20.837916 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.get_or_create( May 03 14:00:20.837916 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 14:00:20.837916 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application with Lock( May 03 14:00:20.837916 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 14:00:20.837916 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._enter() May 03 14:00:20.837916 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 14:00:20.837916 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 14:00:20.837916 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 14:00:20.837916 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.creator() May 03 14:00:20.844083 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 14:00:20.844083 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application created_value = creator( May 03 14:00:20.844083 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 14:00:20.844083 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 14:00:20.844083 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 14:00:20.844083 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 14:00:20.844083 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 14:00:20.844083 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 14:00:20.844083 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 03 14:00:20.844083 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application May 03 14:00:20.844083 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 358/737] 10.222.0.36 () {56 vars in 1117 bytes} [Tue May 3 14:00:20 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 14:00:20.844083 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0da0cb7-1d7a-42a5-a144-afed8174cca2 None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:20.857658 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda6ffcd-a2ad-47e1-8cf6-3487aa6c3da3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:20.858450 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda6ffcd-a2ad-47e1-8cf6-3487aa6c3da3 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:20.858726 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda6ffcd-a2ad-47e1-8cf6-3487aa6c3da3 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:20.858993 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda6ffcd-a2ad-47e1-8cf6-3487aa6c3da3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:20.868494 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda6ffcd-a2ad-47e1-8cf6-3487aa6c3da3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 14:00:20.876174 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application [None req-eda6ffcd-a2ad-47e1-8cf6-3487aa6c3da3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 03 14:00:20.876174 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:00:20.876174 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 14:00:20.876174 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 14:00:20.876174 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 14:00:20.876174 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 14:00:20.876174 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 14:00:20.876174 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 14:00:20.876174 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 14:00:20.876174 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 14:00:20.876174 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 14:00:20.876174 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 14:00:20.876174 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 14:00:20.876174 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 14:00:20.876174 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 14:00:20.876174 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 14:00:20.877487 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 14:00:20.877487 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 14:00:20.877487 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 14:00:20.877487 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 14:00:20.877487 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 14:00:20.877487 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 14:00:20.877487 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 14:00:20.877487 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 14:00:20.877487 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 14:00:20.877487 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.get_or_create( May 03 14:00:20.877487 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 14:00:20.877487 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application with Lock( May 03 14:00:20.877487 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 14:00:20.877487 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._enter() May 03 14:00:20.877487 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 14:00:20.877487 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 14:00:20.878729 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 14:00:20.878729 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.creator() May 03 14:00:20.878729 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 14:00:20.878729 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application created_value = creator( May 03 14:00:20.878729 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 14:00:20.878729 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 14:00:20.878729 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 14:00:20.878729 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 14:00:20.878729 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 14:00:20.878729 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 14:00:20.878729 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 03 14:00:20.878729 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application May 03 14:00:20.878729 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 380/738] 10.222.0.36 () {56 vars in 1096 bytes} [Tue May 3 14:00:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 14:00:20.878729 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899ab57b-54a7-4ed4-820b-d293947f6def None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:20.879708 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899ab57b-54a7-4ed4-820b-d293947f6def None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:20.879708 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899ab57b-54a7-4ed4-820b-d293947f6def None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:20.896584 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-899ab57b-54a7-4ed4-820b-d293947f6def None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:00:20.897848 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-899ab57b-54a7-4ed4-820b-d293947f6def None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:00:20.969443 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 381/739] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 3 14:00:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 14:00:20.970769 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3422035a-6072-4d43-a49a-edeb5b4c8645 None None] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:20.971087 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3422035a-6072-4d43-a49a-edeb5b4c8645 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:20.971366 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3422035a-6072-4d43-a49a-edeb5b4c8645 None None] PATH_INFO: `/` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:20.972842 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 382/740] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 3 14:00:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 14:00:20.974207 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3422035a-6072-4d43-a49a-edeb5b4c8645 None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:21.066221 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0da0cb7-1d7a-42a5-a144-afed8174cca2 None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:21.085816 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3422035a-6072-4d43-a49a-edeb5b4c8645 None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:21.097829 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60294ae8-8dc3-4538-a9ec-81622afc6fa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:21.098472 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60294ae8-8dc3-4538-a9ec-81622afc6fa4 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:21.098749 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60294ae8-8dc3-4538-a9ec-81622afc6fa4 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:21.099023 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60294ae8-8dc3-4538-a9ec-81622afc6fa4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:21.118522 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01ae537-ea3f-44bb-8732-c93a699caaaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:21.119181 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01ae537-ea3f-44bb-8732-c93a699caaaa None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:21.119457 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01ae537-ea3f-44bb-8732-c93a699caaaa None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:21.119728 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01ae537-ea3f-44bb-8732-c93a699caaaa None admin] PATH_INFO: `/v3/users` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:21.120618 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01ae537-ea3f-44bb-8732-c93a699caaaa None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:00:21.120936 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01ae537-ea3f-44bb-8732-c93a699caaaa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:21.122416 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01ae537-ea3f-44bb-8732-c93a699caaaa None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:21.138533 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 383/741] 10.222.0.36 () {56 vars in 1149 bytes} [Tue May 3 14:00:20 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:00:21.139319 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01ae537-ea3f-44bb-8732-c93a699caaaa None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:21.164240 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60294ae8-8dc3-4538-a9ec-81622afc6fa4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:21.165818 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60294ae8-8dc3-4538-a9ec-81622afc6fa4 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:21.231724 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01ae537-ea3f-44bb-8732-c93a699caaaa None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:21.258868 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 359/742] 10.222.0.36 () {58 vars in 1282 bytes} [Tue May 3 14:00:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 03 14:00:21.260113 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed09028-b3b0-45e0-adcb-773457757c02 None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:21.260400 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed09028-b3b0-45e0-adcb-773457757c02 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:21.260705 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed09028-b3b0-45e0-adcb-773457757c02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:21.265654 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37e5dde-fc5d-46bd-9159-46c40b3531d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:21.266313 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37e5dde-fc5d-46bd-9159-46c40b3531d4 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:21.266583 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37e5dde-fc5d-46bd-9159-46c40b3531d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:21.266852 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37e5dde-fc5d-46bd-9159-46c40b3531d4 None admin] PATH_INFO: `/v3/roles` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:21.267585 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37e5dde-fc5d-46bd-9159-46c40b3531d4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:00:21.267881 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37e5dde-fc5d-46bd-9159-46c40b3531d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:21.269234 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37e5dde-fc5d-46bd-9159-46c40b3531d4 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:21.276788 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-6ed09028-b3b0-45e0-adcb-773457757c02 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:00:21.277216 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 384/743] 10.222.0.36 () {56 vars in 1099 bytes} [Tue May 3 14:00:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:00:21.277978 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37e5dde-fc5d-46bd-9159-46c40b3531d4 None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:21.278093 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-6ed09028-b3b0-45e0-adcb-773457757c02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:00:21.339258 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 360/744] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 3 14:00:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 14:00:21.339867 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed09028-b3b0-45e0-adcb-773457757c02 None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:21.379685 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37e5dde-fc5d-46bd-9159-46c40b3531d4 None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:21.412432 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e9ac62-c0cb-4e6b-aeb4-b6238ed75675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:21.413070 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e9ac62-c0cb-4e6b-aeb4-b6238ed75675 None admin] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:21.413374 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e9ac62-c0cb-4e6b-aeb4-b6238ed75675 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:21.413654 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e9ac62-c0cb-4e6b-aeb4-b6238ed75675 None admin] PATH_INFO: `/v3/services` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:21.414370 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e9ac62-c0cb-4e6b-aeb4-b6238ed75675 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:21.415759 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e9ac62-c0cb-4e6b-aeb4-b6238ed75675 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:21.430522 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 385/745] 10.222.0.36 () {60 vars in 1141 bytes} [Tue May 3 14:00:21 2022] POST /identity/v3/services => generated 251 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 14:00:21.431318 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e9ac62-c0cb-4e6b-aeb4-b6238ed75675 None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:21.447762 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed09028-b3b0-45e0-adcb-773457757c02 None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:21.503958 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979d844e-92a6-42ff-9b79-83b2f89ea44d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:21.504531 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979d844e-92a6-42ff-9b79-83b2f89ea44d None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:21.504812 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979d844e-92a6-42ff-9b79-83b2f89ea44d None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:21.505076 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979d844e-92a6-42ff-9b79-83b2f89ea44d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:21.543317 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e9ac62-c0cb-4e6b-aeb4-b6238ed75675 None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:21.578330 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b385e26-ceb3-4d04-914c-d99b27408748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:21.579216 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b385e26-ceb3-4d04-914c-d99b27408748 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:21.579498 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b385e26-ceb3-4d04-914c-d99b27408748 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:21.579770 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b385e26-ceb3-4d04-914c-d99b27408748 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:21.580209 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979d844e-92a6-42ff-9b79-83b2f89ea44d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:21.581751 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979d844e-92a6-42ff-9b79-83b2f89ea44d None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:21.591916 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b385e26-ceb3-4d04-914c-d99b27408748 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:21.593429 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b385e26-ceb3-4d04-914c-d99b27408748 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:21.611773 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application [None req-5b385e26-ceb3-4d04-914c-d99b27408748 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 14:00:21.611773 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:00:21.611773 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 14:00:21.611773 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 14:00:21.611773 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 14:00:21.611773 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 14:00:21.611773 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 14:00:21.611773 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 14:00:21.611773 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 14:00:21.611773 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 14:00:21.611773 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 14:00:21.611773 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 14:00:21.611773 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 14:00:21.611773 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 14:00:21.611773 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 14:00:21.612934 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 14:00:21.612934 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 14:00:21.612934 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 14:00:21.612934 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 14:00:21.612934 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 14:00:21.612934 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 14:00:21.612934 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.get_or_create( May 03 14:00:21.612934 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 14:00:21.612934 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application with Lock( May 03 14:00:21.612934 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 14:00:21.612934 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._enter() May 03 14:00:21.612934 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 14:00:21.612934 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 14:00:21.612934 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 14:00:21.612934 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.creator() May 03 14:00:21.612934 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 14:00:21.612934 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application created_value = creator( May 03 14:00:21.613911 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 14:00:21.613911 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 14:00:21.613911 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 14:00:21.613911 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application May 03 14:00:21.613911 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 386/746] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 3 14:00:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 14:00:21.613911 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b385e26-ceb3-4d04-914c-d99b27408748 None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:21.690094 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 361/747] 10.222.0.36 () {58 vars in 1282 bytes} [Tue May 3 14:00:21 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 03 14:00:21.690920 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979d844e-92a6-42ff-9b79-83b2f89ea44d None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:21.725809 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b385e26-ceb3-4d04-914c-d99b27408748 None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:21.764380 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b814a16-d736-4564-8740-71ccbc44f295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:21.765579 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b814a16-d736-4564-8740-71ccbc44f295 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:21.766076 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b814a16-d736-4564-8740-71ccbc44f295 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:21.766445 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b814a16-d736-4564-8740-71ccbc44f295 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:21.777083 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b814a16-d736-4564-8740-71ccbc44f295 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:21.778643 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b814a16-d736-4564-8740-71ccbc44f295 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:21.783879 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979d844e-92a6-42ff-9b79-83b2f89ea44d None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:21.798483 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application [None req-3b814a16-d736-4564-8740-71ccbc44f295 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 14:00:21.798483 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:00:21.798483 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 14:00:21.798483 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 14:00:21.798483 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 14:00:21.798483 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 14:00:21.798483 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 14:00:21.798483 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 14:00:21.798483 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 14:00:21.798483 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 14:00:21.798483 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 14:00:21.798483 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 14:00:21.798483 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 14:00:21.798483 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 14:00:21.798483 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 14:00:21.799432 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 14:00:21.799432 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 14:00:21.799432 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 14:00:21.799432 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 14:00:21.799432 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 14:00:21.799432 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 14:00:21.799432 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.get_or_create( May 03 14:00:21.799432 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 14:00:21.799432 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application with Lock( May 03 14:00:21.799432 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 14:00:21.799432 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._enter() May 03 14:00:21.799432 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 14:00:21.799432 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 14:00:21.799432 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 14:00:21.799432 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.creator() May 03 14:00:21.799432 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 14:00:21.799432 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application created_value = creator( May 03 14:00:21.800348 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 14:00:21.800348 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 14:00:21.800348 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 14:00:21.800348 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application May 03 14:00:21.800348 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 387/748] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 3 14:00:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 14:00:21.800646 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b814a16-d736-4564-8740-71ccbc44f295 None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:21.817991 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ba3ca3-d5d6-493e-ad67-0009df123de8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:21.818655 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ba3ca3-d5d6-493e-ad67-0009df123de8 None admin] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:21.818927 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ba3ca3-d5d6-493e-ad67-0009df123de8 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:21.819199 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ba3ca3-d5d6-493e-ad67-0009df123de8 None admin] PATH_INFO: `/v3/services` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:21.819916 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ba3ca3-d5d6-493e-ad67-0009df123de8 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:21.821272 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ba3ca3-d5d6-493e-ad67-0009df123de8 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:21.836444 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 362/749] 10.222.0.36 () {60 vars in 1141 bytes} [Tue May 3 14:00:21 2022] POST /identity/v3/services => generated 240 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 14:00:21.837251 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ba3ca3-d5d6-493e-ad67-0009df123de8 None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:21.911060 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b814a16-d736-4564-8740-71ccbc44f295 None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:21.953735 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7137f5e6-0920-4cb5-a70a-7758f6b5d5df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:21.954407 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7137f5e6-0920-4cb5-a70a-7758f6b5d5df None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:21.954739 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7137f5e6-0920-4cb5-a70a-7758f6b5d5df None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:21.955017 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7137f5e6-0920-4cb5-a70a-7758f6b5d5df None admin] PATH_INFO: `/v3/domains` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:21.955750 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7137f5e6-0920-4cb5-a70a-7758f6b5d5df None admin] RBAC: Adding query filter params (name=Default) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:00:21.956060 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7137f5e6-0920-4cb5-a70a-7758f6b5d5df None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:21.957541 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7137f5e6-0920-4cb5-a70a-7758f6b5d5df None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:21.976919 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 388/750] 10.222.0.36 () {56 vars in 1109 bytes} [Tue May 3 14:00:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:00:21.977816 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7137f5e6-0920-4cb5-a70a-7758f6b5d5df None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:21.987869 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ba3ca3-d5d6-493e-ad67-0009df123de8 None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:22.030181 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8931255a-706d-4da1-8d93-1e9bab2095c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:22.031385 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8931255a-706d-4da1-8d93-1e9bab2095c5 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:22.032245 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8931255a-706d-4da1-8d93-1e9bab2095c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:22.032727 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8931255a-706d-4da1-8d93-1e9bab2095c5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:22.050019 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8931255a-706d-4da1-8d93-1e9bab2095c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:22.052061 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8931255a-706d-4da1-8d93-1e9bab2095c5 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:22.073338 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application [None req-8931255a-706d-4da1-8d93-1e9bab2095c5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 14:00:22.073338 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:00:22.073338 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 14:00:22.073338 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 14:00:22.073338 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 14:00:22.073338 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 14:00:22.073338 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 14:00:22.073338 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 14:00:22.073338 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 14:00:22.073338 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 14:00:22.073338 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 14:00:22.073338 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 14:00:22.073338 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 14:00:22.073338 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 14:00:22.073338 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 14:00:22.074249 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 14:00:22.074249 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 14:00:22.074249 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 14:00:22.074249 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 14:00:22.074249 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 14:00:22.074249 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 14:00:22.074249 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.get_or_create( May 03 14:00:22.074249 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 14:00:22.074249 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application with Lock( May 03 14:00:22.074249 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 14:00:22.074249 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._enter() May 03 14:00:22.074249 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 14:00:22.074249 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 14:00:22.074249 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 14:00:22.074249 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.creator() May 03 14:00:22.074249 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 14:00:22.074249 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application created_value = creator( May 03 14:00:22.075653 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 14:00:22.075653 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 14:00:22.075653 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 14:00:22.075653 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application May 03 14:00:22.075653 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 363/751] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 3 14:00:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 14:00:22.076325 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8931255a-706d-4da1-8d93-1e9bab2095c5 None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:22.106921 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7137f5e6-0920-4cb5-a70a-7758f6b5d5df None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:22.144950 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11194109-3e51-4cbf-bd44-725a24b95b06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:22.145679 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11194109-3e51-4cbf-bd44-725a24b95b06 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:22.145958 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11194109-3e51-4cbf-bd44-725a24b95b06 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:22.146282 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11194109-3e51-4cbf-bd44-725a24b95b06 None admin] PATH_INFO: `/v3/domains` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:22.147007 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11194109-3e51-4cbf-bd44-725a24b95b06 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:00:22.147306 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11194109-3e51-4cbf-bd44-725a24b95b06 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:22.148658 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11194109-3e51-4cbf-bd44-725a24b95b06 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:22.160634 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 389/752] 10.222.0.36 () {56 vars in 1109 bytes} [Tue May 3 14:00:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:00:22.162806 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11194109-3e51-4cbf-bd44-725a24b95b06 None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:22.207354 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8931255a-706d-4da1-8d93-1e9bab2095c5 None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:22.241110 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f50370b-6d18-4a1b-8c08-720f931cbf52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:22.242330 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f50370b-6d18-4a1b-8c08-720f931cbf52 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:22.242815 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f50370b-6d18-4a1b-8c08-720f931cbf52 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:22.243287 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f50370b-6d18-4a1b-8c08-720f931cbf52 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:22.250772 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f50370b-6d18-4a1b-8c08-720f931cbf52 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:22.252512 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f50370b-6d18-4a1b-8c08-720f931cbf52 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:22.267911 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application [None req-8f50370b-6d18-4a1b-8c08-720f931cbf52 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 14:00:22.267911 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:00:22.267911 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 14:00:22.267911 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 14:00:22.267911 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 14:00:22.267911 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 14:00:22.267911 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 14:00:22.267911 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 14:00:22.267911 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 14:00:22.267911 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 14:00:22.267911 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 14:00:22.267911 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 14:00:22.267911 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 14:00:22.267911 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 14:00:22.267911 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 14:00:22.269337 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 14:00:22.269337 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 14:00:22.269337 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 14:00:22.269337 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 14:00:22.269337 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 14:00:22.269337 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 14:00:22.269337 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.get_or_create( May 03 14:00:22.269337 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 14:00:22.269337 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application with Lock( May 03 14:00:22.269337 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 14:00:22.269337 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._enter() May 03 14:00:22.269337 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 14:00:22.269337 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 14:00:22.269337 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 14:00:22.269337 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.creator() May 03 14:00:22.269337 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 14:00:22.269337 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application created_value = creator( May 03 14:00:22.270458 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 14:00:22.270458 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 14:00:22.270458 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 14:00:22.270458 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 14:00:22.270458 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 14:00:22.270458 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 14:00:22.270458 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 14:00:22.270458 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application May 03 14:00:22.272615 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 364/753] 10.222.0.36 () {56 vars in 1111 bytes} [Tue May 3 14:00:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 14:00:22.273494 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11194109-3e51-4cbf-bd44-725a24b95b06 None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:22.274064 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f50370b-6d18-4a1b-8c08-720f931cbf52 None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:22.307290 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34910240-152f-478e-8d10-0d732b4e5431 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:22.307877 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34910240-152f-478e-8d10-0d732b4e5431 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:22.308155 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34910240-152f-478e-8d10-0d732b4e5431 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:22.308432 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34910240-152f-478e-8d10-0d732b4e5431 None admin] PATH_INFO: `/v3/domains` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:22.309156 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34910240-152f-478e-8d10-0d732b4e5431 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:00:22.309528 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34910240-152f-478e-8d10-0d732b4e5431 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:22.311514 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34910240-152f-478e-8d10-0d732b4e5431 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:22.329405 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 390/754] 10.222.0.36 () {56 vars in 1109 bytes} [Tue May 3 14:00:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:00:22.329405 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34910240-152f-478e-8d10-0d732b4e5431 None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:22.382446 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f50370b-6d18-4a1b-8c08-720f931cbf52 None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:22.418480 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c22dafd-9934-4ce9-ad0c-418d3296877a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:22.419676 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c22dafd-9934-4ce9-ad0c-418d3296877a None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:22.420231 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c22dafd-9934-4ce9-ad0c-418d3296877a None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:22.421196 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c22dafd-9934-4ce9-ad0c-418d3296877a None admin] PATH_INFO: `/v3/users/nova` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:22.431068 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c22dafd-9934-4ce9-ad0c-418d3296877a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:22.432798 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c22dafd-9934-4ce9-ad0c-418d3296877a None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:22.444853 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34910240-152f-478e-8d10-0d732b4e5431 None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:22.452973 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application [None req-5c22dafd-9934-4ce9-ad0c-418d3296877a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 03 14:00:22.452973 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:00:22.452973 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 14:00:22.452973 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 14:00:22.452973 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 14:00:22.452973 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 14:00:22.452973 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 14:00:22.452973 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 14:00:22.452973 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 14:00:22.452973 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 14:00:22.452973 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 14:00:22.452973 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 14:00:22.452973 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 14:00:22.452973 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 14:00:22.452973 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 14:00:22.452973 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 14:00:22.453955 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 14:00:22.453955 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 14:00:22.453955 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 14:00:22.453955 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 14:00:22.453955 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 14:00:22.453955 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 14:00:22.453955 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 14:00:22.453955 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 14:00:22.453955 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 14:00:22.453955 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.get_or_create( May 03 14:00:22.453955 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 14:00:22.453955 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application with Lock( May 03 14:00:22.453955 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 14:00:22.453955 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._enter() May 03 14:00:22.453955 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 14:00:22.453955 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 14:00:22.453955 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 14:00:22.453955 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.creator() May 03 14:00:22.454934 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 14:00:22.454934 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application created_value = creator( May 03 14:00:22.454934 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 14:00:22.454934 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 14:00:22.454934 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 14:00:22.454934 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 14:00:22.454934 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 14:00:22.454934 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 14:00:22.454934 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 03 14:00:22.454934 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application May 03 14:00:22.457781 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 365/755] 10.222.0.36 () {56 vars in 1093 bytes} [Tue May 3 14:00:22 2022] GET /identity/v3/users/nova => generated 82 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 14:00:22.458733 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c22dafd-9934-4ce9-ad0c-418d3296877a None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:22.486286 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6759cb-d3dd-4b74-82ab-2050ce996319 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:22.487095 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6759cb-d3dd-4b74-82ab-2050ce996319 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:22.487479 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6759cb-d3dd-4b74-82ab-2050ce996319 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:22.487846 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6759cb-d3dd-4b74-82ab-2050ce996319 None admin] PATH_INFO: `/v3/projects` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:22.488872 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6759cb-d3dd-4b74-82ab-2050ce996319 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:00:22.489122 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6759cb-d3dd-4b74-82ab-2050ce996319 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:22.490755 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6759cb-d3dd-4b74-82ab-2050ce996319 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:22.503043 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 391/756] 10.222.0.36 () {56 vars in 1148 bytes} [Tue May 3 14:00:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:00:22.504144 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6759cb-d3dd-4b74-82ab-2050ce996319 None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:22.562097 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c22dafd-9934-4ce9-ad0c-418d3296877a None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:22.599057 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559ae3e2-3ddb-4041-8c0c-88bff4aedc54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:22.600147 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559ae3e2-3ddb-4041-8c0c-88bff4aedc54 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:22.600578 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559ae3e2-3ddb-4041-8c0c-88bff4aedc54 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:22.600988 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559ae3e2-3ddb-4041-8c0c-88bff4aedc54 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:22.605581 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6759cb-d3dd-4b74-82ab-2050ce996319 None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:22.608741 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559ae3e2-3ddb-4041-8c0c-88bff4aedc54 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:22.610411 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559ae3e2-3ddb-4041-8c0c-88bff4aedc54 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:22.624730 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application [None req-559ae3e2-3ddb-4041-8c0c-88bff4aedc54 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 14:00:22.624730 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:00:22.624730 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 14:00:22.624730 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 14:00:22.624730 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 14:00:22.624730 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 14:00:22.624730 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 14:00:22.624730 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 14:00:22.624730 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 14:00:22.624730 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 14:00:22.624730 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 14:00:22.624730 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 14:00:22.624730 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 14:00:22.624730 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 14:00:22.624730 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 14:00:22.625902 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 14:00:22.625902 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 14:00:22.625902 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 14:00:22.625902 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 14:00:22.625902 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 14:00:22.625902 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 14:00:22.625902 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.get_or_create( May 03 14:00:22.625902 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 14:00:22.625902 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application with Lock( May 03 14:00:22.625902 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 14:00:22.625902 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._enter() May 03 14:00:22.625902 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 14:00:22.625902 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 14:00:22.625902 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 14:00:22.625902 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.creator() May 03 14:00:22.625902 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 14:00:22.625902 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application created_value = creator( May 03 14:00:22.627033 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 14:00:22.627033 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 14:00:22.627033 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 14:00:22.627033 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 14:00:22.627033 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 14:00:22.627033 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 14:00:22.627033 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 14:00:22.627033 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application May 03 14:00:22.633515 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 366/757] 10.222.0.36 () {56 vars in 1111 bytes} [Tue May 3 14:00:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 14:00:22.634542 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559ae3e2-3ddb-4041-8c0c-88bff4aedc54 None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:22.643661 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98646f8-afa4-44e9-8e05-e4f3edca0caf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:22.644534 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98646f8-afa4-44e9-8e05-e4f3edca0caf None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:22.644882 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98646f8-afa4-44e9-8e05-e4f3edca0caf None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:22.645647 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98646f8-afa4-44e9-8e05-e4f3edca0caf None admin] PATH_INFO: `/v3/users` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:22.646391 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98646f8-afa4-44e9-8e05-e4f3edca0caf None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:00:22.646775 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98646f8-afa4-44e9-8e05-e4f3edca0caf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:22.648396 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98646f8-afa4-44e9-8e05-e4f3edca0caf None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:22.666024 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 392/758] 10.222.0.36 () {56 vars in 1133 bytes} [Tue May 3 14:00:22 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:00:22.671523 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98646f8-afa4-44e9-8e05-e4f3edca0caf None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:22.736192 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559ae3e2-3ddb-4041-8c0c-88bff4aedc54 None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:22.771993 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98646f8-afa4-44e9-8e05-e4f3edca0caf None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:22.777077 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8737928e-c4de-4db0-a3a1-dffc3bfd6a2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:22.777768 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8737928e-c4de-4db0-a3a1-dffc3bfd6a2d None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:22.778045 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8737928e-c4de-4db0-a3a1-dffc3bfd6a2d None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:22.778347 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8737928e-c4de-4db0-a3a1-dffc3bfd6a2d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:22.779180 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8737928e-c4de-4db0-a3a1-dffc3bfd6a2d None admin] RBAC: Adding query filter params (role.id=36abe9b50fd8479c86c4f8f70fd85aa3, scope.project.id=de541be478754087934323bdbe41a579, user.id=e1180e29180d44418390cf22d3e0bd6f) {{(pid=80012) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:00:22.779487 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8737928e-c4de-4db0-a3a1-dffc3bfd6a2d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:22.781020 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8737928e-c4de-4db0-a3a1-dffc3bfd6a2d None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:22.788545 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 367/759] 10.222.0.36 () {56 vars in 1374 bytes} [Tue May 3 14:00:22 2022] GET /identity/v3/role_assignments?user.id=e1180e29180d44418390cf22d3e0bd6f&scope.project.id=de541be478754087934323bdbe41a579&role.id=36abe9b50fd8479c86c4f8f70fd85aa3 => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:00:22.791025 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8737928e-c4de-4db0-a3a1-dffc3bfd6a2d None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:22.840852 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa41804-bc6c-4f97-b257-5af974155b12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:22.841951 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa41804-bc6c-4f97-b257-5af974155b12 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:22.842439 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa41804-bc6c-4f97-b257-5af974155b12 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:22.842933 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa41804-bc6c-4f97-b257-5af974155b12 None admin] PATH_INFO: `/v3/projects` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:22.843946 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa41804-bc6c-4f97-b257-5af974155b12 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:00:22.844455 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa41804-bc6c-4f97-b257-5af974155b12 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:22.846166 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa41804-bc6c-4f97-b257-5af974155b12 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:22.866320 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 393/760] 10.222.0.36 () {56 vars in 1148 bytes} [Tue May 3 14:00:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:00:22.875158 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa41804-bc6c-4f97-b257-5af974155b12 None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:22.943740 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8737928e-c4de-4db0-a3a1-dffc3bfd6a2d None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:22.988503 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e11283-9524-4edf-9c0f-6a59fca7aa10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:22.989421 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e11283-9524-4edf-9c0f-6a59fca7aa10 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:22.989780 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e11283-9524-4edf-9c0f-6a59fca7aa10 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:22.989966 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e11283-9524-4edf-9c0f-6a59fca7aa10 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:23.007642 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e11283-9524-4edf-9c0f-6a59fca7aa10 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:23.008954 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e11283-9524-4edf-9c0f-6a59fca7aa10 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:23.011116 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa41804-bc6c-4f97-b257-5af974155b12 None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:23.043445 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application [None req-92e11283-9524-4edf-9c0f-6a59fca7aa10 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 14:00:23.043445 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:00:23.043445 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 14:00:23.043445 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 14:00:23.043445 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 14:00:23.043445 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 14:00:23.043445 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 14:00:23.043445 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 14:00:23.043445 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 14:00:23.043445 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 14:00:23.043445 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 14:00:23.043445 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 14:00:23.043445 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 14:00:23.043445 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 14:00:23.043445 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 14:00:23.044526 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 14:00:23.044526 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 14:00:23.044526 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 14:00:23.044526 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 14:00:23.044526 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 14:00:23.044526 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 14:00:23.044526 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.get_or_create( May 03 14:00:23.044526 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 14:00:23.044526 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application with Lock( May 03 14:00:23.044526 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 14:00:23.044526 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._enter() May 03 14:00:23.044526 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 14:00:23.044526 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 14:00:23.044526 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 14:00:23.044526 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.creator() May 03 14:00:23.044526 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 14:00:23.044526 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application created_value = creator( May 03 14:00:23.045914 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 14:00:23.045914 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 14:00:23.045914 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 14:00:23.045914 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application May 03 14:00:23.045914 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 368/761] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 3 14:00:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 14:00:23.053310 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e11283-9524-4edf-9c0f-6a59fca7aa10 None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:23.057680 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542f96cc-f839-496d-8af5-8af9f4ce94c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:23.058607 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542f96cc-f839-496d-8af5-8af9f4ce94c8 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:23.059088 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542f96cc-f839-496d-8af5-8af9f4ce94c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:23.059606 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542f96cc-f839-496d-8af5-8af9f4ce94c8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:23.060671 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542f96cc-f839-496d-8af5-8af9f4ce94c8 None admin] RBAC: Adding query filter params (role.id=b3902525744e454694820e2ea3b2e563, scope.project.id=de541be478754087934323bdbe41a579, user.id=dec39ff0b6544a738e5aae06e9a8cb38) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:00:23.061209 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542f96cc-f839-496d-8af5-8af9f4ce94c8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:23.062921 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542f96cc-f839-496d-8af5-8af9f4ce94c8 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:23.070269 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 394/762] 10.222.0.36 () {56 vars in 1374 bytes} [Tue May 3 14:00:22 2022] GET /identity/v3/role_assignments?user.id=dec39ff0b6544a738e5aae06e9a8cb38&scope.project.id=de541be478754087934323bdbe41a579&role.id=b3902525744e454694820e2ea3b2e563 => generated 259 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:00:23.187384 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e11283-9524-4edf-9c0f-6a59fca7aa10 None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:23.228654 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96d24b0-b54f-4f50-a5a0-95ec7bba6b1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:23.229440 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96d24b0-b54f-4f50-a5a0-95ec7bba6b1c None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:23.229726 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96d24b0-b54f-4f50-a5a0-95ec7bba6b1c None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:23.230000 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96d24b0-b54f-4f50-a5a0-95ec7bba6b1c None admin] PATH_INFO: `/v3/domains` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:23.230748 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96d24b0-b54f-4f50-a5a0-95ec7bba6b1c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80012) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:00:23.231052 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96d24b0-b54f-4f50-a5a0-95ec7bba6b1c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:23.232528 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96d24b0-b54f-4f50-a5a0-95ec7bba6b1c None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:23.252276 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 369/763] 10.222.0.36 () {56 vars in 1109 bytes} [Tue May 3 14:00:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:00:23.258436 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542f96cc-f839-496d-8af5-8af9f4ce94c8 None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:23.393154 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542f96cc-f839-496d-8af5-8af9f4ce94c8 None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:23.426343 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97355608-e5b3-4b94-8967-65b53afbcfa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:23.427146 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97355608-e5b3-4b94-8967-65b53afbcfa8 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:23.427421 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97355608-e5b3-4b94-8967-65b53afbcfa8 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:23.427689 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97355608-e5b3-4b94-8967-65b53afbcfa8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:23.434498 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97355608-e5b3-4b94-8967-65b53afbcfa8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:23.435982 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97355608-e5b3-4b94-8967-65b53afbcfa8 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:23.450197 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application [None req-97355608-e5b3-4b94-8967-65b53afbcfa8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 14:00:23.450197 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:00:23.450197 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 14:00:23.450197 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 14:00:23.450197 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 14:00:23.450197 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 14:00:23.450197 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 14:00:23.450197 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 14:00:23.450197 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 14:00:23.450197 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 14:00:23.450197 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 14:00:23.450197 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 14:00:23.450197 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 14:00:23.450197 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 14:00:23.450197 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 14:00:23.451151 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 14:00:23.451151 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 14:00:23.451151 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 14:00:23.451151 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 14:00:23.451151 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 14:00:23.451151 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 14:00:23.451151 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.get_or_create( May 03 14:00:23.451151 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 14:00:23.451151 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application with Lock( May 03 14:00:23.451151 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 14:00:23.451151 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._enter() May 03 14:00:23.451151 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 14:00:23.451151 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 14:00:23.451151 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 14:00:23.451151 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.creator() May 03 14:00:23.451151 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 14:00:23.451151 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application created_value = creator( May 03 14:00:23.452072 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 14:00:23.452072 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 14:00:23.452072 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 14:00:23.452072 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 14:00:23.452072 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 14:00:23.452072 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 14:00:23.452072 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 14:00:23.452072 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application May 03 14:00:23.452072 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 395/764] 10.222.0.36 () {56 vars in 1111 bytes} [Tue May 3 14:00:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 14:00:23.457252 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96d24b0-b54f-4f50-a5a0-95ec7bba6b1c None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:23.621078 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96d24b0-b54f-4f50-a5a0-95ec7bba6b1c None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:23.670003 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cace14-1c3f-4230-93c5-d69f29ff697c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:23.670682 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cace14-1c3f-4230-93c5-d69f29ff697c None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:23.670968 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cace14-1c3f-4230-93c5-d69f29ff697c None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:23.671250 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cace14-1c3f-4230-93c5-d69f29ff697c None admin] PATH_INFO: `/v3/projects` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:23.672052 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cace14-1c3f-4230-93c5-d69f29ff697c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80012) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:00:23.672361 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cace14-1c3f-4230-93c5-d69f29ff697c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:23.673823 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cace14-1c3f-4230-93c5-d69f29ff697c None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:23.686215 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 370/765] 10.222.0.36 () {56 vars in 1148 bytes} [Tue May 3 14:00:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:00:23.691965 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97355608-e5b3-4b94-8967-65b53afbcfa8 None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:23.778649 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b642878e-3395-475f-8c05-ab2fb691387a None None] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:23.779019 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b642878e-3395-475f-8c05-ab2fb691387a None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:23.779189 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b642878e-3395-475f-8c05-ab2fb691387a None None] PATH_INFO: `/` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:23.780797 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 371/766] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 3 14:00:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 14:00:23.785507 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80617750-7e57-4431-86a1-e1a84070dd85 None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:23.785793 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80617750-7e57-4431-86a1-e1a84070dd85 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:23.786080 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80617750-7e57-4431-86a1-e1a84070dd85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:23.818331 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-80617750-7e57-4431-86a1-e1a84070dd85 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:00:23.819885 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-80617750-7e57-4431-86a1-e1a84070dd85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:00:23.825407 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97355608-e5b3-4b94-8967-65b53afbcfa8 None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:23.859591 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76a562e-d306-4218-a29c-d278d473cebf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:23.860488 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76a562e-d306-4218-a29c-d278d473cebf None admin] REQUEST_METHOD: `PUT` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:23.860767 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76a562e-d306-4218-a29c-d278d473cebf None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:23.861040 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76a562e-d306-4218-a29c-d278d473cebf None admin] PATH_INFO: `/v3/projects/de541be478754087934323bdbe41a579/users/63489e658c094a2598a2ac62159d2fda/roles/36abe9b50fd8479c86c4f8f70fd85aa3` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:23.863041 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76a562e-d306-4218-a29c-d278d473cebf None admin] RBAC: Authorizing `identity:create_grant(project_id=de541be478754087934323bdbe41a579, user_id=63489e658c094a2598a2ac62159d2fda, role_id=36abe9b50fd8479c86c4f8f70fd85aa3)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:23.868928 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76a562e-d306-4218-a29c-d278d473cebf None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:23.881381 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 396/767] 10.222.0.36 () {58 vars in 1439 bytes} [Tue May 3 14:00:23 2022] PUT /identity/v3/projects/de541be478754087934323bdbe41a579/users/63489e658c094a2598a2ac62159d2fda/roles/36abe9b50fd8479c86c4f8f70fd85aa3 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:00:23.964351 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 372/768] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 3 14:00:23 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 14:00:23.999061 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76a562e-d306-4218-a29c-d278d473cebf None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:24.123541 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76a562e-d306-4218-a29c-d278d473cebf None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:24.164901 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7b6ae3-ac17-4d00-9c49-d7cf0c3cacc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:24.165852 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7b6ae3-ac17-4d00-9c49-d7cf0c3cacc2 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:24.166130 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7b6ae3-ac17-4d00-9c49-d7cf0c3cacc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:24.166403 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7b6ae3-ac17-4d00-9c49-d7cf0c3cacc2 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:24.167074 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7b6ae3-ac17-4d00-9c49-d7cf0c3cacc2 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:24.168491 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7b6ae3-ac17-4d00-9c49-d7cf0c3cacc2 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:24.185575 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application [None req-7d7b6ae3-ac17-4d00-9c49-d7cf0c3cacc2 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 03 14:00:24.185575 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:00:24.185575 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 03 14:00:24.185575 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 03 14:00:24.185575 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 03 14:00:24.185575 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 03 14:00:24.185575 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 03 14:00:24.185575 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 14:00:24.185575 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 03 14:00:24.185575 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application May 03 14:00:24.185575 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 03 14:00:24.185575 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application May 03 14:00:24.185575 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:00:24.185575 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 14:00:24.185575 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 14:00:24.185575 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 14:00:24.186588 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 14:00:24.186588 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 14:00:24.186588 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 14:00:24.186588 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 14:00:24.186588 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 14:00:24.186588 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 14:00:24.186588 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 14:00:24.186588 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 03 14:00:24.186588 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._get_service(service_id) May 03 14:00:24.186588 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 03 14:00:24.186588 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 03 14:00:24.186588 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 14:00:24.186588 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 14:00:24.186588 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 14:00:24.186588 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 14:00:24.186588 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 14:00:24.187453 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.get_or_create( May 03 14:00:24.187453 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 14:00:24.187453 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application with Lock( May 03 14:00:24.187453 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 14:00:24.187453 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._enter() May 03 14:00:24.187453 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 14:00:24.187453 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 14:00:24.187453 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 14:00:24.187453 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.creator() May 03 14:00:24.187453 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 14:00:24.187453 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application created_value = creator( May 03 14:00:24.187453 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 03 14:00:24.187453 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 14:00:24.187453 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 03 14:00:24.187453 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application May 03 14:00:24.187453 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 397/769] 10.222.0.36 () {56 vars in 1129 bytes} [Tue May 3 14:00:23 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 14:00:24.192821 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80617750-7e57-4431-86a1-e1a84070dd85 None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:24.307070 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80617750-7e57-4431-86a1-e1a84070dd85 None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:24.349614 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c8b8e7-d600-4338-bb14-e40eca72f031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:24.350214 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c8b8e7-d600-4338-bb14-e40eca72f031 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:24.350493 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c8b8e7-d600-4338-bb14-e40eca72f031 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:24.350765 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c8b8e7-d600-4338-bb14-e40eca72f031 None admin] PATH_INFO: `/v3/services` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:24.351486 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c8b8e7-d600-4338-bb14-e40eca72f031 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80012) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:00:24.351788 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c8b8e7-d600-4338-bb14-e40eca72f031 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:24.353161 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c8b8e7-d600-4338-bb14-e40eca72f031 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:24.358228 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 373/770] 10.222.0.36 () {56 vars in 1124 bytes} [Tue May 3 14:00:24 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:00:24.360958 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6a76f5-dbd4-4165-a554-f90c28b809d5 None None] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:24.361244 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6a76f5-dbd4-4165-a554-f90c28b809d5 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:24.361548 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6a76f5-dbd4-4165-a554-f90c28b809d5 None None] PATH_INFO: `/` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:24.363131 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 398/771] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 3 14:00:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 14:00:24.368326 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6a76f5-dbd4-4165-a554-f90c28b809d5 None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:24.368558 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c5a50f-7c1d-4bfc-b980-f4a74176b25e None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:24.368816 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c5a50f-7c1d-4bfc-b980-f4a74176b25e None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:24.368972 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c5a50f-7c1d-4bfc-b980-f4a74176b25e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:24.398356 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-61c5a50f-7c1d-4bfc-b980-f4a74176b25e None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:00:24.399554 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-61c5a50f-7c1d-4bfc-b980-f4a74176b25e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:00:24.513536 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6a76f5-dbd4-4165-a554-f90c28b809d5 None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:24.521347 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 374/772] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 3 14:00:24 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 03 14:00:24.554898 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c5a50f-7c1d-4bfc-b980-f4a74176b25e None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:24.561210 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3629dabd-3974-4223-9615-586de7be703d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:24.561917 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3629dabd-3974-4223-9615-586de7be703d None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:24.565063 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3629dabd-3974-4223-9615-586de7be703d None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:24.565375 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3629dabd-3974-4223-9615-586de7be703d None admin] PATH_INFO: `/v3/services` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:24.566105 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3629dabd-3974-4223-9615-586de7be703d None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:00:24.566412 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3629dabd-3974-4223-9615-586de7be703d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:24.567787 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3629dabd-3974-4223-9615-586de7be703d None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:24.579326 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 399/773] 10.222.0.36 () {56 vars in 1124 bytes} [Tue May 3 14:00:24 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:00:24.585011 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3629dabd-3974-4223-9615-586de7be703d None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:24.659103 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c5a50f-7c1d-4bfc-b980-f4a74176b25e None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:24.695042 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a78bb93-b7f4-4be8-9f27-e1181513e90a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:24.696483 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a78bb93-b7f4-4be8-9f27-e1181513e90a None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:24.696767 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a78bb93-b7f4-4be8-9f27-e1181513e90a None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:24.697043 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a78bb93-b7f4-4be8-9f27-e1181513e90a None admin] PATH_INFO: `/v3/services/network` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:24.697728 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a78bb93-b7f4-4be8-9f27-e1181513e90a None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:24.699094 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a78bb93-b7f4-4be8-9f27-e1181513e90a None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:24.720200 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application [None req-8a78bb93-b7f4-4be8-9f27-e1181513e90a None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 03 14:00:24.720200 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:00:24.720200 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 03 14:00:24.720200 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 03 14:00:24.720200 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 03 14:00:24.720200 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 03 14:00:24.720200 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 03 14:00:24.720200 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 14:00:24.720200 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 03 14:00:24.720200 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application May 03 14:00:24.720200 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 03 14:00:24.720200 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application May 03 14:00:24.720200 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:00:24.720200 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 14:00:24.720200 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 14:00:24.720200 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 14:00:24.720200 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 14:00:24.721269 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 14:00:24.721269 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 14:00:24.721269 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 14:00:24.721269 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 14:00:24.721269 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 14:00:24.721269 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 14:00:24.721269 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 03 14:00:24.721269 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._get_service(service_id) May 03 14:00:24.721269 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 03 14:00:24.721269 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 03 14:00:24.721269 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 14:00:24.721269 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 14:00:24.721269 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 14:00:24.721269 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 14:00:24.721269 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 14:00:24.721269 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.get_or_create( May 03 14:00:24.722178 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 14:00:24.722178 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application with Lock( May 03 14:00:24.722178 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 14:00:24.722178 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._enter() May 03 14:00:24.722178 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 14:00:24.722178 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 14:00:24.722178 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 14:00:24.722178 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.creator() May 03 14:00:24.722178 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 14:00:24.722178 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application created_value = creator( May 03 14:00:24.722178 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 03 14:00:24.722178 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 14:00:24.722178 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 03 14:00:24.722178 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application May 03 14:00:24.725050 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 375/774] 10.222.0.36 () {56 vars in 1111 bytes} [Tue May 3 14:00:24 2022] GET /identity/v3/services/network => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 14:00:24.750337 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a78bb93-b7f4-4be8-9f27-e1181513e90a None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:24.767707 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3629dabd-3974-4223-9615-586de7be703d None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:24.814926 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4cd604-9b5f-42b1-bc36-f22ca281f4ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:24.815601 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4cd604-9b5f-42b1-bc36-f22ca281f4ee None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:24.815881 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4cd604-9b5f-42b1-bc36-f22ca281f4ee None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:24.816356 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4cd604-9b5f-42b1-bc36-f22ca281f4ee None admin] PATH_INFO: `/v3/endpoints` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:24.816943 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4cd604-9b5f-42b1-bc36-f22ca281f4ee None admin] RBAC: Adding query filter params (interface=public, service_id=1549281ea4ac465987d7caa3000d47a3, region_id=RegionOne) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:00:24.817255 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4cd604-9b5f-42b1-bc36-f22ca281f4ee None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:24.818658 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4cd604-9b5f-42b1-bc36-f22ca281f4ee None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:24.835375 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 400/775] 10.222.0.36 () {56 vars in 1251 bytes} [Tue May 3 14:00:24 2022] GET /identity/v3/endpoints?service_id=1549281ea4ac465987d7caa3000d47a3&interface=public®ion_id=RegionOne => generated 194 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 14:00:24.841129 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4cd604-9b5f-42b1-bc36-f22ca281f4ee None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:24.887504 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a78bb93-b7f4-4be8-9f27-e1181513e90a None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:24.928048 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b76ddf9-4b75-4e0c-bca8-4492a35379f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:24.929094 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b76ddf9-4b75-4e0c-bca8-4492a35379f6 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:24.929617 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b76ddf9-4b75-4e0c-bca8-4492a35379f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:24.930092 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b76ddf9-4b75-4e0c-bca8-4492a35379f6 None admin] PATH_INFO: `/v3/services` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:24.931035 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b76ddf9-4b75-4e0c-bca8-4492a35379f6 None admin] RBAC: Adding query filter params (name=network) {{(pid=80012) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:00:24.931538 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b76ddf9-4b75-4e0c-bca8-4492a35379f6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:24.933114 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b76ddf9-4b75-4e0c-bca8-4492a35379f6 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:24.941747 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 376/776] 10.222.0.36 () {56 vars in 1112 bytes} [Tue May 3 14:00:24 2022] GET /identity/v3/services?name=network => generated 124 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:00:24.950351 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b76ddf9-4b75-4e0c-bca8-4492a35379f6 None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:25.015119 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4cd604-9b5f-42b1-bc36-f22ca281f4ee None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:25.051041 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ae9808-b3f5-4262-9a7c-bfba874babea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:25.051718 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ae9808-b3f5-4262-9a7c-bfba874babea None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:25.051995 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ae9808-b3f5-4262-9a7c-bfba874babea None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:25.052269 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ae9808-b3f5-4262-9a7c-bfba874babea None admin] PATH_INFO: `/v3/services` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:25.055619 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ae9808-b3f5-4262-9a7c-bfba874babea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:25.057011 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ae9808-b3f5-4262-9a7c-bfba874babea None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:25.069859 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 401/777] 10.222.0.36 () {56 vars in 1087 bytes} [Tue May 3 14:00:24 2022] GET /identity/v3/services => generated 772 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 14:00:25.096572 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b76ddf9-4b75-4e0c-bca8-4492a35379f6 None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:25.136644 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45b0634-880d-4a49-a673-21dd5672617a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:25.137347 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45b0634-880d-4a49-a673-21dd5672617a None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:25.137938 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45b0634-880d-4a49-a673-21dd5672617a None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:25.138112 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45b0634-880d-4a49-a673-21dd5672617a None admin] PATH_INFO: `/v3/services` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:25.138818 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45b0634-880d-4a49-a673-21dd5672617a None admin] RBAC: Adding query filter params (type=network) {{(pid=80012) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:00:25.139124 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45b0634-880d-4a49-a673-21dd5672617a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:25.140492 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45b0634-880d-4a49-a673-21dd5672617a None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:25.150855 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 377/778] 10.222.0.36 () {56 vars in 1112 bytes} [Tue May 3 14:00:24 2022] GET /identity/v3/services?type=network => generated 350 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:00:25.152275 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ae9808-b3f5-4262-9a7c-bfba874babea None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:25.327066 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ae9808-b3f5-4262-9a7c-bfba874babea None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:25.368243 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb913a0-dcc3-49f6-8bcc-683d0ba353a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:25.369311 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb913a0-dcc3-49f6-8bcc-683d0ba353a7 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:25.369798 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb913a0-dcc3-49f6-8bcc-683d0ba353a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:25.370272 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb913a0-dcc3-49f6-8bcc-683d0ba353a7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:25.371265 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb913a0-dcc3-49f6-8bcc-683d0ba353a7 None admin] RBAC: Adding query filter params (interface=public, service_id=fff1e7003fb74705a0d6262fd7961337, region_id=RegionOne) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:00:25.371798 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb913a0-dcc3-49f6-8bcc-683d0ba353a7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:25.373627 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb913a0-dcc3-49f6-8bcc-683d0ba353a7 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:25.382451 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 402/779] 10.222.0.36 () {56 vars in 1251 bytes} [Tue May 3 14:00:25 2022] GET /identity/v3/endpoints?service_id=fff1e7003fb74705a0d6262fd7961337&interface=public®ion_id=RegionOne => generated 194 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:00:25.387892 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45b0634-880d-4a49-a673-21dd5672617a None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:25.490479 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45b0634-880d-4a49-a673-21dd5672617a None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:25.532294 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82413492-03d3-4349-bde7-6fbef997638f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:25.533847 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82413492-03d3-4349-bde7-6fbef997638f None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:25.534330 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82413492-03d3-4349-bde7-6fbef997638f None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:25.534746 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82413492-03d3-4349-bde7-6fbef997638f None admin] PATH_INFO: `/v3/services` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:25.535651 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82413492-03d3-4349-bde7-6fbef997638f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:25.537173 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82413492-03d3-4349-bde7-6fbef997638f None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:25.542805 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 378/780] 10.222.0.36 () {56 vars in 1087 bytes} [Tue May 3 14:00:25 2022] GET /identity/v3/services => generated 772 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:00:25.682153 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c961c026-66ba-489b-9a39-6fbbc2858158 None None] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:25.682659 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c961c026-66ba-489b-9a39-6fbbc2858158 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:25.682659 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c961c026-66ba-489b-9a39-6fbbc2858158 None None] PATH_INFO: `/` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:25.684237 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 403/781] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 3 14:00:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 14:00:25.689866 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03635562-1789-425c-9980-04fbf221ec89 None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:25.690335 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03635562-1789-425c-9980-04fbf221ec89 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:25.690758 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03635562-1789-425c-9980-04fbf221ec89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:25.714855 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-03635562-1789-425c-9980-04fbf221ec89 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:00:25.716631 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-03635562-1789-425c-9980-04fbf221ec89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:00:25.789873 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 379/782] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 3 14:00:25 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 03 14:00:25.823765 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c961c026-66ba-489b-9a39-6fbbc2858158 None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:25.937583 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c961c026-66ba-489b-9a39-6fbbc2858158 None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:25.952148 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463118ff-bbdf-47f8-84f4-f730ad3eb57d None None] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:25.952803 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463118ff-bbdf-47f8-84f4-f730ad3eb57d None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:25.953472 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463118ff-bbdf-47f8-84f4-f730ad3eb57d None None] PATH_INFO: `/` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:25.959774 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 380/783] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 3 14:00:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 14:00:25.961651 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4bca2c-8341-40f6-9c73-1d58f0ed9e34 None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:25.962155 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4bca2c-8341-40f6-9c73-1d58f0ed9e34 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:25.962645 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4bca2c-8341-40f6-9c73-1d58f0ed9e34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:25.974712 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f153854-b8b3-469b-8503-3671a2d418a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:25.975512 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f153854-b8b3-469b-8503-3671a2d418a8 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:25.975793 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f153854-b8b3-469b-8503-3671a2d418a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:25.976068 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f153854-b8b3-469b-8503-3671a2d418a8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:25.983795 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-2e4bca2c-8341-40f6-9c73-1d58f0ed9e34 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:00:25.985254 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-2e4bca2c-8341-40f6-9c73-1d58f0ed9e34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:00:25.987500 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f153854-b8b3-469b-8503-3671a2d418a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 14:00:25.995109 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application [None req-4f153854-b8b3-469b-8503-3671a2d418a8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 03 14:00:25.995109 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:00:25.995109 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 14:00:25.995109 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 14:00:25.995109 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 14:00:25.995109 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 14:00:25.995109 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 14:00:25.995109 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 14:00:25.995109 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 14:00:25.995109 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 14:00:25.995109 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 14:00:25.995109 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 14:00:25.995109 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 14:00:25.995109 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 14:00:25.995109 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 14:00:25.995109 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 14:00:25.996090 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 14:00:25.996090 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 14:00:25.996090 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 14:00:25.996090 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 14:00:25.996090 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 14:00:25.996090 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 14:00:25.996090 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 14:00:25.996090 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 14:00:25.996090 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 14:00:25.996090 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.get_or_create( May 03 14:00:25.996090 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 14:00:25.996090 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application with Lock( May 03 14:00:25.996090 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 14:00:25.996090 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._enter() May 03 14:00:25.996090 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 14:00:25.996090 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 14:00:25.997201 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 14:00:25.997201 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.creator() May 03 14:00:25.997201 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 14:00:25.997201 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application created_value = creator( May 03 14:00:25.997201 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 14:00:25.997201 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 14:00:25.997201 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 14:00:25.997201 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 14:00:25.997201 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 14:00:25.997201 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 14:00:25.997201 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 03 14:00:25.997201 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application May 03 14:00:25.997201 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 404/784] 10.222.0.36 () {56 vars in 1096 bytes} [Tue May 3 14:00:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 14:00:26.002969 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f153854-b8b3-469b-8503-3671a2d418a8 None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:26.061436 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 381/785] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 3 14:00:25 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 03 14:00:26.082059 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4bca2c-8341-40f6-9c73-1d58f0ed9e34 None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:26.105574 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f153854-b8b3-469b-8503-3671a2d418a8 None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:26.139264 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8dc59a-3531-448d-9223-a19d01a192d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:26.139941 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8dc59a-3531-448d-9223-a19d01a192d0 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:26.140222 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8dc59a-3531-448d-9223-a19d01a192d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:26.140497 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8dc59a-3531-448d-9223-a19d01a192d0 None admin] PATH_INFO: `/v3/roles` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:26.141251 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8dc59a-3531-448d-9223-a19d01a192d0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:00:26.141589 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8dc59a-3531-448d-9223-a19d01a192d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:26.142973 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8dc59a-3531-448d-9223-a19d01a192d0 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:26.151844 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 405/786] 10.222.0.36 () {56 vars in 1099 bytes} [Tue May 3 14:00:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:00:26.157368 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8dc59a-3531-448d-9223-a19d01a192d0 None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:26.239551 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4bca2c-8341-40f6-9c73-1d58f0ed9e34 None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:26.265079 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8dc59a-3531-448d-9223-a19d01a192d0 None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:26.302020 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744fb981-eb10-485a-a38c-465b10ac599a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:26.303284 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744fb981-eb10-485a-a38c-465b10ac599a None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:26.303670 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744fb981-eb10-485a-a38c-465b10ac599a None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:26.304044 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744fb981-eb10-485a-a38c-465b10ac599a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:26.322636 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ee20c5-6d7c-4aca-8fdc-d2a244f30120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:26.323456 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ee20c5-6d7c-4aca-8fdc-d2a244f30120 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:26.323739 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ee20c5-6d7c-4aca-8fdc-d2a244f30120 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:26.324015 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ee20c5-6d7c-4aca-8fdc-d2a244f30120 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:26.325712 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744fb981-eb10-485a-a38c-465b10ac599a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:26.329911 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744fb981-eb10-485a-a38c-465b10ac599a None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:26.346114 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ee20c5-6d7c-4aca-8fdc-d2a244f30120 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 14:00:26.362943 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application [None req-a4ee20c5-6d7c-4aca-8fdc-d2a244f30120 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 03 14:00:26.362943 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:00:26.362943 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 14:00:26.362943 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 14:00:26.362943 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 14:00:26.362943 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 14:00:26.362943 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 14:00:26.362943 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 14:00:26.362943 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 14:00:26.362943 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 14:00:26.362943 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 14:00:26.362943 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 14:00:26.362943 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 14:00:26.362943 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 14:00:26.362943 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 14:00:26.362943 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 14:00:26.363958 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 14:00:26.363958 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 14:00:26.363958 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 14:00:26.363958 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 14:00:26.363958 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 14:00:26.363958 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 14:00:26.363958 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 14:00:26.363958 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 14:00:26.363958 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 14:00:26.363958 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.get_or_create( May 03 14:00:26.363958 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 14:00:26.363958 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application with Lock( May 03 14:00:26.363958 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 14:00:26.363958 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._enter() May 03 14:00:26.363958 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 14:00:26.363958 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 14:00:26.365055 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 14:00:26.365055 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.creator() May 03 14:00:26.365055 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 14:00:26.365055 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application created_value = creator( May 03 14:00:26.365055 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 14:00:26.365055 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 14:00:26.365055 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 14:00:26.365055 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 14:00:26.365055 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 14:00:26.365055 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 14:00:26.365055 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 03 14:00:26.365055 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application May 03 14:00:26.365854 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application [None req-744fb981-eb10-485a-a38c-465b10ac599a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 14:00:26.365854 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:00:26.365854 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 14:00:26.365854 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 14:00:26.365854 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 14:00:26.365854 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 14:00:26.365854 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 14:00:26.365854 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 14:00:26.365854 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 14:00:26.365854 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 14:00:26.365854 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 14:00:26.365854 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 14:00:26.365854 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 14:00:26.365854 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 14:00:26.365854 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 14:00:26.366724 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 14:00:26.366724 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 14:00:26.366724 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 14:00:26.366724 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 14:00:26.366724 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 14:00:26.366724 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 14:00:26.366724 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.get_or_create( May 03 14:00:26.366724 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 14:00:26.366724 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application with Lock( May 03 14:00:26.366724 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 14:00:26.366724 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._enter() May 03 14:00:26.366724 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 14:00:26.366724 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 14:00:26.366724 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 14:00:26.366724 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.creator() May 03 14:00:26.366724 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 14:00:26.366724 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application created_value = creator( May 03 14:00:26.367720 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 14:00:26.367720 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 14:00:26.367720 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 14:00:26.367720 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application May 03 14:00:26.367954 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 382/787] 10.222.0.36 () {56 vars in 1102 bytes} [Tue May 3 14:00:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 14:00:26.368025 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 406/788] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 3 14:00:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 14:00:26.375710 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ee20c5-6d7c-4aca-8fdc-d2a244f30120 None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:26.378475 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744fb981-eb10-485a-a38c-465b10ac599a None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:26.483640 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ee20c5-6d7c-4aca-8fdc-d2a244f30120 None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:26.529736 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddc4e2d-c823-4257-894b-5247da028a59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:26.530800 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddc4e2d-c823-4257-894b-5247da028a59 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:26.531304 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddc4e2d-c823-4257-894b-5247da028a59 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:26.531776 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddc4e2d-c823-4257-894b-5247da028a59 None admin] PATH_INFO: `/v3/domains` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:26.532722 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddc4e2d-c823-4257-894b-5247da028a59 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80012) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:00:26.534757 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddc4e2d-c823-4257-894b-5247da028a59 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:26.536431 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddc4e2d-c823-4257-894b-5247da028a59 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:26.555696 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 383/789] 10.222.0.36 () {56 vars in 1109 bytes} [Tue May 3 14:00:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:00:26.561543 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddc4e2d-c823-4257-894b-5247da028a59 None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:26.587442 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744fb981-eb10-485a-a38c-465b10ac599a None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:26.659241 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddc4e2d-c823-4257-894b-5247da028a59 None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:26.670004 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f1f995-dbd9-4f93-86c7-48385aae992e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:26.670690 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f1f995-dbd9-4f93-86c7-48385aae992e None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:26.671205 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f1f995-dbd9-4f93-86c7-48385aae992e None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:26.671205 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f1f995-dbd9-4f93-86c7-48385aae992e None admin] PATH_INFO: `/v3/roles` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:26.671962 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f1f995-dbd9-4f93-86c7-48385aae992e None admin] RBAC: Adding query filter params (name=service) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:00:26.672261 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f1f995-dbd9-4f93-86c7-48385aae992e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:26.673673 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f1f995-dbd9-4f93-86c7-48385aae992e None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:26.696469 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 407/790] 10.222.0.36 () {56 vars in 1103 bytes} [Tue May 3 14:00:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 14:00:26.700218 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f1f995-dbd9-4f93-86c7-48385aae992e None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:26.701225 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7dec73-106a-49d8-8641-3bf01775081f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:26.702294 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7dec73-106a-49d8-8641-3bf01775081f None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:26.702788 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7dec73-106a-49d8-8641-3bf01775081f None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:26.703290 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7dec73-106a-49d8-8641-3bf01775081f None admin] PATH_INFO: `/v3/users/swift` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:26.711438 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7dec73-106a-49d8-8641-3bf01775081f None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:26.713128 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7dec73-106a-49d8-8641-3bf01775081f None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:26.728846 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application [None req-8f7dec73-106a-49d8-8641-3bf01775081f None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 03 14:00:26.728846 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:00:26.728846 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 14:00:26.728846 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 14:00:26.728846 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 14:00:26.728846 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 14:00:26.728846 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 14:00:26.728846 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 14:00:26.728846 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 14:00:26.728846 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 14:00:26.728846 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 14:00:26.728846 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 14:00:26.728846 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 14:00:26.728846 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 14:00:26.728846 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 14:00:26.728846 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 14:00:26.729918 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 14:00:26.729918 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 14:00:26.729918 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 14:00:26.729918 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 14:00:26.729918 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 14:00:26.729918 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 14:00:26.729918 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 14:00:26.729918 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 14:00:26.729918 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 14:00:26.729918 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.get_or_create( May 03 14:00:26.729918 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 14:00:26.729918 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application with Lock( May 03 14:00:26.729918 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 14:00:26.729918 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._enter() May 03 14:00:26.729918 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 14:00:26.729918 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 14:00:26.729918 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 14:00:26.729918 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.creator() May 03 14:00:26.730932 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 14:00:26.730932 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application created_value = creator( May 03 14:00:26.730932 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 14:00:26.730932 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 14:00:26.730932 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 14:00:26.730932 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 14:00:26.730932 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 14:00:26.730932 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 14:00:26.730932 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 03 14:00:26.730932 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application May 03 14:00:26.733849 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 384/791] 10.222.0.36 () {56 vars in 1096 bytes} [Tue May 3 14:00:26 2022] GET /identity/v3/users/swift => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 14:00:26.739608 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7dec73-106a-49d8-8641-3bf01775081f None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:26.839368 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7dec73-106a-49d8-8641-3bf01775081f None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:26.878764 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b430e14-4804-400e-9c1e-59c811df5d8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:26.879433 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b430e14-4804-400e-9c1e-59c811df5d8b None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:26.879708 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b430e14-4804-400e-9c1e-59c811df5d8b None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:26.879979 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b430e14-4804-400e-9c1e-59c811df5d8b None admin] PATH_INFO: `/v3/users` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:26.880811 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b430e14-4804-400e-9c1e-59c811df5d8b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80012) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:00:26.881110 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b430e14-4804-400e-9c1e-59c811df5d8b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:26.882567 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b430e14-4804-400e-9c1e-59c811df5d8b None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:26.883220 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f1f995-dbd9-4f93-86c7-48385aae992e None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:26.900533 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 385/792] 10.222.0.36 () {56 vars in 1135 bytes} [Tue May 3 14:00:26 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 14:00:26.902024 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17515483-008b-4cb9-a12e-190a0cd421c4 None None] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:26.902309 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17515483-008b-4cb9-a12e-190a0cd421c4 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:26.902583 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17515483-008b-4cb9-a12e-190a0cd421c4 None None] PATH_INFO: `/` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:26.908176 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 386/793] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 3 14:00:26 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 14:00:26.908977 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17515483-008b-4cb9-a12e-190a0cd421c4 None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:26.917586 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21ecef1-186f-4457-9cce-7c8f63a3a8c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:26.918414 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21ecef1-186f-4457-9cce-7c8f63a3a8c6 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:26.918703 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21ecef1-186f-4457-9cce-7c8f63a3a8c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:26.918995 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21ecef1-186f-4457-9cce-7c8f63a3a8c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:26.929743 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21ecef1-186f-4457-9cce-7c8f63a3a8c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:26.931260 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21ecef1-186f-4457-9cce-7c8f63a3a8c6 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:26.949948 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application [None req-c21ecef1-186f-4457-9cce-7c8f63a3a8c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 14:00:26.949948 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:00:26.949948 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 14:00:26.949948 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 14:00:26.949948 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 14:00:26.949948 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 14:00:26.949948 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 14:00:26.949948 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 14:00:26.949948 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 14:00:26.949948 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 14:00:26.949948 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 14:00:26.949948 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 14:00:26.949948 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 14:00:26.949948 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 14:00:26.949948 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 14:00:26.951017 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 14:00:26.951017 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 14:00:26.951017 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 14:00:26.951017 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 14:00:26.951017 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 14:00:26.951017 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 14:00:26.951017 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.get_or_create( May 03 14:00:26.951017 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 14:00:26.951017 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application with Lock( May 03 14:00:26.951017 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 14:00:26.951017 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._enter() May 03 14:00:26.951017 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 14:00:26.951017 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 14:00:26.951017 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 14:00:26.951017 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.creator() May 03 14:00:26.951017 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 14:00:26.951017 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application created_value = creator( May 03 14:00:26.951934 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 14:00:26.951934 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 14:00:26.951934 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 14:00:26.951934 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application May 03 14:00:26.952600 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 408/794] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 3 14:00:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 14:00:26.953791 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de59a26-5ad5-48db-912a-bcf015f0b95d None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:26.957308 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de59a26-5ad5-48db-912a-bcf015f0b95d None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:26.957308 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de59a26-5ad5-48db-912a-bcf015f0b95d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:26.971382 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-5de59a26-5ad5-48db-912a-bcf015f0b95d None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:00:26.972563 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-5de59a26-5ad5-48db-912a-bcf015f0b95d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:00:27.008197 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17515483-008b-4cb9-a12e-190a0cd421c4 None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:27.038198 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 409/795] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 3 14:00:26 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 14:00:27.039124 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de59a26-5ad5-48db-912a-bcf015f0b95d None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:27.054033 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f924776b-b465-4ba1-bc66-6d30465f6759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:27.054859 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f924776b-b465-4ba1-bc66-6d30465f6759 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:27.055136 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f924776b-b465-4ba1-bc66-6d30465f6759 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:27.055411 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f924776b-b465-4ba1-bc66-6d30465f6759 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:27.072563 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f924776b-b465-4ba1-bc66-6d30465f6759 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:27.079741 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f924776b-b465-4ba1-bc66-6d30465f6759 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:27.098520 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application [None req-f924776b-b465-4ba1-bc66-6d30465f6759 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 14:00:27.098520 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:00:27.098520 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 14:00:27.098520 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 14:00:27.098520 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 14:00:27.098520 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 14:00:27.098520 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 14:00:27.098520 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 14:00:27.098520 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 14:00:27.098520 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 14:00:27.098520 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 14:00:27.098520 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 14:00:27.098520 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 14:00:27.098520 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 14:00:27.098520 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 14:00:27.100552 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 14:00:27.100552 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 14:00:27.100552 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 14:00:27.100552 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 14:00:27.100552 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 14:00:27.100552 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 14:00:27.100552 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.get_or_create( May 03 14:00:27.100552 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 14:00:27.100552 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application with Lock( May 03 14:00:27.100552 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 14:00:27.100552 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._enter() May 03 14:00:27.100552 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 14:00:27.100552 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 14:00:27.100552 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 14:00:27.100552 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.creator() May 03 14:00:27.100552 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 14:00:27.100552 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application created_value = creator( May 03 14:00:27.102658 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 14:00:27.102658 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 14:00:27.102658 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 14:00:27.102658 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application May 03 14:00:27.102658 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 387/796] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 3 14:00:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 14:00:27.102658 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f924776b-b465-4ba1-bc66-6d30465f6759 None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:27.138284 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de59a26-5ad5-48db-912a-bcf015f0b95d None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:27.171700 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e33d65-9ba3-4f35-805d-e9e5e921edd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:27.172367 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e33d65-9ba3-4f35-805d-e9e5e921edd6 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:27.172647 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e33d65-9ba3-4f35-805d-e9e5e921edd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:27.172918 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e33d65-9ba3-4f35-805d-e9e5e921edd6 None admin] PATH_INFO: `/v3/domains` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:27.173689 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e33d65-9ba3-4f35-805d-e9e5e921edd6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:00:27.173991 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e33d65-9ba3-4f35-805d-e9e5e921edd6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:27.175365 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e33d65-9ba3-4f35-805d-e9e5e921edd6 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:27.188509 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 410/797] 10.222.0.36 () {56 vars in 1109 bytes} [Tue May 3 14:00:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:00:27.189435 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e33d65-9ba3-4f35-805d-e9e5e921edd6 None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:27.197753 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f924776b-b465-4ba1-bc66-6d30465f6759 None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:27.235291 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d6fabe-3634-4fd8-9cbd-0a259fe8f25a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:27.236097 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d6fabe-3634-4fd8-9cbd-0a259fe8f25a None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:27.236371 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d6fabe-3634-4fd8-9cbd-0a259fe8f25a None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:27.236637 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d6fabe-3634-4fd8-9cbd-0a259fe8f25a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:27.246886 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d6fabe-3634-4fd8-9cbd-0a259fe8f25a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 14:00:27.254523 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application [None req-28d6fabe-3634-4fd8-9cbd-0a259fe8f25a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 03 14:00:27.254523 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:00:27.254523 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 14:00:27.254523 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 14:00:27.254523 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 14:00:27.254523 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 14:00:27.254523 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 14:00:27.254523 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 14:00:27.254523 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 14:00:27.254523 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 14:00:27.254523 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 14:00:27.254523 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 14:00:27.254523 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 14:00:27.254523 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 14:00:27.254523 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 14:00:27.254523 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 14:00:27.256610 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 14:00:27.256610 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 14:00:27.256610 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 14:00:27.256610 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 14:00:27.256610 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 14:00:27.256610 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 14:00:27.256610 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 14:00:27.256610 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 14:00:27.256610 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 14:00:27.256610 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.get_or_create( May 03 14:00:27.256610 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 14:00:27.256610 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application with Lock( May 03 14:00:27.256610 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 14:00:27.256610 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._enter() May 03 14:00:27.256610 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 14:00:27.256610 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 14:00:27.258677 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 14:00:27.258677 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.creator() May 03 14:00:27.258677 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 14:00:27.258677 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application created_value = creator( May 03 14:00:27.258677 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 14:00:27.258677 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 14:00:27.258677 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 14:00:27.258677 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 14:00:27.258677 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 14:00:27.258677 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 14:00:27.258677 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 03 14:00:27.258677 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application May 03 14:00:27.265549 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 388/798] 10.222.0.36 () {56 vars in 1096 bytes} [Tue May 3 14:00:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 14:00:27.265549 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d6fabe-3634-4fd8-9cbd-0a259fe8f25a None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:27.290039 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e33d65-9ba3-4f35-805d-e9e5e921edd6 None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:27.323034 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff14d1b8-dc32-4a32-bf3a-a1b0c556c554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:27.323654 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff14d1b8-dc32-4a32-bf3a-a1b0c556c554 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:27.323931 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff14d1b8-dc32-4a32-bf3a-a1b0c556c554 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:27.324203 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff14d1b8-dc32-4a32-bf3a-a1b0c556c554 None admin] PATH_INFO: `/v3/domains` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:27.324923 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff14d1b8-dc32-4a32-bf3a-a1b0c556c554 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:00:27.325456 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff14d1b8-dc32-4a32-bf3a-a1b0c556c554 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:27.326831 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff14d1b8-dc32-4a32-bf3a-a1b0c556c554 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:27.339182 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 411/799] 10.222.0.36 () {56 vars in 1109 bytes} [Tue May 3 14:00:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:00:27.340044 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff14d1b8-dc32-4a32-bf3a-a1b0c556c554 None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:27.357697 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d6fabe-3634-4fd8-9cbd-0a259fe8f25a None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:27.390812 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd701c7-2704-4768-9889-b0082a514cb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:27.391644 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd701c7-2704-4768-9889-b0082a514cb2 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:27.391921 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd701c7-2704-4768-9889-b0082a514cb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:27.392190 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd701c7-2704-4768-9889-b0082a514cb2 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:27.400748 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd701c7-2704-4768-9889-b0082a514cb2 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:27.402264 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd701c7-2704-4768-9889-b0082a514cb2 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:27.417878 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application [None req-9fd701c7-2704-4768-9889-b0082a514cb2 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 03 14:00:27.417878 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:00:27.417878 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 14:00:27.417878 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 14:00:27.417878 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 14:00:27.417878 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 14:00:27.417878 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 14:00:27.417878 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 14:00:27.417878 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 14:00:27.417878 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 14:00:27.417878 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 14:00:27.417878 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 14:00:27.417878 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 14:00:27.417878 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 14:00:27.417878 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 14:00:27.417878 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 14:00:27.420338 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 14:00:27.420338 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 14:00:27.420338 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 14:00:27.420338 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 14:00:27.420338 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 14:00:27.420338 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 14:00:27.420338 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 14:00:27.420338 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 14:00:27.420338 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 14:00:27.420338 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.get_or_create( May 03 14:00:27.420338 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 14:00:27.420338 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application with Lock( May 03 14:00:27.420338 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 14:00:27.420338 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._enter() May 03 14:00:27.420338 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 14:00:27.420338 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 14:00:27.420338 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 14:00:27.420338 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.creator() May 03 14:00:27.422604 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 14:00:27.422604 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application created_value = creator( May 03 14:00:27.422604 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 14:00:27.422604 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 14:00:27.422604 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 14:00:27.422604 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 14:00:27.422604 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 14:00:27.422604 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 14:00:27.422604 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 03 14:00:27.422604 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application May 03 14:00:27.422604 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 389/800] 10.222.0.36 () {56 vars in 1117 bytes} [Tue May 3 14:00:27 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 14:00:27.422604 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd701c7-2704-4768-9889-b0082a514cb2 None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:27.441885 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff14d1b8-dc32-4a32-bf3a-a1b0c556c554 None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:27.477527 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7057c767-6284-47db-aecc-ca00b8062bad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:27.478197 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7057c767-6284-47db-aecc-ca00b8062bad None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:27.478471 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7057c767-6284-47db-aecc-ca00b8062bad None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:27.478743 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7057c767-6284-47db-aecc-ca00b8062bad None admin] PATH_INFO: `/v3/roles` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:27.479487 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7057c767-6284-47db-aecc-ca00b8062bad None admin] RBAC: Adding query filter params (name=admin) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:00:27.479789 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7057c767-6284-47db-aecc-ca00b8062bad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:27.481158 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7057c767-6284-47db-aecc-ca00b8062bad None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:27.489910 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 412/801] 10.222.0.36 () {56 vars in 1099 bytes} [Tue May 3 14:00:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:00:27.490734 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7057c767-6284-47db-aecc-ca00b8062bad None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:27.523325 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd701c7-2704-4768-9889-b0082a514cb2 None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:27.556032 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bc72d7-6d54-4eb2-bf63-9625a5e7fbdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:27.556859 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bc72d7-6d54-4eb2-bf63-9625a5e7fbdd None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:27.557112 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bc72d7-6d54-4eb2-bf63-9625a5e7fbdd None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:27.557425 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bc72d7-6d54-4eb2-bf63-9625a5e7fbdd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:27.564147 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bc72d7-6d54-4eb2-bf63-9625a5e7fbdd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:27.565627 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bc72d7-6d54-4eb2-bf63-9625a5e7fbdd None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:27.580062 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application [None req-54bc72d7-6d54-4eb2-bf63-9625a5e7fbdd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 14:00:27.580062 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:00:27.580062 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 14:00:27.580062 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 14:00:27.580062 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 14:00:27.580062 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 14:00:27.580062 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 14:00:27.580062 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 14:00:27.580062 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 14:00:27.580062 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 14:00:27.580062 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 14:00:27.580062 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 14:00:27.580062 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 14:00:27.580062 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 14:00:27.580062 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 14:00:27.581046 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 14:00:27.581046 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 14:00:27.581046 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 14:00:27.581046 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 14:00:27.581046 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 14:00:27.581046 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 14:00:27.581046 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.get_or_create( May 03 14:00:27.581046 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 14:00:27.581046 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application with Lock( May 03 14:00:27.581046 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 14:00:27.581046 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._enter() May 03 14:00:27.581046 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 14:00:27.581046 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 14:00:27.581046 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 14:00:27.581046 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.creator() May 03 14:00:27.581046 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 14:00:27.581046 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application created_value = creator( May 03 14:00:27.582032 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 14:00:27.582032 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 14:00:27.582032 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 14:00:27.582032 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 14:00:27.582032 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 14:00:27.582032 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 14:00:27.582032 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 14:00:27.582032 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application May 03 14:00:27.582032 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 390/802] 10.222.0.36 () {56 vars in 1111 bytes} [Tue May 3 14:00:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 14:00:27.582533 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bc72d7-6d54-4eb2-bf63-9625a5e7fbdd None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:27.589364 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7057c767-6284-47db-aecc-ca00b8062bad None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:27.622916 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a9d86e-c02c-4d98-b3e6-525dbe8106c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:27.623508 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a9d86e-c02c-4d98-b3e6-525dbe8106c5 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:27.623788 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a9d86e-c02c-4d98-b3e6-525dbe8106c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:27.624061 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a9d86e-c02c-4d98-b3e6-525dbe8106c5 None admin] PATH_INFO: `/v3/users` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:27.624897 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a9d86e-c02c-4d98-b3e6-525dbe8106c5 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:00:27.625200 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a9d86e-c02c-4d98-b3e6-525dbe8106c5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:27.626652 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a9d86e-c02c-4d98-b3e6-525dbe8106c5 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:27.643774 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 413/803] 10.222.0.36 () {56 vars in 1149 bytes} [Tue May 3 14:00:27 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:00:27.645141 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8524d62b-9e76-435e-a3e5-fd47e2ba78c4 None None] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:27.645528 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8524d62b-9e76-435e-a3e5-fd47e2ba78c4 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:27.645855 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8524d62b-9e76-435e-a3e5-fd47e2ba78c4 None None] PATH_INFO: `/` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:27.647209 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 414/804] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 3 14:00:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 14:00:27.647789 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8524d62b-9e76-435e-a3e5-fd47e2ba78c4 None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:27.690268 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bc72d7-6d54-4eb2-bf63-9625a5e7fbdd None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:27.722463 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2586ecb7-9309-4ddd-8661-ab3a8153d971 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:27.723257 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2586ecb7-9309-4ddd-8661-ab3a8153d971 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:27.723831 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2586ecb7-9309-4ddd-8661-ab3a8153d971 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:27.723831 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2586ecb7-9309-4ddd-8661-ab3a8153d971 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:27.733607 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2586ecb7-9309-4ddd-8661-ab3a8153d971 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:27.735058 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2586ecb7-9309-4ddd-8661-ab3a8153d971 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:27.750443 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8524d62b-9e76-435e-a3e5-fd47e2ba78c4 None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:27.752239 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application [None req-2586ecb7-9309-4ddd-8661-ab3a8153d971 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 14:00:27.752239 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:00:27.752239 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 14:00:27.752239 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 14:00:27.752239 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 14:00:27.752239 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 14:00:27.752239 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 14:00:27.752239 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 14:00:27.752239 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 14:00:27.752239 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 14:00:27.752239 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 14:00:27.752239 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 14:00:27.752239 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 14:00:27.752239 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 14:00:27.752239 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 14:00:27.753119 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 14:00:27.753119 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 14:00:27.753119 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 14:00:27.753119 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 14:00:27.753119 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 14:00:27.753119 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 14:00:27.753119 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.get_or_create( May 03 14:00:27.753119 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 14:00:27.753119 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application with Lock( May 03 14:00:27.753119 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 14:00:27.753119 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._enter() May 03 14:00:27.753119 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 14:00:27.753119 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 14:00:27.753119 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 14:00:27.753119 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.creator() May 03 14:00:27.753119 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 14:00:27.753119 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application created_value = creator( May 03 14:00:27.754068 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 14:00:27.754068 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 14:00:27.754068 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 14:00:27.754068 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application May 03 14:00:27.758184 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 391/805] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 3 14:00:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 14:00:27.758934 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2586ecb7-9309-4ddd-8661-ab3a8153d971 None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:27.783936 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b765358-0214-4fab-96fe-ce266dae8880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:27.784668 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b765358-0214-4fab-96fe-ce266dae8880 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:27.784949 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b765358-0214-4fab-96fe-ce266dae8880 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:27.785223 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b765358-0214-4fab-96fe-ce266dae8880 None admin] PATH_INFO: `/v3/projects` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:27.786041 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b765358-0214-4fab-96fe-ce266dae8880 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:00:27.786341 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b765358-0214-4fab-96fe-ce266dae8880 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:27.787768 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b765358-0214-4fab-96fe-ce266dae8880 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:27.805536 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 415/806] 10.222.0.36 () {56 vars in 1148 bytes} [Tue May 3 14:00:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:00:27.805536 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0530643-d11c-42c9-b06b-3f6d63274dac None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:27.805536 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0530643-d11c-42c9-b06b-3f6d63274dac None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:27.805536 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0530643-d11c-42c9-b06b-3f6d63274dac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:27.818785 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-d0530643-d11c-42c9-b06b-3f6d63274dac None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:00:27.819992 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-d0530643-d11c-42c9-b06b-3f6d63274dac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:00:27.864751 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2586ecb7-9309-4ddd-8661-ab3a8153d971 None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:27.886251 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 416/807] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 3 14:00:27 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 14:00:27.887293 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0530643-d11c-42c9-b06b-3f6d63274dac None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:27.908966 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a36d45-243b-4c8f-9b97-e8fc9f0849ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:27.909814 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a36d45-243b-4c8f-9b97-e8fc9f0849ce None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:27.910097 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a36d45-243b-4c8f-9b97-e8fc9f0849ce None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:27.910371 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a36d45-243b-4c8f-9b97-e8fc9f0849ce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:27.920524 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a36d45-243b-4c8f-9b97-e8fc9f0849ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:27.922014 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a36d45-243b-4c8f-9b97-e8fc9f0849ce None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:27.939330 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application [None req-54a36d45-243b-4c8f-9b97-e8fc9f0849ce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 14:00:27.939330 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:00:27.939330 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 14:00:27.939330 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 14:00:27.939330 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 14:00:27.939330 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 14:00:27.939330 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 14:00:27.939330 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 14:00:27.939330 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 14:00:27.939330 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 14:00:27.939330 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 14:00:27.939330 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 14:00:27.939330 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 14:00:27.939330 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 14:00:27.939330 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 14:00:27.940513 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 14:00:27.940513 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 14:00:27.940513 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 14:00:27.940513 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 14:00:27.940513 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 14:00:27.940513 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 14:00:27.940513 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.get_or_create( May 03 14:00:27.940513 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 14:00:27.940513 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application with Lock( May 03 14:00:27.940513 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 14:00:27.940513 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._enter() May 03 14:00:27.940513 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 14:00:27.940513 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 14:00:27.940513 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 14:00:27.940513 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.creator() May 03 14:00:27.940513 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 14:00:27.940513 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application created_value = creator( May 03 14:00:27.941467 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 14:00:27.941467 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 14:00:27.941467 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 14:00:27.941467 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application May 03 14:00:27.941467 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 392/808] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 3 14:00:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 14:00:27.941467 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a36d45-243b-4c8f-9b97-e8fc9f0849ce None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:27.994026 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0530643-d11c-42c9-b06b-3f6d63274dac None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:28.026819 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8681206d-98f0-4dd9-b79a-713ccbacb2e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:28.027583 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8681206d-98f0-4dd9-b79a-713ccbacb2e3 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:28.027926 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8681206d-98f0-4dd9-b79a-713ccbacb2e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:28.028294 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8681206d-98f0-4dd9-b79a-713ccbacb2e3 None admin] PATH_INFO: `/v3/domains` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:28.029075 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8681206d-98f0-4dd9-b79a-713ccbacb2e3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:00:28.029471 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8681206d-98f0-4dd9-b79a-713ccbacb2e3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:28.030911 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8681206d-98f0-4dd9-b79a-713ccbacb2e3 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:28.041246 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a36d45-243b-4c8f-9b97-e8fc9f0849ce None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:28.046997 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 417/809] 10.222.0.36 () {56 vars in 1109 bytes} [Tue May 3 14:00:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:00:28.046997 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8681206d-98f0-4dd9-b79a-713ccbacb2e3 None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:28.096422 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a181449d-fa92-4341-a29d-d7d4f2e5296a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:28.097329 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a181449d-fa92-4341-a29d-d7d4f2e5296a None admin] REQUEST_METHOD: `PUT` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:28.097612 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a181449d-fa92-4341-a29d-d7d4f2e5296a None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:28.098041 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a181449d-fa92-4341-a29d-d7d4f2e5296a None admin] PATH_INFO: `/v3/projects/de541be478754087934323bdbe41a579/users/e1180e29180d44418390cf22d3e0bd6f/roles/36abe9b50fd8479c86c4f8f70fd85aa3` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:28.099992 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a181449d-fa92-4341-a29d-d7d4f2e5296a None admin] RBAC: Authorizing `identity:create_grant(project_id=de541be478754087934323bdbe41a579, user_id=e1180e29180d44418390cf22d3e0bd6f, role_id=36abe9b50fd8479c86c4f8f70fd85aa3)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:28.101439 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a181449d-fa92-4341-a29d-d7d4f2e5296a None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:28.125428 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 393/810] 10.222.0.36 () {58 vars in 1439 bytes} [Tue May 3 14:00:27 2022] PUT /identity/v3/projects/de541be478754087934323bdbe41a579/users/e1180e29180d44418390cf22d3e0bd6f/roles/36abe9b50fd8479c86c4f8f70fd85aa3 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:00:28.127036 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a181449d-fa92-4341-a29d-d7d4f2e5296a None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:28.148457 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8681206d-98f0-4dd9-b79a-713ccbacb2e3 None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:28.183665 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3ff530-a7ee-4d26-a0e4-d019631b2296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:28.184939 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3ff530-a7ee-4d26-a0e4-d019631b2296 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:28.185537 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3ff530-a7ee-4d26-a0e4-d019631b2296 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:28.185997 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3ff530-a7ee-4d26-a0e4-d019631b2296 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:28.186825 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3ff530-a7ee-4d26-a0e4-d019631b2296 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:28.188422 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3ff530-a7ee-4d26-a0e4-d019631b2296 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:28.201848 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application [None req-af3ff530-a7ee-4d26-a0e4-d019631b2296 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 03 14:00:28.201848 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:00:28.201848 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 03 14:00:28.201848 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 03 14:00:28.201848 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 03 14:00:28.201848 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 03 14:00:28.201848 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 03 14:00:28.201848 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 14:00:28.201848 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 03 14:00:28.201848 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application May 03 14:00:28.201848 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 03 14:00:28.201848 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application May 03 14:00:28.201848 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:00:28.201848 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 14:00:28.201848 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 14:00:28.201848 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 14:00:28.202961 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 14:00:28.202961 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 14:00:28.202961 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 14:00:28.202961 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 14:00:28.202961 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 14:00:28.202961 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 14:00:28.202961 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 14:00:28.202961 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 03 14:00:28.202961 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._get_service(service_id) May 03 14:00:28.202961 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 03 14:00:28.202961 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 03 14:00:28.202961 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 14:00:28.202961 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 14:00:28.202961 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 14:00:28.202961 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 14:00:28.202961 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 14:00:28.203863 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.get_or_create( May 03 14:00:28.203863 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 14:00:28.203863 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application with Lock( May 03 14:00:28.203863 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 14:00:28.203863 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._enter() May 03 14:00:28.203863 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 14:00:28.203863 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 14:00:28.203863 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 14:00:28.203863 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.creator() May 03 14:00:28.203863 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 14:00:28.203863 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application created_value = creator( May 03 14:00:28.203863 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 03 14:00:28.203863 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 14:00:28.203863 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 03 14:00:28.203863 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application May 03 14:00:28.206951 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 418/811] 10.222.0.36 () {56 vars in 1129 bytes} [Tue May 3 14:00:28 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 14:00:28.208215 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3ff530-a7ee-4d26-a0e4-d019631b2296 None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:28.257793 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a181449d-fa92-4341-a29d-d7d4f2e5296a None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:28.301629 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db6b874-5590-4d3b-a019-82153f74c14f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:28.302334 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db6b874-5590-4d3b-a019-82153f74c14f None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:28.302615 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db6b874-5590-4d3b-a019-82153f74c14f None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:28.302890 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db6b874-5590-4d3b-a019-82153f74c14f None admin] PATH_INFO: `/v3/domains` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:28.303632 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db6b874-5590-4d3b-a019-82153f74c14f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80012) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:00:28.303941 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db6b874-5590-4d3b-a019-82153f74c14f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:28.305396 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db6b874-5590-4d3b-a019-82153f74c14f None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:28.321729 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 394/812] 10.222.0.36 () {56 vars in 1109 bytes} [Tue May 3 14:00:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:00:28.321729 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db6b874-5590-4d3b-a019-82153f74c14f None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:28.330029 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3ff530-a7ee-4d26-a0e4-d019631b2296 None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:28.367349 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0441b328-0732-4494-8f4b-fdc4e02edbeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:28.368549 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0441b328-0732-4494-8f4b-fdc4e02edbeb None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:28.369061 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0441b328-0732-4494-8f4b-fdc4e02edbeb None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:28.369586 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0441b328-0732-4494-8f4b-fdc4e02edbeb None admin] PATH_INFO: `/v3/users/nova` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:28.382152 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0441b328-0732-4494-8f4b-fdc4e02edbeb None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:28.383893 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0441b328-0732-4494-8f4b-fdc4e02edbeb None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:28.398854 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application [None req-0441b328-0732-4494-8f4b-fdc4e02edbeb None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 03 14:00:28.398854 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:00:28.398854 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 14:00:28.398854 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 14:00:28.398854 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 14:00:28.398854 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 14:00:28.398854 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 14:00:28.398854 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 14:00:28.398854 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 14:00:28.398854 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 14:00:28.398854 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 14:00:28.398854 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 14:00:28.398854 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 14:00:28.398854 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 14:00:28.398854 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 14:00:28.398854 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 14:00:28.399851 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 14:00:28.399851 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 14:00:28.399851 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 14:00:28.399851 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 14:00:28.399851 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 14:00:28.399851 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 14:00:28.399851 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 14:00:28.399851 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 14:00:28.399851 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 14:00:28.399851 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.get_or_create( May 03 14:00:28.399851 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 14:00:28.399851 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application with Lock( May 03 14:00:28.399851 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 14:00:28.399851 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._enter() May 03 14:00:28.399851 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 14:00:28.399851 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 14:00:28.399851 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 14:00:28.399851 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.creator() May 03 14:00:28.401164 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 14:00:28.401164 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application created_value = creator( May 03 14:00:28.401164 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 14:00:28.401164 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 14:00:28.401164 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 14:00:28.401164 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 14:00:28.401164 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 14:00:28.401164 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 14:00:28.401164 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 03 14:00:28.401164 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application May 03 14:00:28.401164 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 419/813] 10.222.0.36 () {56 vars in 1093 bytes} [Tue May 3 14:00:28 2022] GET /identity/v3/users/nova => generated 82 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 14:00:28.401164 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0441b328-0732-4494-8f4b-fdc4e02edbeb None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:28.435591 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db6b874-5590-4d3b-a019-82153f74c14f None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:28.468141 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116da4ec-355e-4e1b-91a9-31a8eecc987a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:28.468808 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116da4ec-355e-4e1b-91a9-31a8eecc987a None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:28.469088 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116da4ec-355e-4e1b-91a9-31a8eecc987a None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:28.469389 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116da4ec-355e-4e1b-91a9-31a8eecc987a None admin] PATH_INFO: `/v3/services` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:28.470096 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116da4ec-355e-4e1b-91a9-31a8eecc987a None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80012) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:00:28.470398 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116da4ec-355e-4e1b-91a9-31a8eecc987a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:28.471758 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116da4ec-355e-4e1b-91a9-31a8eecc987a None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:28.480759 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 395/814] 10.222.0.36 () {56 vars in 1124 bytes} [Tue May 3 14:00:28 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:00:28.480759 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116da4ec-355e-4e1b-91a9-31a8eecc987a None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:28.500780 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0441b328-0732-4494-8f4b-fdc4e02edbeb None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:28.532945 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaaca22-ee2a-4c0f-a92b-6cc5c851386e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:28.534055 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaaca22-ee2a-4c0f-a92b-6cc5c851386e None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:28.534330 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaaca22-ee2a-4c0f-a92b-6cc5c851386e None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:28.534586 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaaca22-ee2a-4c0f-a92b-6cc5c851386e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:28.541158 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcaaca22-ee2a-4c0f-a92b-6cc5c851386e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:28.542626 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcaaca22-ee2a-4c0f-a92b-6cc5c851386e None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:28.556414 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application [None req-dcaaca22-ee2a-4c0f-a92b-6cc5c851386e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 14:00:28.556414 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:00:28.556414 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 14:00:28.556414 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 14:00:28.556414 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 14:00:28.556414 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 14:00:28.556414 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 14:00:28.556414 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 14:00:28.556414 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 14:00:28.556414 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 14:00:28.556414 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 14:00:28.556414 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 14:00:28.556414 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 14:00:28.556414 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 14:00:28.556414 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 14:00:28.557381 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 14:00:28.557381 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 14:00:28.557381 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 14:00:28.557381 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 14:00:28.557381 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 14:00:28.557381 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 14:00:28.557381 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.get_or_create( May 03 14:00:28.557381 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 14:00:28.557381 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application with Lock( May 03 14:00:28.557381 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 14:00:28.557381 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._enter() May 03 14:00:28.557381 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 14:00:28.557381 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 14:00:28.557381 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 14:00:28.557381 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.creator() May 03 14:00:28.557381 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 14:00:28.557381 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application created_value = creator( May 03 14:00:28.558301 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 14:00:28.558301 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 14:00:28.558301 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 14:00:28.558301 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 14:00:28.558301 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 14:00:28.558301 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 14:00:28.558301 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 14:00:28.558301 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application May 03 14:00:28.558301 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 420/815] 10.222.0.36 () {56 vars in 1111 bytes} [Tue May 3 14:00:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 14:00:28.559347 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7694d68-c4d9-41f3-8563-aae8e75dddba None None] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:28.559347 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7694d68-c4d9-41f3-8563-aae8e75dddba None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:28.559347 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7694d68-c4d9-41f3-8563-aae8e75dddba None None] PATH_INFO: `/` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:28.560785 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 421/816] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 3 14:00:28 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 14:00:28.562101 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7694d68-c4d9-41f3-8563-aae8e75dddba None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:28.583940 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116da4ec-355e-4e1b-91a9-31a8eecc987a None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:28.616144 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704dd79e-4e08-4b7a-814a-e2fb8391d196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:28.616819 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704dd79e-4e08-4b7a-814a-e2fb8391d196 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:28.617082 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704dd79e-4e08-4b7a-814a-e2fb8391d196 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:28.617381 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704dd79e-4e08-4b7a-814a-e2fb8391d196 None admin] PATH_INFO: `/v3/users` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:28.618201 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704dd79e-4e08-4b7a-814a-e2fb8391d196 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80012) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:00:28.618510 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704dd79e-4e08-4b7a-814a-e2fb8391d196 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:28.619963 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704dd79e-4e08-4b7a-814a-e2fb8391d196 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:28.637863 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 396/817] 10.222.0.36 () {56 vars in 1133 bytes} [Tue May 3 14:00:28 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:00:28.638918 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704dd79e-4e08-4b7a-814a-e2fb8391d196 None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:28.663067 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7694d68-c4d9-41f3-8563-aae8e75dddba None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:28.696729 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b6f151-2d87-4563-a192-c5284eb1c049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:28.697414 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b6f151-2d87-4563-a192-c5284eb1c049 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:28.697699 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b6f151-2d87-4563-a192-c5284eb1c049 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:28.697970 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b6f151-2d87-4563-a192-c5284eb1c049 None admin] PATH_INFO: `/v3/services` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:28.698662 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b6f151-2d87-4563-a192-c5284eb1c049 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:00:28.698971 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b6f151-2d87-4563-a192-c5284eb1c049 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:28.700452 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b6f151-2d87-4563-a192-c5284eb1c049 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:28.705377 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 422/818] 10.222.0.36 () {56 vars in 1124 bytes} [Tue May 3 14:00:28 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:00:28.706543 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64c1dc2-4903-49dc-a9e0-bb41b5acfe99 None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:28.706820 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64c1dc2-4903-49dc-a9e0-bb41b5acfe99 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:28.707090 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64c1dc2-4903-49dc-a9e0-bb41b5acfe99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:28.723229 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-b64c1dc2-4903-49dc-a9e0-bb41b5acfe99 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:00:28.724396 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-b64c1dc2-4903-49dc-a9e0-bb41b5acfe99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:00:28.740776 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704dd79e-4e08-4b7a-814a-e2fb8391d196 None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:28.778396 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf8a1d1-c6e0-488d-bf01-2db6bd2c1a8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:28.779363 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf8a1d1-c6e0-488d-bf01-2db6bd2c1a8c None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:28.779827 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf8a1d1-c6e0-488d-bf01-2db6bd2c1a8c None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:28.780183 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf8a1d1-c6e0-488d-bf01-2db6bd2c1a8c None admin] PATH_INFO: `/v3/projects` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:28.781025 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf8a1d1-c6e0-488d-bf01-2db6bd2c1a8c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80012) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:00:28.781361 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf8a1d1-c6e0-488d-bf01-2db6bd2c1a8c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:28.782796 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf8a1d1-c6e0-488d-bf01-2db6bd2c1a8c None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:28.809333 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 423/819] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 3 14:00:28 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 14:00:28.809333 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64c1dc2-4903-49dc-a9e0-bb41b5acfe99 None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:28.809941 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 397/820] 10.222.0.36 () {56 vars in 1148 bytes} [Tue May 3 14:00:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:00:28.809941 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf8a1d1-c6e0-488d-bf01-2db6bd2c1a8c None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:28.894313 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64c1dc2-4903-49dc-a9e0-bb41b5acfe99 None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:28.923788 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf8a1d1-c6e0-488d-bf01-2db6bd2c1a8c None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:28.927410 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0026e52f-9fd4-459d-8edc-d690a57e5b0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:28.928057 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0026e52f-9fd4-459d-8edc-d690a57e5b0f None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:28.928333 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0026e52f-9fd4-459d-8edc-d690a57e5b0f None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:28.928600 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0026e52f-9fd4-459d-8edc-d690a57e5b0f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:28.961956 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc58d775-15e4-4a7a-87cd-f4dcc7f07d2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:28.962757 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc58d775-15e4-4a7a-87cd-f4dcc7f07d2f None admin] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:28.963042 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc58d775-15e4-4a7a-87cd-f4dcc7f07d2f None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:28.963312 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc58d775-15e4-4a7a-87cd-f4dcc7f07d2f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:28.965123 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc58d775-15e4-4a7a-87cd-f4dcc7f07d2f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:28.966561 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc58d775-15e4-4a7a-87cd-f4dcc7f07d2f None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:28.997388 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 398/821] 10.222.0.36 () {60 vars in 1144 bytes} [Tue May 3 14:00:28 2022] POST /identity/v3/endpoints => generated 346 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 14:00:28.998025 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0026e52f-9fd4-459d-8edc-d690a57e5b0f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:28.999047 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc58d775-15e4-4a7a-87cd-f4dcc7f07d2f None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:28.999517 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0026e52f-9fd4-459d-8edc-d690a57e5b0f None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:29.128135 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 424/822] 10.222.0.36 () {58 vars in 1282 bytes} [Tue May 3 14:00:28 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 03 14:00:29.128135 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0026e52f-9fd4-459d-8edc-d690a57e5b0f None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:29.163344 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc58d775-15e4-4a7a-87cd-f4dcc7f07d2f None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:29.201319 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce87a94f-1557-4052-89a6-84b63bf2a563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:29.202161 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce87a94f-1557-4052-89a6-84b63bf2a563 None admin] REQUEST_METHOD: `PUT` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:29.202438 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce87a94f-1557-4052-89a6-84b63bf2a563 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:29.202714 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce87a94f-1557-4052-89a6-84b63bf2a563 None admin] PATH_INFO: `/v3/projects/de541be478754087934323bdbe41a579/users/dec39ff0b6544a738e5aae06e9a8cb38/roles/b3902525744e454694820e2ea3b2e563` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:29.218966 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce87a94f-1557-4052-89a6-84b63bf2a563 None admin] RBAC: Authorizing `identity:create_grant(project_id=de541be478754087934323bdbe41a579, user_id=dec39ff0b6544a738e5aae06e9a8cb38, role_id=b3902525744e454694820e2ea3b2e563)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:29.220511 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce87a94f-1557-4052-89a6-84b63bf2a563 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:29.236467 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 399/823] 10.222.0.36 () {58 vars in 1439 bytes} [Tue May 3 14:00:28 2022] PUT /identity/v3/projects/de541be478754087934323bdbe41a579/users/dec39ff0b6544a738e5aae06e9a8cb38/roles/b3902525744e454694820e2ea3b2e563 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:00:29.237183 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce87a94f-1557-4052-89a6-84b63bf2a563 None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:29.255088 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0026e52f-9fd4-459d-8edc-d690a57e5b0f None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:29.297108 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1727d1-b541-4b46-87ae-9a65a8bfb3db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:29.297961 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1727d1-b541-4b46-87ae-9a65a8bfb3db None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:29.298237 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1727d1-b541-4b46-87ae-9a65a8bfb3db None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:29.298507 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1727d1-b541-4b46-87ae-9a65a8bfb3db None admin] PATH_INFO: `/v3/services/network` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:29.299166 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1727d1-b541-4b46-87ae-9a65a8bfb3db None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:29.300549 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1727d1-b541-4b46-87ae-9a65a8bfb3db None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:29.314565 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application [None req-3e1727d1-b541-4b46-87ae-9a65a8bfb3db None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 03 14:00:29.314565 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:00:29.314565 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 03 14:00:29.314565 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 03 14:00:29.314565 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 03 14:00:29.314565 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 03 14:00:29.314565 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 03 14:00:29.314565 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 14:00:29.314565 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 03 14:00:29.314565 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application May 03 14:00:29.314565 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 03 14:00:29.314565 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application May 03 14:00:29.314565 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:00:29.314565 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 14:00:29.314565 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 14:00:29.314565 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 14:00:29.314565 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 14:00:29.315667 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 14:00:29.315667 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 14:00:29.315667 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 14:00:29.315667 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 14:00:29.315667 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 14:00:29.315667 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 14:00:29.315667 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 03 14:00:29.315667 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._get_service(service_id) May 03 14:00:29.315667 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 03 14:00:29.315667 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 03 14:00:29.315667 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 14:00:29.315667 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 14:00:29.315667 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 14:00:29.315667 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 14:00:29.315667 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 14:00:29.315667 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.get_or_create( May 03 14:00:29.316522 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 14:00:29.316522 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application with Lock( May 03 14:00:29.316522 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 14:00:29.316522 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._enter() May 03 14:00:29.316522 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 14:00:29.316522 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 14:00:29.316522 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 14:00:29.316522 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.creator() May 03 14:00:29.316522 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 14:00:29.316522 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application created_value = creator( May 03 14:00:29.316522 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 03 14:00:29.316522 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 14:00:29.316522 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 03 14:00:29.316522 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application May 03 14:00:29.317272 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 425/824] 10.222.0.36 () {56 vars in 1111 bytes} [Tue May 3 14:00:29 2022] GET /identity/v3/services/network => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 14:00:29.323082 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1727d1-b541-4b46-87ae-9a65a8bfb3db None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:29.391886 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce87a94f-1557-4052-89a6-84b63bf2a563 None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:29.437429 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3f837d-518c-426b-aafa-ad0929f071ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:29.438244 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3f837d-518c-426b-aafa-ad0929f071ff None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:29.438523 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3f837d-518c-426b-aafa-ad0929f071ff None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:29.438852 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3f837d-518c-426b-aafa-ad0929f071ff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:29.445614 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1727d1-b541-4b46-87ae-9a65a8bfb3db None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:29.450134 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3f837d-518c-426b-aafa-ad0929f071ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:29.451655 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3f837d-518c-426b-aafa-ad0929f071ff None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:29.470481 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application [None req-de3f837d-518c-426b-aafa-ad0929f071ff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 14:00:29.470481 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:00:29.470481 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 14:00:29.470481 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 14:00:29.470481 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 14:00:29.470481 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 14:00:29.470481 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 14:00:29.470481 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 14:00:29.470481 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 14:00:29.470481 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 14:00:29.470481 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 14:00:29.470481 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 14:00:29.470481 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 14:00:29.470481 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 14:00:29.470481 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 14:00:29.471464 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 14:00:29.471464 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 14:00:29.471464 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 14:00:29.471464 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 14:00:29.471464 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 14:00:29.471464 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 14:00:29.471464 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.get_or_create( May 03 14:00:29.471464 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 14:00:29.471464 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application with Lock( May 03 14:00:29.471464 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 14:00:29.471464 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._enter() May 03 14:00:29.471464 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 14:00:29.471464 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 14:00:29.471464 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 14:00:29.471464 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.creator() May 03 14:00:29.471464 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 14:00:29.471464 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application created_value = creator( May 03 14:00:29.472376 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 14:00:29.472376 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 14:00:29.472376 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 14:00:29.472376 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application May 03 14:00:29.476330 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 400/825] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 3 14:00:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 14:00:29.477189 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3f837d-518c-426b-aafa-ad0929f071ff None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:29.486595 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfdb5f3-fc0f-47e5-ab4b-f30afec13dd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:29.487602 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfdb5f3-fc0f-47e5-ab4b-f30afec13dd0 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:29.488090 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfdb5f3-fc0f-47e5-ab4b-f30afec13dd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:29.488583 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfdb5f3-fc0f-47e5-ab4b-f30afec13dd0 None admin] PATH_INFO: `/v3/services` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:29.489582 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfdb5f3-fc0f-47e5-ab4b-f30afec13dd0 None admin] RBAC: Adding query filter params (name=network) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:00:29.490086 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfdb5f3-fc0f-47e5-ab4b-f30afec13dd0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:29.491680 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfdb5f3-fc0f-47e5-ab4b-f30afec13dd0 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:29.501345 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 426/826] 10.222.0.36 () {56 vars in 1112 bytes} [Tue May 3 14:00:29 2022] GET /identity/v3/services?name=network => generated 124 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 14:00:29.502862 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfdb5f3-fc0f-47e5-ab4b-f30afec13dd0 None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:29.574859 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3f837d-518c-426b-aafa-ad0929f071ff None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:29.603402 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfdb5f3-fc0f-47e5-ab4b-f30afec13dd0 None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:29.608246 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dfef84-8c14-4da0-9020-303bf1f91382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:29.608911 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dfef84-8c14-4da0-9020-303bf1f91382 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:29.609190 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dfef84-8c14-4da0-9020-303bf1f91382 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:29.609486 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dfef84-8c14-4da0-9020-303bf1f91382 None admin] PATH_INFO: `/v3/domains` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:29.610202 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dfef84-8c14-4da0-9020-303bf1f91382 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80012) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:00:29.610503 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dfef84-8c14-4da0-9020-303bf1f91382 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:29.611920 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dfef84-8c14-4da0-9020-303bf1f91382 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:29.624002 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 401/827] 10.222.0.36 () {56 vars in 1109 bytes} [Tue May 3 14:00:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:00:29.629433 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dfef84-8c14-4da0-9020-303bf1f91382 None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:29.640819 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f41230-af4e-4e3f-b8ba-c8b07235a639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:29.641876 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f41230-af4e-4e3f-b8ba-c8b07235a639 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:29.642350 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f41230-af4e-4e3f-b8ba-c8b07235a639 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:29.642908 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f41230-af4e-4e3f-b8ba-c8b07235a639 None admin] PATH_INFO: `/v3/services` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:29.643856 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f41230-af4e-4e3f-b8ba-c8b07235a639 None admin] RBAC: Adding query filter params (type=network) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:00:29.644346 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f41230-af4e-4e3f-b8ba-c8b07235a639 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:29.646014 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f41230-af4e-4e3f-b8ba-c8b07235a639 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:29.655910 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 427/828] 10.222.0.36 () {56 vars in 1112 bytes} [Tue May 3 14:00:29 2022] GET /identity/v3/services?type=network => generated 350 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 14:00:29.657678 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f41230-af4e-4e3f-b8ba-c8b07235a639 None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:29.725447 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dfef84-8c14-4da0-9020-303bf1f91382 None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:29.756622 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f41230-af4e-4e3f-b8ba-c8b07235a639 None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:29.758071 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2696cecc-2e1c-4db3-a45f-0e89661b942c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:29.758874 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2696cecc-2e1c-4db3-a45f-0e89661b942c None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:29.759152 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2696cecc-2e1c-4db3-a45f-0e89661b942c None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:29.759423 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2696cecc-2e1c-4db3-a45f-0e89661b942c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:29.766302 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2696cecc-2e1c-4db3-a45f-0e89661b942c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:29.767743 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2696cecc-2e1c-4db3-a45f-0e89661b942c None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:29.781958 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application [None req-2696cecc-2e1c-4db3-a45f-0e89661b942c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 14:00:29.781958 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:00:29.781958 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 14:00:29.781958 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 14:00:29.781958 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 14:00:29.781958 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 14:00:29.781958 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 14:00:29.781958 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 14:00:29.781958 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 14:00:29.781958 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 14:00:29.781958 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 14:00:29.781958 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 14:00:29.781958 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 14:00:29.781958 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 14:00:29.781958 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 14:00:29.783028 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 14:00:29.783028 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 14:00:29.783028 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 14:00:29.783028 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 14:00:29.783028 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 14:00:29.783028 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 14:00:29.783028 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.get_or_create( May 03 14:00:29.783028 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 14:00:29.783028 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application with Lock( May 03 14:00:29.783028 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 14:00:29.783028 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._enter() May 03 14:00:29.783028 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 14:00:29.783028 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 14:00:29.783028 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 14:00:29.783028 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.creator() May 03 14:00:29.783028 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 14:00:29.783028 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application created_value = creator( May 03 14:00:29.784249 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 14:00:29.784249 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 14:00:29.784249 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 14:00:29.784249 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 14:00:29.784249 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 14:00:29.784249 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 14:00:29.784249 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 14:00:29.784249 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application May 03 14:00:29.784249 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 402/829] 10.222.0.36 () {56 vars in 1111 bytes} [Tue May 3 14:00:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 14:00:29.788948 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2696cecc-2e1c-4db3-a45f-0e89661b942c None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:29.795690 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a321624a-804d-467c-8a3a-e19e931bb2fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:29.796549 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a321624a-804d-467c-8a3a-e19e931bb2fa None admin] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:29.796975 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a321624a-804d-467c-8a3a-e19e931bb2fa None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:29.797435 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a321624a-804d-467c-8a3a-e19e931bb2fa None admin] PATH_INFO: `/v3/endpoints` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:29.798391 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a321624a-804d-467c-8a3a-e19e931bb2fa None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:29.799953 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a321624a-804d-467c-8a3a-e19e931bb2fa None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:29.830938 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 428/830] 10.222.0.36 () {60 vars in 1144 bytes} [Tue May 3 14:00:29 2022] POST /identity/v3/endpoints => generated 327 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 14:00:29.888312 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2696cecc-2e1c-4db3-a45f-0e89661b942c None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:29.929849 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56e2912-f705-44cd-b842-bd046c96efd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:29.930511 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56e2912-f705-44cd-b842-bd046c96efd9 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:29.930788 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56e2912-f705-44cd-b842-bd046c96efd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:29.931058 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56e2912-f705-44cd-b842-bd046c96efd9 None admin] PATH_INFO: `/v3/projects` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:29.931915 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56e2912-f705-44cd-b842-bd046c96efd9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80012) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:00:29.932221 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56e2912-f705-44cd-b842-bd046c96efd9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:29.933667 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56e2912-f705-44cd-b842-bd046c96efd9 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:29.946488 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 403/831] 10.222.0.36 () {56 vars in 1148 bytes} [Tue May 3 14:00:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 14:00:29.952763 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a321624a-804d-467c-8a3a-e19e931bb2fa None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:30.091719 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a321624a-804d-467c-8a3a-e19e931bb2fa None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:30.127135 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b25ed5b-a4e7-4edf-a9f2-c419587a7b64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:30.127786 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b25ed5b-a4e7-4edf-a9f2-c419587a7b64 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:30.128061 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b25ed5b-a4e7-4edf-a9f2-c419587a7b64 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:30.128326 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b25ed5b-a4e7-4edf-a9f2-c419587a7b64 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:30.129146 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b25ed5b-a4e7-4edf-a9f2-c419587a7b64 None admin] RBAC: Adding query filter params (role.id=36abe9b50fd8479c86c4f8f70fd85aa3, scope.project.id=de541be478754087934323bdbe41a579, user.id=63489e658c094a2598a2ac62159d2fda) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:00:30.129476 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b25ed5b-a4e7-4edf-a9f2-c419587a7b64 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:30.130891 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b25ed5b-a4e7-4edf-a9f2-c419587a7b64 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:30.137166 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 429/832] 10.222.0.36 () {56 vars in 1374 bytes} [Tue May 3 14:00:29 2022] GET /identity/v3/role_assignments?user.id=63489e658c094a2598a2ac62159d2fda&scope.project.id=de541be478754087934323bdbe41a579&role.id=36abe9b50fd8479c86c4f8f70fd85aa3 => generated 608 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:00:30.625782 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afdd5c9-b7fc-42d4-b7c8-3c707df89205 None None] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:30.626317 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afdd5c9-b7fc-42d4-b7c8-3c707df89205 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:30.626317 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afdd5c9-b7fc-42d4-b7c8-3c707df89205 None None] PATH_INFO: `/` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:30.627986 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 404/833] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 3 14:00:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 14:00:30.633333 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2892ce-4cff-4cf9-95f5-c29c79068b62 None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:30.633634 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2892ce-4cff-4cf9-95f5-c29c79068b62 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:30.633927 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2892ce-4cff-4cf9-95f5-c29c79068b62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:30.651607 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-cf2892ce-4cff-4cf9-95f5-c29c79068b62 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:00:30.652795 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-cf2892ce-4cff-4cf9-95f5-c29c79068b62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:00:30.717916 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 430/834] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 3 14:00:30 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 14:00:30.741244 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afdd5c9-b7fc-42d4-b7c8-3c707df89205 None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:30.842069 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afdd5c9-b7fc-42d4-b7c8-3c707df89205 None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:30.874666 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7856255-4877-4ca2-87d9-99921b0ed800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:30.875422 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7856255-4877-4ca2-87d9-99921b0ed800 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:30.875707 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7856255-4877-4ca2-87d9-99921b0ed800 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:30.876032 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7856255-4877-4ca2-87d9-99921b0ed800 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:30.887024 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7856255-4877-4ca2-87d9-99921b0ed800 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 14:00:30.894836 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application [None req-f7856255-4877-4ca2-87d9-99921b0ed800 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 03 14:00:30.894836 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:00:30.894836 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 14:00:30.894836 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 14:00:30.894836 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 14:00:30.894836 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 14:00:30.894836 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 14:00:30.894836 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 14:00:30.894836 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 14:00:30.894836 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 14:00:30.894836 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 14:00:30.894836 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 14:00:30.894836 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 14:00:30.894836 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 14:00:30.894836 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 14:00:30.894836 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 14:00:30.895777 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 14:00:30.895777 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 14:00:30.895777 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 14:00:30.895777 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 14:00:30.895777 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 14:00:30.895777 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 14:00:30.895777 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 14:00:30.895777 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 14:00:30.895777 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 14:00:30.895777 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.get_or_create( May 03 14:00:30.895777 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 14:00:30.895777 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application with Lock( May 03 14:00:30.895777 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 14:00:30.895777 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._enter() May 03 14:00:30.895777 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 14:00:30.895777 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 14:00:30.896655 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 14:00:30.896655 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.creator() May 03 14:00:30.896655 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 14:00:30.896655 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application created_value = creator( May 03 14:00:30.896655 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 14:00:30.896655 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 14:00:30.896655 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 14:00:30.896655 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 14:00:30.896655 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 14:00:30.896655 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 14:00:30.896655 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 03 14:00:30.896655 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application May 03 14:00:30.896655 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 405/835] 10.222.0.36 () {56 vars in 1096 bytes} [Tue May 3 14:00:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 14:00:30.902307 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2892ce-4cff-4cf9-95f5-c29c79068b62 None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:31.000470 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2892ce-4cff-4cf9-95f5-c29c79068b62 None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:31.033367 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daca392a-a886-407d-92ee-797ae0e4b70d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:31.034043 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daca392a-a886-407d-92ee-797ae0e4b70d None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:31.034317 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daca392a-a886-407d-92ee-797ae0e4b70d None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:31.034588 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daca392a-a886-407d-92ee-797ae0e4b70d None admin] PATH_INFO: `/v3/roles` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:31.035331 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daca392a-a886-407d-92ee-797ae0e4b70d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:00:31.035629 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daca392a-a886-407d-92ee-797ae0e4b70d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:31.036988 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daca392a-a886-407d-92ee-797ae0e4b70d None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:31.045806 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 431/836] 10.222.0.36 () {56 vars in 1099 bytes} [Tue May 3 14:00:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:00:31.051395 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7856255-4877-4ca2-87d9-99921b0ed800 None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:31.153623 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7856255-4877-4ca2-87d9-99921b0ed800 None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:31.187622 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8ebfa4-fc30-4f9a-86f7-ca731de39ce1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:31.188759 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8ebfa4-fc30-4f9a-86f7-ca731de39ce1 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:31.189312 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8ebfa4-fc30-4f9a-86f7-ca731de39ce1 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:31.189816 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8ebfa4-fc30-4f9a-86f7-ca731de39ce1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:31.200648 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8ebfa4-fc30-4f9a-86f7-ca731de39ce1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:31.202446 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8ebfa4-fc30-4f9a-86f7-ca731de39ce1 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:31.221011 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application [None req-bb8ebfa4-fc30-4f9a-86f7-ca731de39ce1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 14:00:31.221011 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:00:31.221011 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 14:00:31.221011 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 14:00:31.221011 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 14:00:31.221011 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 14:00:31.221011 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 14:00:31.221011 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 14:00:31.221011 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 14:00:31.221011 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 14:00:31.221011 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 14:00:31.221011 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 14:00:31.221011 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 14:00:31.221011 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 14:00:31.221011 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 14:00:31.222046 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 14:00:31.222046 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 14:00:31.222046 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 14:00:31.222046 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 14:00:31.222046 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 14:00:31.222046 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 14:00:31.222046 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.get_or_create( May 03 14:00:31.222046 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 14:00:31.222046 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application with Lock( May 03 14:00:31.222046 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 14:00:31.222046 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._enter() May 03 14:00:31.222046 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 14:00:31.222046 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 14:00:31.222046 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 14:00:31.222046 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.creator() May 03 14:00:31.222046 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 14:00:31.222046 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application created_value = creator( May 03 14:00:31.223025 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 14:00:31.223025 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 14:00:31.223025 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 14:00:31.223025 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application May 03 14:00:31.229314 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 406/837] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 3 14:00:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 14:00:31.234395 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daca392a-a886-407d-92ee-797ae0e4b70d None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:31.334282 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daca392a-a886-407d-92ee-797ae0e4b70d None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:31.368339 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bf11c9-26bd-43cf-9d19-51d64ee79390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:31.369004 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bf11c9-26bd-43cf-9d19-51d64ee79390 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:31.369281 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bf11c9-26bd-43cf-9d19-51d64ee79390 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:31.369575 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bf11c9-26bd-43cf-9d19-51d64ee79390 None admin] PATH_INFO: `/v3/domains` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:31.370295 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bf11c9-26bd-43cf-9d19-51d64ee79390 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:00:31.370595 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bf11c9-26bd-43cf-9d19-51d64ee79390 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:31.372000 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bf11c9-26bd-43cf-9d19-51d64ee79390 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:31.384170 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 432/838] 10.222.0.36 () {56 vars in 1109 bytes} [Tue May 3 14:00:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:00:31.390775 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8ebfa4-fc30-4f9a-86f7-ca731de39ce1 None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:31.496884 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8ebfa4-fc30-4f9a-86f7-ca731de39ce1 None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:31.530740 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0fb8e0-98b1-4bd5-b1c0-718c4cd03885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:31.531914 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0fb8e0-98b1-4bd5-b1c0-718c4cd03885 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:31.532427 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0fb8e0-98b1-4bd5-b1c0-718c4cd03885 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:31.532906 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0fb8e0-98b1-4bd5-b1c0-718c4cd03885 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:31.541244 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0fb8e0-98b1-4bd5-b1c0-718c4cd03885 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:31.542987 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0fb8e0-98b1-4bd5-b1c0-718c4cd03885 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:31.557770 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application [None req-dc0fb8e0-98b1-4bd5-b1c0-718c4cd03885 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 03 14:00:31.557770 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:00:31.557770 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 14:00:31.557770 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 14:00:31.557770 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 14:00:31.557770 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 14:00:31.557770 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 14:00:31.557770 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 14:00:31.557770 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 14:00:31.557770 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 14:00:31.557770 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 14:00:31.557770 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 14:00:31.557770 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 14:00:31.557770 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 14:00:31.557770 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 14:00:31.557770 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 14:00:31.558775 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 14:00:31.558775 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 14:00:31.558775 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 14:00:31.558775 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 14:00:31.558775 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 14:00:31.558775 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 14:00:31.558775 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 14:00:31.558775 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 14:00:31.558775 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 14:00:31.558775 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.get_or_create( May 03 14:00:31.558775 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 14:00:31.558775 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application with Lock( May 03 14:00:31.558775 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 14:00:31.558775 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._enter() May 03 14:00:31.558775 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 14:00:31.558775 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 14:00:31.558775 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 14:00:31.558775 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.creator() May 03 14:00:31.559890 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 14:00:31.559890 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application created_value = creator( May 03 14:00:31.559890 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 14:00:31.559890 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 14:00:31.559890 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 14:00:31.559890 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 14:00:31.559890 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 14:00:31.559890 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 14:00:31.559890 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 03 14:00:31.559890 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application May 03 14:00:31.562547 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 407/839] 10.222.0.36 () {56 vars in 1096 bytes} [Tue May 3 14:00:31 2022] GET /identity/v3/users/swift => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 14:00:31.570393 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bf11c9-26bd-43cf-9d19-51d64ee79390 None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:31.641730 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f76788-c930-416c-9762-efcc4ac39505 None None] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:31.642260 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f76788-c930-416c-9762-efcc4ac39505 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:31.642260 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f76788-c930-416c-9762-efcc4ac39505 None None] PATH_INFO: `/` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:31.643936 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 408/840] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 3 14:00:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 14:00:31.649172 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3615aa-bbaf-486b-96a6-8941c6170bde None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:31.649499 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3615aa-bbaf-486b-96a6-8941c6170bde None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:31.649777 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3615aa-bbaf-486b-96a6-8941c6170bde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:31.669936 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-2f3615aa-bbaf-486b-96a6-8941c6170bde None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:00:31.671141 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-2f3615aa-bbaf-486b-96a6-8941c6170bde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:00:31.681885 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bf11c9-26bd-43cf-9d19-51d64ee79390 None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:31.722615 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a898fd-49e4-4289-984e-dc4936f3b074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:31.723281 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a898fd-49e4-4289-984e-dc4936f3b074 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:31.723558 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a898fd-49e4-4289-984e-dc4936f3b074 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:31.723829 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a898fd-49e4-4289-984e-dc4936f3b074 None admin] PATH_INFO: `/v3/users` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:31.724655 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a898fd-49e4-4289-984e-dc4936f3b074 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:00:31.724956 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a898fd-49e4-4289-984e-dc4936f3b074 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:31.726421 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a898fd-49e4-4289-984e-dc4936f3b074 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:31.752622 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 433/841] 10.222.0.36 () {56 vars in 1135 bytes} [Tue May 3 14:00:31 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:00:31.753716 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a898fd-49e4-4289-984e-dc4936f3b074 None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:31.760956 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 409/842] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 3 14:00:31 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 14:00:31.783030 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3615aa-bbaf-486b-96a6-8941c6170bde None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:31.851943 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a898fd-49e4-4289-984e-dc4936f3b074 None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:31.883613 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3615aa-bbaf-486b-96a6-8941c6170bde None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:31.885839 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d3ecf9-f4cf-4c18-b8f5-e5205315ead7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:31.886485 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d3ecf9-f4cf-4c18-b8f5-e5205315ead7 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:31.886761 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d3ecf9-f4cf-4c18-b8f5-e5205315ead7 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:31.887220 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d3ecf9-f4cf-4c18-b8f5-e5205315ead7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:31.920211 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a333973-32ff-46f1-8d92-a3f366ac97d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:31.921025 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a333973-32ff-46f1-8d92-a3f366ac97d5 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:31.921326 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a333973-32ff-46f1-8d92-a3f366ac97d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:31.921605 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a333973-32ff-46f1-8d92-a3f366ac97d5 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:31.922260 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a333973-32ff-46f1-8d92-a3f366ac97d5 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:31.923632 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a333973-32ff-46f1-8d92-a3f366ac97d5 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:31.935791 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application [None req-3a333973-32ff-46f1-8d92-a3f366ac97d5 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 03 14:00:31.935791 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:00:31.935791 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 03 14:00:31.935791 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 03 14:00:31.935791 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 03 14:00:31.935791 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 03 14:00:31.935791 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 03 14:00:31.935791 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 14:00:31.935791 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 03 14:00:31.935791 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application May 03 14:00:31.935791 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 03 14:00:31.935791 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application May 03 14:00:31.935791 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:00:31.935791 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 14:00:31.935791 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 14:00:31.935791 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 14:00:31.935791 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 14:00:31.936836 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 14:00:31.936836 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 14:00:31.936836 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 14:00:31.936836 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 14:00:31.936836 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 14:00:31.936836 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 14:00:31.936836 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 03 14:00:31.936836 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._get_service(service_id) May 03 14:00:31.936836 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 03 14:00:31.936836 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 03 14:00:31.936836 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 14:00:31.936836 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 14:00:31.936836 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 14:00:31.936836 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 14:00:31.936836 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 14:00:31.936836 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.get_or_create( May 03 14:00:31.938125 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 14:00:31.938125 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application with Lock( May 03 14:00:31.938125 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 14:00:31.938125 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._enter() May 03 14:00:31.938125 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 14:00:31.938125 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 14:00:31.938125 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 14:00:31.938125 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.creator() May 03 14:00:31.938125 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 14:00:31.938125 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application created_value = creator( May 03 14:00:31.938125 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 03 14:00:31.938125 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 14:00:31.938125 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 03 14:00:31.938125 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application May 03 14:00:31.938125 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 410/843] 10.222.0.36 () {56 vars in 1114 bytes} [Tue May 3 14:00:31 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 14:00:31.938945 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8334c65-106f-4981-aa42-e1cc9eef8af4 None None] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:31.938945 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8334c65-106f-4981-aa42-e1cc9eef8af4 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:31.938945 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8334c65-106f-4981-aa42-e1cc9eef8af4 None None] PATH_INFO: `/` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:31.940246 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 411/844] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 3 14:00:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 14:00:31.945037 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8334c65-106f-4981-aa42-e1cc9eef8af4 None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:31.962446 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d3ecf9-f4cf-4c18-b8f5-e5205315ead7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:31.964207 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d3ecf9-f4cf-4c18-b8f5-e5205315ead7 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:32.051388 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8334c65-106f-4981-aa42-e1cc9eef8af4 None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:32.072010 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 434/845] 10.222.0.36 () {58 vars in 1282 bytes} [Tue May 3 14:00:31 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 03 14:00:32.072010 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bbe14c-bdbb-4a37-b52c-bf4d73e29851 None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:32.072010 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bbe14c-bdbb-4a37-b52c-bf4d73e29851 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:32.072010 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bbe14c-bdbb-4a37-b52c-bf4d73e29851 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:32.085038 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-38bbe14c-bdbb-4a37-b52c-bf4d73e29851 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:00:32.086222 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-38bbe14c-bdbb-4a37-b52c-bf4d73e29851 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:00:32.092373 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa9c09e-d45b-490f-aa80-8ae3da860569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:32.093041 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa9c09e-d45b-490f-aa80-8ae3da860569 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:32.093345 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa9c09e-d45b-490f-aa80-8ae3da860569 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:32.093627 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa9c09e-d45b-490f-aa80-8ae3da860569 None admin] PATH_INFO: `/v3/services` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:32.094326 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa9c09e-d45b-490f-aa80-8ae3da860569 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80012) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:00:32.094631 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa9c09e-d45b-490f-aa80-8ae3da860569 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:32.096010 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa9c09e-d45b-490f-aa80-8ae3da860569 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:32.104807 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 412/846] 10.222.0.36 () {56 vars in 1114 bytes} [Tue May 3 14:00:31 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:00:32.104807 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa9c09e-d45b-490f-aa80-8ae3da860569 None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:32.165316 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 435/847] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 3 14:00:32 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 14:00:32.165316 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bbe14c-bdbb-4a37-b52c-bf4d73e29851 None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:32.210352 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa9c09e-d45b-490f-aa80-8ae3da860569 None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:32.244106 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead745f6-f0fe-4b5e-8dfc-a9a2c80683d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:32.244905 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead745f6-f0fe-4b5e-8dfc-a9a2c80683d1 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:32.245181 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead745f6-f0fe-4b5e-8dfc-a9a2c80683d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:32.245473 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead745f6-f0fe-4b5e-8dfc-a9a2c80683d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:32.256080 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead745f6-f0fe-4b5e-8dfc-a9a2c80683d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:32.256265 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bbe14c-bdbb-4a37-b52c-bf4d73e29851 None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:32.257559 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead745f6-f0fe-4b5e-8dfc-a9a2c80683d1 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:32.274609 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application [None req-ead745f6-f0fe-4b5e-8dfc-a9a2c80683d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 14:00:32.274609 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:00:32.274609 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 14:00:32.274609 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 14:00:32.274609 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 14:00:32.274609 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 14:00:32.274609 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 14:00:32.274609 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 14:00:32.274609 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 14:00:32.274609 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 14:00:32.274609 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 14:00:32.274609 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 14:00:32.274609 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 14:00:32.274609 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 14:00:32.274609 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 14:00:32.275591 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 14:00:32.275591 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 14:00:32.275591 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 14:00:32.275591 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 14:00:32.275591 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 14:00:32.275591 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 14:00:32.275591 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.get_or_create( May 03 14:00:32.275591 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 14:00:32.275591 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application with Lock( May 03 14:00:32.275591 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 14:00:32.275591 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._enter() May 03 14:00:32.275591 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 14:00:32.275591 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 14:00:32.275591 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 14:00:32.275591 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.creator() May 03 14:00:32.275591 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 14:00:32.275591 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application created_value = creator( May 03 14:00:32.276509 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 14:00:32.276509 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 14:00:32.276509 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 14:00:32.276509 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application May 03 14:00:32.276509 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 413/848] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 3 14:00:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 14:00:32.277741 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead745f6-f0fe-4b5e-8dfc-a9a2c80683d1 None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:32.291955 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88a1fc7-279c-43c4-a71f-b73ab74a14b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:32.292612 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88a1fc7-279c-43c4-a71f-b73ab74a14b0 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:32.292894 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88a1fc7-279c-43c4-a71f-b73ab74a14b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:32.293165 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88a1fc7-279c-43c4-a71f-b73ab74a14b0 None admin] PATH_INFO: `/v3/services` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:32.293953 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88a1fc7-279c-43c4-a71f-b73ab74a14b0 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:00:32.294241 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88a1fc7-279c-43c4-a71f-b73ab74a14b0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:32.295601 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88a1fc7-279c-43c4-a71f-b73ab74a14b0 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:32.305403 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 436/849] 10.222.0.36 () {56 vars in 1114 bytes} [Tue May 3 14:00:32 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:00:32.305403 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88a1fc7-279c-43c4-a71f-b73ab74a14b0 None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:32.400470 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead745f6-f0fe-4b5e-8dfc-a9a2c80683d1 None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:32.420603 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88a1fc7-279c-43c4-a71f-b73ab74a14b0 None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:32.436403 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e38c0a-d0ae-4179-823a-0edabd02faea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:32.437402 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e38c0a-d0ae-4179-823a-0edabd02faea None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:32.437814 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e38c0a-d0ae-4179-823a-0edabd02faea None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:32.438184 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e38c0a-d0ae-4179-823a-0edabd02faea None admin] PATH_INFO: `/v3/roles/service` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:32.451961 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e38c0a-d0ae-4179-823a-0edabd02faea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 14:00:32.460234 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application [None req-36e38c0a-d0ae-4179-823a-0edabd02faea None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 03 14:00:32.460234 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:00:32.460234 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 14:00:32.460234 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 14:00:32.460234 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 14:00:32.460234 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 14:00:32.460234 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 14:00:32.460234 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 14:00:32.460234 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 14:00:32.460234 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 14:00:32.460234 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 14:00:32.460234 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 14:00:32.460234 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 14:00:32.460234 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 14:00:32.460234 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 14:00:32.460234 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 14:00:32.461450 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 14:00:32.461450 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 14:00:32.461450 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 14:00:32.461450 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 14:00:32.461450 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 14:00:32.461450 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 14:00:32.461450 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 14:00:32.461450 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 14:00:32.461450 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 14:00:32.461450 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.get_or_create( May 03 14:00:32.461450 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 14:00:32.461450 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application with Lock( May 03 14:00:32.461450 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 14:00:32.461450 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._enter() May 03 14:00:32.461450 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 14:00:32.461450 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 14:00:32.462319 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 14:00:32.462319 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.creator() May 03 14:00:32.462319 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 14:00:32.462319 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application created_value = creator( May 03 14:00:32.462319 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 14:00:32.462319 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 14:00:32.462319 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 14:00:32.462319 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 14:00:32.462319 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 14:00:32.462319 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 14:00:32.462319 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 03 14:00:32.462319 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application May 03 14:00:32.462978 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 414/850] 10.222.0.36 () {56 vars in 1102 bytes} [Tue May 3 14:00:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 14:00:32.464335 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaa4407-2b26-465a-ac7e-e0b2208e140f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:32.465089 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaa4407-2b26-465a-ac7e-e0b2208e140f None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:32.473339 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaa4407-2b26-465a-ac7e-e0b2208e140f None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:32.473339 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaa4407-2b26-465a-ac7e-e0b2208e140f None admin] PATH_INFO: `/v3/domains` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:32.473339 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efaa4407-2b26-465a-ac7e-e0b2208e140f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:00:32.473339 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efaa4407-2b26-465a-ac7e-e0b2208e140f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:32.473339 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efaa4407-2b26-465a-ac7e-e0b2208e140f None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:32.473821 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e38c0a-d0ae-4179-823a-0edabd02faea None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:32.485409 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 437/851] 10.222.0.36 () {56 vars in 1109 bytes} [Tue May 3 14:00:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:00:32.490426 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaa4407-2b26-465a-ac7e-e0b2208e140f None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:32.594593 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e38c0a-d0ae-4179-823a-0edabd02faea None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:32.602453 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaa4407-2b26-465a-ac7e-e0b2208e140f None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:32.634490 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b99c668-0b18-4535-bea2-67d5c1a5e865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:32.635162 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62527781-4109-4e56-96c5-960f543fd02f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:32.635305 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b99c668-0b18-4535-bea2-67d5c1a5e865 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:32.635520 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b99c668-0b18-4535-bea2-67d5c1a5e865 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:32.635763 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b99c668-0b18-4535-bea2-67d5c1a5e865 None admin] PATH_INFO: `/v3/roles` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:32.635967 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62527781-4109-4e56-96c5-960f543fd02f None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:32.636235 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62527781-4109-4e56-96c5-960f543fd02f None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:32.636477 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b99c668-0b18-4535-bea2-67d5c1a5e865 None admin] RBAC: Adding query filter params (name=service) {{(pid=80012) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:00:32.636595 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62527781-4109-4e56-96c5-960f543fd02f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:32.636779 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b99c668-0b18-4535-bea2-67d5c1a5e865 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:32.638519 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b99c668-0b18-4535-bea2-67d5c1a5e865 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:32.644287 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62527781-4109-4e56-96c5-960f543fd02f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:32.646016 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62527781-4109-4e56-96c5-960f543fd02f None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:32.652869 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 415/852] 10.222.0.36 () {56 vars in 1103 bytes} [Tue May 3 14:00:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:00:32.652869 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c6d5c2-61d4-447b-8a9a-9a2e0159bbf2 None None] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:32.652869 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c6d5c2-61d4-447b-8a9a-9a2e0159bbf2 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:32.652869 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c6d5c2-61d4-447b-8a9a-9a2e0159bbf2 None None] PATH_INFO: `/` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:32.652869 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 416/853] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 3 14:00:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 14:00:32.656238 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c6d5c2-61d4-447b-8a9a-9a2e0159bbf2 None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:32.663962 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application [None req-62527781-4109-4e56-96c5-960f543fd02f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 14:00:32.663962 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:00:32.663962 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 14:00:32.663962 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 14:00:32.663962 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 14:00:32.663962 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 14:00:32.663962 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 14:00:32.663962 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 14:00:32.663962 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 14:00:32.663962 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 14:00:32.663962 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 14:00:32.663962 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 14:00:32.663962 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 14:00:32.663962 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 14:00:32.663962 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 14:00:32.664894 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 14:00:32.664894 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 14:00:32.664894 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 14:00:32.664894 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 14:00:32.664894 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 14:00:32.664894 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 14:00:32.664894 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.get_or_create( May 03 14:00:32.664894 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 14:00:32.664894 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application with Lock( May 03 14:00:32.664894 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 14:00:32.664894 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._enter() May 03 14:00:32.664894 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 14:00:32.664894 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 14:00:32.664894 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 14:00:32.664894 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.creator() May 03 14:00:32.664894 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 14:00:32.664894 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application created_value = creator( May 03 14:00:32.666179 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 14:00:32.666179 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 14:00:32.666179 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 14:00:32.666179 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 14:00:32.666179 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 14:00:32.666179 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 14:00:32.666179 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 14:00:32.666179 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application May 03 14:00:32.666179 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 438/854] 10.222.0.36 () {56 vars in 1111 bytes} [Tue May 3 14:00:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 14:00:32.666956 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd48f14b-e48f-4b68-bfbf-73e2858c2d56 None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:32.667055 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd48f14b-e48f-4b68-bfbf-73e2858c2d56 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:32.667316 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd48f14b-e48f-4b68-bfbf-73e2858c2d56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:32.685133 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-dd48f14b-e48f-4b68-bfbf-73e2858c2d56 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:00:32.686365 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-dd48f14b-e48f-4b68-bfbf-73e2858c2d56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:00:32.750490 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 439/855] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 3 14:00:32 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 14:00:32.751417 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd48f14b-e48f-4b68-bfbf-73e2858c2d56 None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:32.758604 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c6d5c2-61d4-447b-8a9a-9a2e0159bbf2 None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:32.793584 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e8c63b-53f6-42ca-93b9-e0bad6e1df07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:32.794746 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e8c63b-53f6-42ca-93b9-e0bad6e1df07 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:32.795021 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e8c63b-53f6-42ca-93b9-e0bad6e1df07 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:32.795287 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e8c63b-53f6-42ca-93b9-e0bad6e1df07 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:32.805668 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e8c63b-53f6-42ca-93b9-e0bad6e1df07 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:32.807100 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e8c63b-53f6-42ca-93b9-e0bad6e1df07 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:32.823645 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application [None req-90e8c63b-53f6-42ca-93b9-e0bad6e1df07 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 14:00:32.823645 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:00:32.823645 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 14:00:32.823645 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 14:00:32.823645 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 14:00:32.823645 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 14:00:32.823645 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 14:00:32.823645 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 14:00:32.823645 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 14:00:32.823645 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 14:00:32.823645 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 14:00:32.823645 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 14:00:32.823645 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 14:00:32.823645 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 14:00:32.823645 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 14:00:32.824596 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 14:00:32.824596 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 14:00:32.824596 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 14:00:32.824596 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 14:00:32.824596 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 14:00:32.824596 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 14:00:32.824596 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.get_or_create( May 03 14:00:32.824596 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 14:00:32.824596 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application with Lock( May 03 14:00:32.824596 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 14:00:32.824596 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._enter() May 03 14:00:32.824596 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 14:00:32.824596 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 14:00:32.824596 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 14:00:32.824596 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.creator() May 03 14:00:32.824596 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 14:00:32.824596 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application created_value = creator( May 03 14:00:32.825783 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 14:00:32.825783 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 14:00:32.825783 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 14:00:32.825783 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application May 03 14:00:32.825783 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 417/856] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 3 14:00:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 14:00:32.826533 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e8c63b-53f6-42ca-93b9-e0bad6e1df07 None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:32.866033 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd48f14b-e48f-4b68-bfbf-73e2858c2d56 None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:32.900548 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e08a35d-9d23-4c7f-9677-6979464d471a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:32.901215 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e08a35d-9d23-4c7f-9677-6979464d471a None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:32.901525 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e08a35d-9d23-4c7f-9677-6979464d471a None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:32.901806 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e08a35d-9d23-4c7f-9677-6979464d471a None admin] PATH_INFO: `/v3/projects` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:32.902589 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e08a35d-9d23-4c7f-9677-6979464d471a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:00:32.902898 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e08a35d-9d23-4c7f-9677-6979464d471a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:32.904463 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e08a35d-9d23-4c7f-9677-6979464d471a None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:32.921076 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 440/857] 10.222.0.36 () {56 vars in 1148 bytes} [Tue May 3 14:00:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:00:32.921076 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e08a35d-9d23-4c7f-9677-6979464d471a None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:32.933430 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e8c63b-53f6-42ca-93b9-e0bad6e1df07 None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:32.967085 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d42e485-8876-4073-8ed7-a0152ea4c0d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:32.967940 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d42e485-8876-4073-8ed7-a0152ea4c0d0 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:32.968221 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d42e485-8876-4073-8ed7-a0152ea4c0d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:32.968492 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d42e485-8876-4073-8ed7-a0152ea4c0d0 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:32.969141 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d42e485-8876-4073-8ed7-a0152ea4c0d0 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:32.970534 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d42e485-8876-4073-8ed7-a0152ea4c0d0 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:32.982720 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application [None req-0d42e485-8876-4073-8ed7-a0152ea4c0d0 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 03 14:00:32.982720 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:00:32.982720 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 03 14:00:32.982720 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 03 14:00:32.982720 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 03 14:00:32.982720 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 03 14:00:32.982720 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 03 14:00:32.982720 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 14:00:32.982720 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 03 14:00:32.982720 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application May 03 14:00:32.982720 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 03 14:00:32.982720 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application May 03 14:00:32.982720 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:00:32.982720 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 14:00:32.982720 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 14:00:32.982720 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 14:00:32.983725 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 14:00:32.983725 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 14:00:32.983725 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 14:00:32.983725 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 14:00:32.983725 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 14:00:32.983725 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 14:00:32.983725 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 14:00:32.983725 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 03 14:00:32.983725 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._get_service(service_id) May 03 14:00:32.983725 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 03 14:00:32.983725 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 03 14:00:32.983725 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 14:00:32.983725 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 14:00:32.983725 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 14:00:32.983725 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 14:00:32.983725 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 14:00:32.984597 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.get_or_create( May 03 14:00:32.984597 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 14:00:32.984597 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application with Lock( May 03 14:00:32.984597 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 14:00:32.984597 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._enter() May 03 14:00:32.984597 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 14:00:32.984597 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 14:00:32.984597 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 14:00:32.984597 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.creator() May 03 14:00:32.984597 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 14:00:32.984597 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application created_value = creator( May 03 14:00:32.984597 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 03 14:00:32.984597 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 14:00:32.984597 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 03 14:00:32.984597 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application May 03 14:00:32.984597 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 418/858] 10.222.0.36 () {56 vars in 1132 bytes} [Tue May 3 14:00:32 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 14:00:32.985539 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d42e485-8876-4073-8ed7-a0152ea4c0d0 None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:33.021504 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e08a35d-9d23-4c7f-9677-6979464d471a None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:33.054182 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc538ae8-53f6-4704-a268-f37a9d313f40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:33.054966 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc538ae8-53f6-4704-a268-f37a9d313f40 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:33.055312 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc538ae8-53f6-4704-a268-f37a9d313f40 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:33.055646 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc538ae8-53f6-4704-a268-f37a9d313f40 None admin] PATH_INFO: `/v3/domains` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:33.056373 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc538ae8-53f6-4704-a268-f37a9d313f40 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:00:33.056687 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc538ae8-53f6-4704-a268-f37a9d313f40 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:33.058061 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc538ae8-53f6-4704-a268-f37a9d313f40 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:33.070078 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 441/859] 10.222.0.36 () {56 vars in 1109 bytes} [Tue May 3 14:00:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:00:33.070902 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc538ae8-53f6-4704-a268-f37a9d313f40 None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:33.093533 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d42e485-8876-4073-8ed7-a0152ea4c0d0 None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:33.125865 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4339e7c1-b5fd-408e-8488-6b36d064fe97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:33.126451 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4339e7c1-b5fd-408e-8488-6b36d064fe97 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:33.126720 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4339e7c1-b5fd-408e-8488-6b36d064fe97 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:33.126990 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4339e7c1-b5fd-408e-8488-6b36d064fe97 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:33.127803 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4339e7c1-b5fd-408e-8488-6b36d064fe97 None admin] RBAC: Adding query filter params (role.id=36abe9b50fd8479c86c4f8f70fd85aa3, scope.project.id=de541be478754087934323bdbe41a579, user.id=e1180e29180d44418390cf22d3e0bd6f) {{(pid=80012) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:00:33.128108 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4339e7c1-b5fd-408e-8488-6b36d064fe97 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:33.129545 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4339e7c1-b5fd-408e-8488-6b36d064fe97 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:33.138034 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 419/860] 10.222.0.36 () {56 vars in 1374 bytes} [Tue May 3 14:00:32 2022] GET /identity/v3/role_assignments?user.id=e1180e29180d44418390cf22d3e0bd6f&scope.project.id=de541be478754087934323bdbe41a579&role.id=36abe9b50fd8479c86c4f8f70fd85aa3 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:00:33.138034 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4339e7c1-b5fd-408e-8488-6b36d064fe97 None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:33.168923 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc538ae8-53f6-4704-a268-f37a9d313f40 None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:33.206955 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a66384-3eee-4eba-859d-486db6513ca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:33.207651 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a66384-3eee-4eba-859d-486db6513ca0 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:33.207934 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a66384-3eee-4eba-859d-486db6513ca0 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:33.208214 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a66384-3eee-4eba-859d-486db6513ca0 None admin] PATH_INFO: `/v3/services` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:33.208946 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a66384-3eee-4eba-859d-486db6513ca0 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:00:33.209258 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a66384-3eee-4eba-859d-486db6513ca0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:33.210731 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a66384-3eee-4eba-859d-486db6513ca0 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:33.216813 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 442/861] 10.222.0.36 () {56 vars in 1126 bytes} [Tue May 3 14:00:33 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:00:33.222382 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a66384-3eee-4eba-859d-486db6513ca0 None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:33.268254 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4339e7c1-b5fd-408e-8488-6b36d064fe97 None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:33.302528 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51338f1-8198-4c8d-a541-35c2ef0f6126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:33.303359 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51338f1-8198-4c8d-a541-35c2ef0f6126 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:33.303633 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51338f1-8198-4c8d-a541-35c2ef0f6126 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:33.303902 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51338f1-8198-4c8d-a541-35c2ef0f6126 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:33.312415 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51338f1-8198-4c8d-a541-35c2ef0f6126 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:33.313930 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51338f1-8198-4c8d-a541-35c2ef0f6126 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:33.329518 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application [None req-c51338f1-8198-4c8d-a541-35c2ef0f6126 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 03 14:00:33.329518 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:00:33.329518 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 14:00:33.329518 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 14:00:33.329518 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 14:00:33.329518 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 14:00:33.329518 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 14:00:33.329518 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 14:00:33.329518 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 14:00:33.329518 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 14:00:33.329518 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 14:00:33.329518 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 14:00:33.329518 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 14:00:33.329518 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 14:00:33.329518 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 14:00:33.329518 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 14:00:33.331902 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 14:00:33.331902 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 14:00:33.331902 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 14:00:33.331902 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 14:00:33.331902 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 14:00:33.331902 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 14:00:33.331902 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 14:00:33.331902 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 14:00:33.331902 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 14:00:33.331902 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.get_or_create( May 03 14:00:33.331902 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 14:00:33.331902 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application with Lock( May 03 14:00:33.331902 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 14:00:33.331902 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._enter() May 03 14:00:33.331902 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 14:00:33.331902 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 14:00:33.331902 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 14:00:33.331902 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.creator() May 03 14:00:33.333560 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 14:00:33.333560 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application created_value = creator( May 03 14:00:33.333560 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 14:00:33.333560 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 14:00:33.333560 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 14:00:33.333560 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 14:00:33.333560 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 14:00:33.333560 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 14:00:33.333560 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 03 14:00:33.333560 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application May 03 14:00:33.333560 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 420/862] 10.222.0.36 () {56 vars in 1117 bytes} [Tue May 3 14:00:33 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 14:00:33.341323 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51338f1-8198-4c8d-a541-35c2ef0f6126 None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:33.341701 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a66384-3eee-4eba-859d-486db6513ca0 None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:33.383208 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08471dba-491c-478d-8abf-20d5b2366797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:33.383797 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08471dba-491c-478d-8abf-20d5b2366797 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:33.384072 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08471dba-491c-478d-8abf-20d5b2366797 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:33.384337 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08471dba-491c-478d-8abf-20d5b2366797 None admin] PATH_INFO: `/v3/services` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:33.385041 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08471dba-491c-478d-8abf-20d5b2366797 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:00:33.385602 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08471dba-491c-478d-8abf-20d5b2366797 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:33.386732 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08471dba-491c-478d-8abf-20d5b2366797 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:33.392496 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 443/863] 10.222.0.36 () {56 vars in 1126 bytes} [Tue May 3 14:00:33 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:00:33.448251 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51338f1-8198-4c8d-a541-35c2ef0f6126 None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:33.487404 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974211ab-dd6e-4ae5-81fa-39f1ef68db24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:33.488144 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974211ab-dd6e-4ae5-81fa-39f1ef68db24 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:33.488457 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974211ab-dd6e-4ae5-81fa-39f1ef68db24 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:33.488735 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974211ab-dd6e-4ae5-81fa-39f1ef68db24 None admin] PATH_INFO: `/v3/users` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:33.489635 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974211ab-dd6e-4ae5-81fa-39f1ef68db24 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80012) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:00:33.489935 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974211ab-dd6e-4ae5-81fa-39f1ef68db24 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:33.491386 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974211ab-dd6e-4ae5-81fa-39f1ef68db24 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:33.511760 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 421/864] 10.222.0.36 () {56 vars in 1149 bytes} [Tue May 3 14:00:33 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:00:33.518352 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08471dba-491c-478d-8abf-20d5b2366797 None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:33.630426 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08471dba-491c-478d-8abf-20d5b2366797 None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:33.664121 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25509d7d-f249-4bcb-9dc6-348f08ea76dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:33.664688 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25509d7d-f249-4bcb-9dc6-348f08ea76dd None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:33.664963 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25509d7d-f249-4bcb-9dc6-348f08ea76dd None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:33.665233 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25509d7d-f249-4bcb-9dc6-348f08ea76dd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:33.731757 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25509d7d-f249-4bcb-9dc6-348f08ea76dd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:33.733197 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25509d7d-f249-4bcb-9dc6-348f08ea76dd None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:33.829244 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 444/865] 10.222.0.36 () {58 vars in 1282 bytes} [Tue May 3 14:00:33 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 03 14:00:33.834841 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974211ab-dd6e-4ae5-81fa-39f1ef68db24 None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:33.935834 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974211ab-dd6e-4ae5-81fa-39f1ef68db24 None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:33.970308 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c90fa7f-32b7-4fb3-aa6d-0829c0fce650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:33.971532 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c90fa7f-32b7-4fb3-aa6d-0829c0fce650 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:33.972013 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c90fa7f-32b7-4fb3-aa6d-0829c0fce650 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:33.972483 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c90fa7f-32b7-4fb3-aa6d-0829c0fce650 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:33.983057 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c90fa7f-32b7-4fb3-aa6d-0829c0fce650 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:33.984773 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c90fa7f-32b7-4fb3-aa6d-0829c0fce650 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:34.002538 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application [None req-4c90fa7f-32b7-4fb3-aa6d-0829c0fce650 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 14:00:34.002538 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:00:34.002538 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 14:00:34.002538 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 14:00:34.002538 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 14:00:34.002538 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 14:00:34.002538 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 14:00:34.002538 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 14:00:34.002538 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 14:00:34.002538 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 14:00:34.002538 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 14:00:34.002538 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 14:00:34.002538 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 14:00:34.002538 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 14:00:34.002538 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 14:00:34.003496 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 14:00:34.003496 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 14:00:34.003496 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 14:00:34.003496 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 14:00:34.003496 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 14:00:34.003496 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 14:00:34.003496 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.get_or_create( May 03 14:00:34.003496 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 14:00:34.003496 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application with Lock( May 03 14:00:34.003496 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 14:00:34.003496 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._enter() May 03 14:00:34.003496 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 14:00:34.003496 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 14:00:34.003496 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 14:00:34.003496 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.creator() May 03 14:00:34.003496 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 14:00:34.003496 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application created_value = creator( May 03 14:00:34.004446 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 14:00:34.004446 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 14:00:34.004446 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 14:00:34.004446 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application May 03 14:00:34.006702 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 422/866] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 3 14:00:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 14:00:34.012616 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25509d7d-f249-4bcb-9dc6-348f08ea76dd None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:34.118716 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25509d7d-f249-4bcb-9dc6-348f08ea76dd None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:34.151427 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f91bb43-5f03-4338-b9f7-086053d36195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:34.152094 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f91bb43-5f03-4338-b9f7-086053d36195 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:34.152373 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f91bb43-5f03-4338-b9f7-086053d36195 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:34.152646 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f91bb43-5f03-4338-b9f7-086053d36195 None admin] PATH_INFO: `/v3/domains` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:34.153423 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f91bb43-5f03-4338-b9f7-086053d36195 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:00:34.153729 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f91bb43-5f03-4338-b9f7-086053d36195 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:34.155099 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f91bb43-5f03-4338-b9f7-086053d36195 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:34.166653 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 445/867] 10.222.0.36 () {56 vars in 1109 bytes} [Tue May 3 14:00:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:00:34.172184 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c90fa7f-32b7-4fb3-aa6d-0829c0fce650 None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:34.274334 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c90fa7f-32b7-4fb3-aa6d-0829c0fce650 None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:34.308486 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26939a47-e3ca-4406-a328-c228278c2611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:34.309798 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26939a47-e3ca-4406-a328-c228278c2611 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:34.310315 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26939a47-e3ca-4406-a328-c228278c2611 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:34.310811 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26939a47-e3ca-4406-a328-c228278c2611 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:34.317990 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26939a47-e3ca-4406-a328-c228278c2611 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:34.319669 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26939a47-e3ca-4406-a328-c228278c2611 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:34.333938 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application [None req-26939a47-e3ca-4406-a328-c228278c2611 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 14:00:34.333938 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:00:34.333938 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 14:00:34.333938 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 14:00:34.333938 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 14:00:34.333938 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 14:00:34.333938 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 14:00:34.333938 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 14:00:34.333938 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 14:00:34.333938 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 14:00:34.333938 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 14:00:34.333938 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 14:00:34.333938 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 14:00:34.333938 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 14:00:34.333938 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 14:00:34.334920 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 14:00:34.334920 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 14:00:34.334920 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 14:00:34.334920 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 14:00:34.334920 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 14:00:34.334920 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 14:00:34.334920 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.get_or_create( May 03 14:00:34.334920 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 14:00:34.334920 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application with Lock( May 03 14:00:34.334920 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 14:00:34.334920 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._enter() May 03 14:00:34.334920 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 14:00:34.334920 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 14:00:34.334920 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 14:00:34.334920 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.creator() May 03 14:00:34.334920 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 14:00:34.334920 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application created_value = creator( May 03 14:00:34.335854 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 14:00:34.335854 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 14:00:34.335854 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 14:00:34.335854 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 14:00:34.335854 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 14:00:34.335854 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 14:00:34.335854 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 14:00:34.335854 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application May 03 14:00:34.338371 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 423/868] 10.222.0.36 () {56 vars in 1111 bytes} [Tue May 3 14:00:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 14:00:34.344825 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f91bb43-5f03-4338-b9f7-086053d36195 None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:34.449720 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f91bb43-5f03-4338-b9f7-086053d36195 None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:34.486118 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dd1694-2a6d-404d-9cec-fc66da6799ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:34.486776 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dd1694-2a6d-404d-9cec-fc66da6799ad None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:34.487052 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dd1694-2a6d-404d-9cec-fc66da6799ad None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:34.487323 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dd1694-2a6d-404d-9cec-fc66da6799ad None admin] PATH_INFO: `/v3/projects` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:34.488100 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dd1694-2a6d-404d-9cec-fc66da6799ad None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:00:34.488401 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dd1694-2a6d-404d-9cec-fc66da6799ad None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:34.489874 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dd1694-2a6d-404d-9cec-fc66da6799ad None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:34.502314 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 446/869] 10.222.0.36 () {56 vars in 1148 bytes} [Tue May 3 14:00:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:00:34.508186 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26939a47-e3ca-4406-a328-c228278c2611 None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:34.609557 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26939a47-e3ca-4406-a328-c228278c2611 None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:34.625082 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd700ce8-3abe-4152-84da-7bc76019f2ba None None] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:34.625389 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd700ce8-3abe-4152-84da-7bc76019f2ba None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:34.625668 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd700ce8-3abe-4152-84da-7bc76019f2ba None None] PATH_INFO: `/` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:34.627234 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 447/870] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 3 14:00:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 14:00:34.632037 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4932a9-0893-4711-b081-128f00a7efa5 None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:34.632318 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4932a9-0893-4711-b081-128f00a7efa5 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:34.632594 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4932a9-0893-4711-b081-128f00a7efa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:34.644927 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af163a2-2fa2-4a6f-a253-dc0d53461b14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:34.646177 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af163a2-2fa2-4a6f-a253-dc0d53461b14 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:34.646665 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af163a2-2fa2-4a6f-a253-dc0d53461b14 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:34.647178 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af163a2-2fa2-4a6f-a253-dc0d53461b14 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:34.648355 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af163a2-2fa2-4a6f-a253-dc0d53461b14 None admin] RBAC: Adding query filter params (role.id=b3902525744e454694820e2ea3b2e563, scope.project.id=de541be478754087934323bdbe41a579, user.id=dec39ff0b6544a738e5aae06e9a8cb38) {{(pid=80012) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:00:34.648889 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af163a2-2fa2-4a6f-a253-dc0d53461b14 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:34.649012 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-4c4932a9-0893-4711-b081-128f00a7efa5 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:00:34.650099 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-4c4932a9-0893-4711-b081-128f00a7efa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:00:34.650893 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af163a2-2fa2-4a6f-a253-dc0d53461b14 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:34.657822 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 424/871] 10.222.0.36 () {56 vars in 1374 bytes} [Tue May 3 14:00:34 2022] GET /identity/v3/role_assignments?user.id=dec39ff0b6544a738e5aae06e9a8cb38&scope.project.id=de541be478754087934323bdbe41a579&role.id=b3902525744e454694820e2ea3b2e563 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:00:34.722648 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 448/872] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 3 14:00:34 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 14:00:34.745042 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af163a2-2fa2-4a6f-a253-dc0d53461b14 None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:34.854816 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af163a2-2fa2-4a6f-a253-dc0d53461b14 None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:34.890543 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef65cbb-90a1-4f7c-935c-7af488c57689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:34.891510 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef65cbb-90a1-4f7c-935c-7af488c57689 None admin] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:34.891976 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef65cbb-90a1-4f7c-935c-7af488c57689 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:34.892510 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef65cbb-90a1-4f7c-935c-7af488c57689 None admin] PATH_INFO: `/v3/services` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:34.893468 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef65cbb-90a1-4f7c-935c-7af488c57689 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:34.895028 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef65cbb-90a1-4f7c-935c-7af488c57689 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:34.911591 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 425/873] 10.222.0.36 () {60 vars in 1141 bytes} [Tue May 3 14:00:34 2022] POST /identity/v3/services => generated 251 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 14:00:35.581455 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5096c902-1949-4fc9-abf5-7441cb5122a7 None None] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:35.582106 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5096c902-1949-4fc9-abf5-7441cb5122a7 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:35.582106 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5096c902-1949-4fc9-abf5-7441cb5122a7 None None] PATH_INFO: `/` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:35.583661 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 449/874] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 3 14:00:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 14:00:35.589455 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3329ce5-da44-4858-86a4-ecc93f74e954 None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:35.589749 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3329ce5-da44-4858-86a4-ecc93f74e954 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:35.590028 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3329ce5-da44-4858-86a4-ecc93f74e954 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:35.606871 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-a3329ce5-da44-4858-86a4-ecc93f74e954 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:00:35.608141 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-a3329ce5-da44-4858-86a4-ecc93f74e954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:00:35.681898 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 426/875] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 3 14:00:35 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 14:00:35.686869 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619943b7-b2de-446d-ab89-d8fcd6efc905 None None] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:35.687162 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619943b7-b2de-446d-ab89-d8fcd6efc905 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:35.687443 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619943b7-b2de-446d-ab89-d8fcd6efc905 None None] PATH_INFO: `/` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:35.689062 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 450/876] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 3 14:00:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 14:00:35.694292 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d61537-b7f4-41c6-99eb-004598234de0 None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:35.694768 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d61537-b7f4-41c6-99eb-004598234de0 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:35.695212 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d61537-b7f4-41c6-99eb-004598234de0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:35.705904 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619943b7-b2de-446d-ab89-d8fcd6efc905 None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:35.712528 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-e9d61537-b7f4-41c6-99eb-004598234de0 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:00:35.714245 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-e9d61537-b7f4-41c6-99eb-004598234de0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:00:35.785084 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 427/877] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 3 14:00:35 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 14:00:35.807772 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d61537-b7f4-41c6-99eb-004598234de0 None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:35.821074 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619943b7-b2de-446d-ab89-d8fcd6efc905 None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:35.869470 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172bd67d-628c-4234-a977-e79793f56eed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:35.870205 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172bd67d-628c-4234-a977-e79793f56eed None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:35.870632 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172bd67d-628c-4234-a977-e79793f56eed None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:35.870920 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172bd67d-628c-4234-a977-e79793f56eed None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:35.871578 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172bd67d-628c-4234-a977-e79793f56eed None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:35.873813 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172bd67d-628c-4234-a977-e79793f56eed None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:35.889327 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application [None req-172bd67d-628c-4234-a977-e79793f56eed None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 03 14:00:35.889327 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:00:35.889327 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 03 14:00:35.889327 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 03 14:00:35.889327 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 03 14:00:35.889327 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 03 14:00:35.889327 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 03 14:00:35.889327 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 14:00:35.889327 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 03 14:00:35.889327 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application May 03 14:00:35.889327 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 03 14:00:35.889327 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application May 03 14:00:35.889327 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:00:35.889327 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 14:00:35.889327 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 14:00:35.889327 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 14:00:35.889327 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 14:00:35.890558 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 14:00:35.890558 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 14:00:35.890558 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 14:00:35.890558 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 14:00:35.890558 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 14:00:35.890558 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 14:00:35.890558 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 03 14:00:35.890558 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._get_service(service_id) May 03 14:00:35.890558 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 03 14:00:35.890558 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 03 14:00:35.890558 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 14:00:35.890558 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 14:00:35.890558 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 14:00:35.890558 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 14:00:35.890558 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 14:00:35.890558 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.get_or_create( May 03 14:00:35.891516 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 14:00:35.891516 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application with Lock( May 03 14:00:35.891516 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 14:00:35.891516 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._enter() May 03 14:00:35.891516 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 14:00:35.891516 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 14:00:35.891516 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 14:00:35.891516 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.creator() May 03 14:00:35.891516 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 14:00:35.891516 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application created_value = creator( May 03 14:00:35.891516 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 03 14:00:35.891516 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 14:00:35.891516 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 03 14:00:35.891516 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application May 03 14:00:35.893377 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 451/878] 10.222.0.36 () {56 vars in 1126 bytes} [Tue May 3 14:00:35 2022] GET /identity/v3/services/object-store => generated 93 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 14:00:35.897079 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172bd67d-628c-4234-a977-e79793f56eed None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:35.910062 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d61537-b7f4-41c6-99eb-004598234de0 None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:35.958022 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0712281d-4637-4bb3-903f-e307ce75fb67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:35.958840 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0712281d-4637-4bb3-903f-e307ce75fb67 None admin] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:35.959217 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0712281d-4637-4bb3-903f-e307ce75fb67 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:35.959591 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0712281d-4637-4bb3-903f-e307ce75fb67 None admin] PATH_INFO: `/v3/services` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:35.960848 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0712281d-4637-4bb3-903f-e307ce75fb67 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:35.962642 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0712281d-4637-4bb3-903f-e307ce75fb67 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:35.985316 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 428/879] 10.222.0.36 () {60 vars in 1141 bytes} [Tue May 3 14:00:35 2022] POST /identity/v3/services => generated 269 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 14:00:36.024529 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172bd67d-628c-4234-a977-e79793f56eed None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:36.073612 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09497d51-5664-41ef-8eaa-7c29e536e4ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:36.074293 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09497d51-5664-41ef-8eaa-7c29e536e4ca None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:36.074576 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09497d51-5664-41ef-8eaa-7c29e536e4ca None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:36.075030 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09497d51-5664-41ef-8eaa-7c29e536e4ca None admin] PATH_INFO: `/v3/services` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:36.076087 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09497d51-5664-41ef-8eaa-7c29e536e4ca None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:00:36.076407 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09497d51-5664-41ef-8eaa-7c29e536e4ca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:36.077858 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09497d51-5664-41ef-8eaa-7c29e536e4ca None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:36.083814 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 452/880] 10.222.0.36 () {56 vars in 1122 bytes} [Tue May 3 14:00:35 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 14:00:36.090295 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0712281d-4637-4bb3-903f-e307ce75fb67 None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:36.199902 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0712281d-4637-4bb3-903f-e307ce75fb67 None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:36.235062 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b8c560-8b5a-48a1-a372-a92c5eb87171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:36.235740 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b8c560-8b5a-48a1-a372-a92c5eb87171 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:36.236021 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b8c560-8b5a-48a1-a372-a92c5eb87171 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:36.236296 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b8c560-8b5a-48a1-a372-a92c5eb87171 None admin] PATH_INFO: `/v3/services` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:36.237007 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b8c560-8b5a-48a1-a372-a92c5eb87171 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80012) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:00:36.237356 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b8c560-8b5a-48a1-a372-a92c5eb87171 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:36.238713 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b8c560-8b5a-48a1-a372-a92c5eb87171 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:36.243485 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 429/881] 10.222.0.36 () {56 vars in 1122 bytes} [Tue May 3 14:00:36 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:00:37.056613 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bf1d28-9a2a-45f0-a7df-1b1e6f4a92ac None None] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:37.057172 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bf1d28-9a2a-45f0-a7df-1b1e6f4a92ac None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:37.057172 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bf1d28-9a2a-45f0-a7df-1b1e6f4a92ac None None] PATH_INFO: `/` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:37.058766 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 453/882] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 3 14:00:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 14:00:37.064579 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca68e5a6-8513-4956-a9dc-1cc5cc6836d1 None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:37.065515 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca68e5a6-8513-4956-a9dc-1cc5cc6836d1 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:37.066597 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca68e5a6-8513-4956-a9dc-1cc5cc6836d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:37.083826 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-ca68e5a6-8513-4956-a9dc-1cc5cc6836d1 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:00:37.085487 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-ca68e5a6-8513-4956-a9dc-1cc5cc6836d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:00:37.153547 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 430/883] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 3 14:00:37 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 14:00:37.176590 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bf1d28-9a2a-45f0-a7df-1b1e6f4a92ac None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:37.223513 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b50653-42d3-4478-a4a9-4591323e6554 None None] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:37.224135 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b50653-42d3-4478-a4a9-4591323e6554 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:37.224417 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b50653-42d3-4478-a4a9-4591323e6554 None None] PATH_INFO: `/` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:37.226100 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 431/884] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 3 14:00:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 14:00:37.235912 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15947909-2c0d-4d9e-ba2a-af19c1c950db None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:37.236550 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15947909-2c0d-4d9e-ba2a-af19c1c950db None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:37.237015 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15947909-2c0d-4d9e-ba2a-af19c1c950db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:37.255477 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-15947909-2c0d-4d9e-ba2a-af19c1c950db None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:00:37.256979 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-15947909-2c0d-4d9e-ba2a-af19c1c950db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:00:37.289912 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bf1d28-9a2a-45f0-a7df-1b1e6f4a92ac None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:37.321767 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 432/885] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 3 14:00:37 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 03 14:00:37.340019 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00421712-ab43-481e-aee7-b46a46ca167e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:37.342700 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00421712-ab43-481e-aee7-b46a46ca167e None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:37.342700 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00421712-ab43-481e-aee7-b46a46ca167e None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:37.342700 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00421712-ab43-481e-aee7-b46a46ca167e None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:37.352757 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15947909-2c0d-4d9e-ba2a-af19c1c950db None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:37.353666 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00421712-ab43-481e-aee7-b46a46ca167e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 14:00:37.363725 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application [None req-00421712-ab43-481e-aee7-b46a46ca167e None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 03 14:00:37.363725 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:00:37.363725 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 14:00:37.363725 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 14:00:37.363725 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 14:00:37.363725 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 14:00:37.363725 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 14:00:37.363725 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 14:00:37.363725 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 14:00:37.363725 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 14:00:37.363725 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 14:00:37.363725 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 14:00:37.363725 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 14:00:37.363725 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 14:00:37.363725 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 14:00:37.363725 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 14:00:37.364716 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 14:00:37.364716 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 14:00:37.364716 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 14:00:37.364716 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 14:00:37.364716 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 14:00:37.364716 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 14:00:37.364716 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 14:00:37.364716 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 14:00:37.364716 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 14:00:37.364716 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.get_or_create( May 03 14:00:37.364716 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 14:00:37.364716 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application with Lock( May 03 14:00:37.364716 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 14:00:37.364716 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._enter() May 03 14:00:37.364716 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 14:00:37.364716 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 14:00:37.365660 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 14:00:37.365660 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.creator() May 03 14:00:37.365660 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 14:00:37.365660 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application created_value = creator( May 03 14:00:37.365660 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 14:00:37.365660 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 14:00:37.365660 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 14:00:37.365660 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 14:00:37.365660 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 14:00:37.365660 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 14:00:37.365660 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 03 14:00:37.365660 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application May 03 14:00:37.365660 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 454/886] 10.222.0.36 () {56 vars in 1120 bytes} [Tue May 3 14:00:37 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 14:00:37.373250 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00421712-ab43-481e-aee7-b46a46ca167e None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:37.475720 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15947909-2c0d-4d9e-ba2a-af19c1c950db None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:37.486916 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00421712-ab43-481e-aee7-b46a46ca167e None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:37.518231 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f542b2-2127-44f4-96cc-48a71071769a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:37.519525 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f542b2-2127-44f4-96cc-48a71071769a None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:37.520008 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f542b2-2127-44f4-96cc-48a71071769a None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:37.520460 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f542b2-2127-44f4-96cc-48a71071769a None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:37.520913 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2aca504-23c9-407c-8608-0d1af2bc3146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:37.521534 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f542b2-2127-44f4-96cc-48a71071769a None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:37.521706 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aca504-23c9-407c-8608-0d1af2bc3146 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:37.522103 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aca504-23c9-407c-8608-0d1af2bc3146 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:37.522440 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aca504-23c9-407c-8608-0d1af2bc3146 None admin] PATH_INFO: `/v3/roles` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:37.523247 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2aca504-23c9-407c-8608-0d1af2bc3146 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:00:37.523616 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2aca504-23c9-407c-8608-0d1af2bc3146 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:37.524151 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f542b2-2127-44f4-96cc-48a71071769a None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:37.525103 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2aca504-23c9-407c-8608-0d1af2bc3146 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:37.537880 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application [None req-e7f542b2-2127-44f4-96cc-48a71071769a None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 03 14:00:37.537880 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:00:37.537880 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 03 14:00:37.537880 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 03 14:00:37.537880 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 03 14:00:37.537880 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 03 14:00:37.537880 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 03 14:00:37.537880 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 14:00:37.537880 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 03 14:00:37.537880 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application May 03 14:00:37.537880 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 03 14:00:37.537880 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application May 03 14:00:37.537880 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:00:37.537880 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 14:00:37.537880 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 14:00:37.537880 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 14:00:37.537880 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 14:00:37.539037 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 14:00:37.539037 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 14:00:37.539037 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 14:00:37.539037 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 14:00:37.539037 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 14:00:37.539037 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 14:00:37.539037 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 03 14:00:37.539037 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._get_service(service_id) May 03 14:00:37.539037 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 03 14:00:37.539037 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 03 14:00:37.539037 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 14:00:37.539037 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 14:00:37.539037 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 14:00:37.539037 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 14:00:37.539037 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 14:00:37.539037 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.get_or_create( May 03 14:00:37.539926 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 14:00:37.539926 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application with Lock( May 03 14:00:37.539926 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 14:00:37.539926 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._enter() May 03 14:00:37.539926 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 14:00:37.539926 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 14:00:37.539926 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 14:00:37.539926 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.creator() May 03 14:00:37.539926 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 14:00:37.539926 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application created_value = creator( May 03 14:00:37.539926 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 03 14:00:37.539926 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 14:00:37.539926 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 03 14:00:37.539926 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application May 03 14:00:37.540707 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 455/887] 10.222.0.36 () {56 vars in 1115 bytes} [Tue May 3 14:00:37 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 14:00:37.540707 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2aca504-23c9-407c-8608-0d1af2bc3146 None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:37.547250 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 433/888] 10.222.0.36 () {56 vars in 1114 bytes} [Tue May 3 14:00:37 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 14:00:37.548251 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f542b2-2127-44f4-96cc-48a71071769a None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:37.643637 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2aca504-23c9-407c-8608-0d1af2bc3146 None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:37.665885 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f542b2-2127-44f4-96cc-48a71071769a None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:37.677326 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25df5784-8ff1-46d2-86e9-61b8b9a51ecc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:37.678215 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25df5784-8ff1-46d2-86e9-61b8b9a51ecc None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:37.678578 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25df5784-8ff1-46d2-86e9-61b8b9a51ecc None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:37.678752 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25df5784-8ff1-46d2-86e9-61b8b9a51ecc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:37.689511 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25df5784-8ff1-46d2-86e9-61b8b9a51ecc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:37.690965 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25df5784-8ff1-46d2-86e9-61b8b9a51ecc None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:37.701961 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160c3f73-1dd3-4fe0-a6ea-c2b4ecd4f59a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:37.702935 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160c3f73-1dd3-4fe0-a6ea-c2b4ecd4f59a None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:37.703432 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160c3f73-1dd3-4fe0-a6ea-c2b4ecd4f59a None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:37.703912 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160c3f73-1dd3-4fe0-a6ea-c2b4ecd4f59a None admin] PATH_INFO: `/v3/services` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:37.704808 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160c3f73-1dd3-4fe0-a6ea-c2b4ecd4f59a None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80012) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:00:37.705348 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160c3f73-1dd3-4fe0-a6ea-c2b4ecd4f59a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:37.706902 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160c3f73-1dd3-4fe0-a6ea-c2b4ecd4f59a None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:37.708261 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application [None req-25df5784-8ff1-46d2-86e9-61b8b9a51ecc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 14:00:37.708261 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:00:37.708261 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 14:00:37.708261 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 14:00:37.708261 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 14:00:37.708261 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 14:00:37.708261 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 14:00:37.708261 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 14:00:37.708261 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 14:00:37.708261 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 14:00:37.708261 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 14:00:37.708261 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 14:00:37.708261 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 14:00:37.708261 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 14:00:37.708261 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 14:00:37.709180 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 14:00:37.709180 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 14:00:37.709180 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 14:00:37.709180 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 14:00:37.709180 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 14:00:37.709180 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 14:00:37.709180 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.get_or_create( May 03 14:00:37.709180 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 14:00:37.709180 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application with Lock( May 03 14:00:37.709180 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 14:00:37.709180 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._enter() May 03 14:00:37.709180 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 14:00:37.709180 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 14:00:37.709180 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 14:00:37.709180 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.creator() May 03 14:00:37.709180 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 14:00:37.709180 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application created_value = creator( May 03 14:00:37.710404 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 14:00:37.710404 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 14:00:37.710404 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 14:00:37.710404 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application May 03 14:00:37.714448 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 456/889] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 3 14:00:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 14:00:37.719854 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25df5784-8ff1-46d2-86e9-61b8b9a51ecc None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:37.720020 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 434/890] 10.222.0.36 () {56 vars in 1114 bytes} [Tue May 3 14:00:37 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:00:37.721555 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160c3f73-1dd3-4fe0-a6ea-c2b4ecd4f59a None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:37.837386 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160c3f73-1dd3-4fe0-a6ea-c2b4ecd4f59a None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:37.837628 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25df5784-8ff1-46d2-86e9-61b8b9a51ecc None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:37.875396 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe35a7d-47eb-4201-b8bf-b9e37f518e0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:37.876500 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe35a7d-47eb-4201-b8bf-b9e37f518e0d None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:37.876933 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe35a7d-47eb-4201-b8bf-b9e37f518e0d None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:37.877528 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe35a7d-47eb-4201-b8bf-b9e37f518e0d None admin] PATH_INFO: `/v3/domains` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:37.878502 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe35a7d-47eb-4201-b8bf-b9e37f518e0d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:00:37.878913 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77c6fa9-2c0b-4a18-91bc-802396644921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:37.879109 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe35a7d-47eb-4201-b8bf-b9e37f518e0d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:37.879754 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77c6fa9-2c0b-4a18-91bc-802396644921 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:37.880127 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77c6fa9-2c0b-4a18-91bc-802396644921 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:37.880491 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77c6fa9-2c0b-4a18-91bc-802396644921 None admin] PATH_INFO: `/v3/services` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:37.881105 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe35a7d-47eb-4201-b8bf-b9e37f518e0d None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:37.881415 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77c6fa9-2c0b-4a18-91bc-802396644921 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80012) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:00:37.881819 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77c6fa9-2c0b-4a18-91bc-802396644921 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:37.883435 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77c6fa9-2c0b-4a18-91bc-802396644921 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:37.893337 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 435/891] 10.222.0.36 () {56 vars in 1114 bytes} [Tue May 3 14:00:37 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:00:37.896228 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77c6fa9-2c0b-4a18-91bc-802396644921 None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:37.903543 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 457/892] 10.222.0.36 () {56 vars in 1109 bytes} [Tue May 3 14:00:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 14:00:37.906103 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe35a7d-47eb-4201-b8bf-b9e37f518e0d None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:38.011324 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77c6fa9-2c0b-4a18-91bc-802396644921 None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:38.027531 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe35a7d-47eb-4201-b8bf-b9e37f518e0d None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:38.044779 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5da5cd6-b86e-47bb-9cea-048fe7c61908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:38.045673 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5da5cd6-b86e-47bb-9cea-048fe7c61908 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:38.046052 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5da5cd6-b86e-47bb-9cea-048fe7c61908 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:38.046465 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5da5cd6-b86e-47bb-9cea-048fe7c61908 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:38.047377 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5da5cd6-b86e-47bb-9cea-048fe7c61908 None admin] RBAC: Adding query filter params (interface=public, service_id=f705c4150e21447bb32683c770bd64fa, region_id=RegionOne) {{(pid=80012) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:00:38.047760 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5da5cd6-b86e-47bb-9cea-048fe7c61908 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:38.049321 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5da5cd6-b86e-47bb-9cea-048fe7c61908 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:38.063724 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 436/893] 10.222.0.36 () {56 vars in 1251 bytes} [Tue May 3 14:00:37 2022] GET /identity/v3/endpoints?service_id=f705c4150e21447bb32683c770bd64fa&interface=public®ion_id=RegionOne => generated 194 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 14:00:38.063724 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5da5cd6-b86e-47bb-9cea-048fe7c61908 None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:38.083614 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8837231-ca75-40c2-a945-08fb889b635c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:38.085044 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8837231-ca75-40c2-a945-08fb889b635c None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:38.085513 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8837231-ca75-40c2-a945-08fb889b635c None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:38.085945 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8837231-ca75-40c2-a945-08fb889b635c None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:38.096926 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8837231-ca75-40c2-a945-08fb889b635c None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:38.098592 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8837231-ca75-40c2-a945-08fb889b635c None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:38.117956 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application [None req-c8837231-ca75-40c2-a945-08fb889b635c None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 03 14:00:38.117956 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:00:38.117956 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 14:00:38.117956 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 14:00:38.117956 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 14:00:38.117956 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 14:00:38.117956 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 14:00:38.117956 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 14:00:38.117956 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 14:00:38.117956 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 14:00:38.117956 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 14:00:38.117956 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 14:00:38.117956 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 14:00:38.117956 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 14:00:38.117956 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 14:00:38.117956 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 14:00:38.119162 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 14:00:38.119162 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 14:00:38.119162 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 14:00:38.119162 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 14:00:38.119162 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 14:00:38.119162 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 14:00:38.119162 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 14:00:38.119162 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 14:00:38.119162 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 14:00:38.119162 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.get_or_create( May 03 14:00:38.119162 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 14:00:38.119162 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application with Lock( May 03 14:00:38.119162 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 14:00:38.119162 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._enter() May 03 14:00:38.119162 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 14:00:38.119162 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 14:00:38.119162 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 14:00:38.119162 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.creator() May 03 14:00:38.120302 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 14:00:38.120302 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application created_value = creator( May 03 14:00:38.120302 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 14:00:38.120302 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 14:00:38.120302 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 14:00:38.120302 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 14:00:38.120302 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 14:00:38.120302 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 14:00:38.120302 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 03 14:00:38.120302 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application May 03 14:00:38.128136 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 458/894] 10.222.0.36 () {56 vars in 1117 bytes} [Tue May 3 14:00:37 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 14:00:38.130580 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8837231-ca75-40c2-a945-08fb889b635c None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:38.178945 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5da5cd6-b86e-47bb-9cea-048fe7c61908 None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:38.218936 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39673ba-b1b6-4e83-8ad4-7e18a25d8c79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:38.219697 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39673ba-b1b6-4e83-8ad4-7e18a25d8c79 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:38.220109 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39673ba-b1b6-4e83-8ad4-7e18a25d8c79 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:38.220448 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39673ba-b1b6-4e83-8ad4-7e18a25d8c79 None admin] PATH_INFO: `/v3/services` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:38.221197 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39673ba-b1b6-4e83-8ad4-7e18a25d8c79 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:38.222745 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39673ba-b1b6-4e83-8ad4-7e18a25d8c79 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:38.237701 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 437/895] 10.222.0.36 () {56 vars in 1087 bytes} [Tue May 3 14:00:38 2022] GET /identity/v3/services => generated 1268 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 14:00:38.255489 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8837231-ca75-40c2-a945-08fb889b635c None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:38.293555 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149d611f-aa26-4103-8c10-06ca06ddf7f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:38.294640 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149d611f-aa26-4103-8c10-06ca06ddf7f6 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:38.295185 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149d611f-aa26-4103-8c10-06ca06ddf7f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:38.295646 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149d611f-aa26-4103-8c10-06ca06ddf7f6 None admin] PATH_INFO: `/v3/users` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:38.296717 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149d611f-aa26-4103-8c10-06ca06ddf7f6 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:00:38.297241 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149d611f-aa26-4103-8c10-06ca06ddf7f6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:38.298963 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149d611f-aa26-4103-8c10-06ca06ddf7f6 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:38.313126 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31290d0c-3b0c-49e5-afcb-460859a3a6d0 None None] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:38.313475 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31290d0c-3b0c-49e5-afcb-460859a3a6d0 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:38.313875 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31290d0c-3b0c-49e5-afcb-460859a3a6d0 None None] PATH_INFO: `/` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:38.315767 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 438/896] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 3 14:00:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 14:00:38.324652 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191b08ed-742b-4ff4-85d8-d543a11c6456 None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:38.325148 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191b08ed-742b-4ff4-85d8-d543a11c6456 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:38.325556 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191b08ed-742b-4ff4-85d8-d543a11c6456 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:38.329155 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 459/897] 10.222.0.36 () {56 vars in 1149 bytes} [Tue May 3 14:00:38 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:00:38.333090 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149d611f-aa26-4103-8c10-06ca06ddf7f6 None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:38.349018 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-191b08ed-742b-4ff4-85d8-d543a11c6456 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:00:38.350365 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-191b08ed-742b-4ff4-85d8-d543a11c6456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:00:38.428524 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 439/898] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 3 14:00:38 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 03 14:00:38.443212 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191b08ed-742b-4ff4-85d8-d543a11c6456 None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:38.459321 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149d611f-aa26-4103-8c10-06ca06ddf7f6 None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:38.505786 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098af127-6a93-4cfa-b48c-cf773b95764a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:38.507246 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098af127-6a93-4cfa-b48c-cf773b95764a None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:38.507592 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098af127-6a93-4cfa-b48c-cf773b95764a None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:38.507927 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098af127-6a93-4cfa-b48c-cf773b95764a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:38.553719 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191b08ed-742b-4ff4-85d8-d543a11c6456 None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:38.577754 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098af127-6a93-4cfa-b48c-cf773b95764a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:38.579212 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098af127-6a93-4cfa-b48c-cf773b95764a None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:38.587320 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429c66d9-f304-4846-a0f8-5f52123697cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:38.588137 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429c66d9-f304-4846-a0f8-5f52123697cf None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:38.588456 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429c66d9-f304-4846-a0f8-5f52123697cf None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:38.588994 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429c66d9-f304-4846-a0f8-5f52123697cf None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:38.589670 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429c66d9-f304-4846-a0f8-5f52123697cf None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:38.591136 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429c66d9-f304-4846-a0f8-5f52123697cf None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:38.602876 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application [None req-429c66d9-f304-4846-a0f8-5f52123697cf None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 03 14:00:38.602876 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:00:38.602876 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 03 14:00:38.602876 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 03 14:00:38.602876 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 03 14:00:38.602876 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 03 14:00:38.602876 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 03 14:00:38.602876 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 14:00:38.602876 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 03 14:00:38.602876 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application May 03 14:00:38.602876 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 03 14:00:38.602876 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application May 03 14:00:38.602876 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:00:38.602876 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 14:00:38.602876 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 14:00:38.602876 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 14:00:38.604083 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 14:00:38.604083 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 14:00:38.604083 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 14:00:38.604083 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 14:00:38.604083 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 14:00:38.604083 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 14:00:38.604083 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 14:00:38.604083 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 03 14:00:38.604083 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._get_service(service_id) May 03 14:00:38.604083 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 03 14:00:38.604083 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 03 14:00:38.604083 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 14:00:38.604083 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 14:00:38.604083 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 14:00:38.604083 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 14:00:38.604083 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 14:00:38.605097 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.get_or_create( May 03 14:00:38.605097 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 14:00:38.605097 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application with Lock( May 03 14:00:38.605097 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 14:00:38.605097 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._enter() May 03 14:00:38.605097 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 14:00:38.605097 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 14:00:38.605097 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 14:00:38.605097 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.creator() May 03 14:00:38.605097 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 14:00:38.605097 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application created_value = creator( May 03 14:00:38.605097 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 03 14:00:38.605097 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 14:00:38.605097 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 03 14:00:38.605097 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application May 03 14:00:38.605097 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 440/899] 10.222.0.36 () {56 vars in 1132 bytes} [Tue May 3 14:00:38 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 14:00:38.606121 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ece13f-5f0d-454e-9908-32d6ec1fc9d2 None None] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:38.606121 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ece13f-5f0d-454e-9908-32d6ec1fc9d2 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:38.606269 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ece13f-5f0d-454e-9908-32d6ec1fc9d2 None None] PATH_INFO: `/` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:38.611482 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 441/900] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 3 14:00:38 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 14:00:38.612265 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ece13f-5f0d-454e-9908-32d6ec1fc9d2 None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:38.691206 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 460/901] 10.222.0.36 () {58 vars in 1282 bytes} [Tue May 3 14:00:38 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 03 14:00:38.693091 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5667a71d-83d0-4741-a9b5-f5a52ffd25c0 None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:38.693450 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5667a71d-83d0-4741-a9b5-f5a52ffd25c0 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:38.693672 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5667a71d-83d0-4741-a9b5-f5a52ffd25c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:38.711347 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-5667a71d-83d0-4741-a9b5-f5a52ffd25c0 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:00:38.712524 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-5667a71d-83d0-4741-a9b5-f5a52ffd25c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:00:38.714910 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ece13f-5f0d-454e-9908-32d6ec1fc9d2 None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:38.747039 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7d7c5c-3528-4f5f-a8e5-3204778fc6a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:38.747817 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7d7c5c-3528-4f5f-a8e5-3204778fc6a5 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:38.748096 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7d7c5c-3528-4f5f-a8e5-3204778fc6a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:38.748366 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7d7c5c-3528-4f5f-a8e5-3204778fc6a5 None admin] PATH_INFO: `/v3/services` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:38.749068 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7d7c5c-3528-4f5f-a8e5-3204778fc6a5 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80012) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:00:38.749397 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7d7c5c-3528-4f5f-a8e5-3204778fc6a5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:38.750771 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7d7c5c-3528-4f5f-a8e5-3204778fc6a5 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:38.755607 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 442/902] 10.222.0.36 () {56 vars in 1126 bytes} [Tue May 3 14:00:38 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:00:38.758109 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7d7c5c-3528-4f5f-a8e5-3204778fc6a5 None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:38.781421 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 461/903] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 3 14:00:38 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 14:00:38.781421 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5667a71d-83d0-4741-a9b5-f5a52ffd25c0 None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:38.866922 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7d7c5c-3528-4f5f-a8e5-3204778fc6a5 None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:38.887473 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5667a71d-83d0-4741-a9b5-f5a52ffd25c0 None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:38.900702 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9105f696-594e-433c-8a8a-9a2468bc1481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:38.901533 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9105f696-594e-433c-8a8a-9a2468bc1481 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:38.901810 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9105f696-594e-433c-8a8a-9a2468bc1481 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:38.902081 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9105f696-594e-433c-8a8a-9a2468bc1481 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:38.912531 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9105f696-594e-433c-8a8a-9a2468bc1481 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:38.914240 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9105f696-594e-433c-8a8a-9a2468bc1481 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:38.923150 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1170ed24-97b8-472a-b489-bfaeecfb149e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:38.923819 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1170ed24-97b8-472a-b489-bfaeecfb149e None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:38.924100 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1170ed24-97b8-472a-b489-bfaeecfb149e None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:38.924372 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1170ed24-97b8-472a-b489-bfaeecfb149e None admin] PATH_INFO: `/v3/services` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:38.925076 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1170ed24-97b8-472a-b489-bfaeecfb149e None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:00:38.925404 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1170ed24-97b8-472a-b489-bfaeecfb149e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:38.926773 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1170ed24-97b8-472a-b489-bfaeecfb149e None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:38.930926 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application [None req-9105f696-594e-433c-8a8a-9a2468bc1481 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 14:00:38.930926 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:00:38.930926 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 14:00:38.930926 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 14:00:38.930926 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 14:00:38.930926 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 14:00:38.930926 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 14:00:38.930926 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 14:00:38.930926 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 14:00:38.930926 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 14:00:38.930926 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 14:00:38.930926 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 14:00:38.930926 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 14:00:38.930926 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 14:00:38.930926 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 14:00:38.937034 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 14:00:38.937034 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 14:00:38.937034 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 14:00:38.937034 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 14:00:38.937034 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 14:00:38.937034 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 14:00:38.937034 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.get_or_create( May 03 14:00:38.937034 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 14:00:38.937034 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application with Lock( May 03 14:00:38.937034 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 14:00:38.937034 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._enter() May 03 14:00:38.937034 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 14:00:38.937034 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 14:00:38.937034 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 14:00:38.937034 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.creator() May 03 14:00:38.937034 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 14:00:38.937034 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application created_value = creator( May 03 14:00:38.937995 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 14:00:38.937995 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 14:00:38.937995 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 14:00:38.937995 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application May 03 14:00:38.938256 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 462/904] 10.222.0.36 () {56 vars in 1126 bytes} [Tue May 3 14:00:38 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:00:38.938333 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 443/905] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 3 14:00:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 14:00:38.938402 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1170ed24-97b8-472a-b489-bfaeecfb149e None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:38.938483 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9105f696-594e-433c-8a8a-9a2468bc1481 None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:39.039738 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1170ed24-97b8-472a-b489-bfaeecfb149e None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:39.041017 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9105f696-594e-433c-8a8a-9a2468bc1481 None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:39.080393 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318bd654-b610-498e-8b19-49376bf0275e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:39.080715 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d642b8d-48e8-46b3-bfc0-2250c8db7947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:39.081365 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d642b8d-48e8-46b3-bfc0-2250c8db7947 None admin] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:39.081642 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d642b8d-48e8-46b3-bfc0-2250c8db7947 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:39.081913 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d642b8d-48e8-46b3-bfc0-2250c8db7947 None admin] PATH_INFO: `/v3/services` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:39.082264 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318bd654-b610-498e-8b19-49376bf0275e None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:39.082632 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d642b8d-48e8-46b3-bfc0-2250c8db7947 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:39.082980 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318bd654-b610-498e-8b19-49376bf0275e None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:39.083466 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318bd654-b610-498e-8b19-49376bf0275e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:39.084018 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d642b8d-48e8-46b3-bfc0-2250c8db7947 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:39.085023 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318bd654-b610-498e-8b19-49376bf0275e None admin] RBAC: Adding query filter params (interface=public, service_id=0b0b6c9e83674c688e38409e992be248, region_id=RegionOne) {{(pid=80012) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:00:39.085567 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318bd654-b610-498e-8b19-49376bf0275e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:39.087132 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318bd654-b610-498e-8b19-49376bf0275e None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:39.093222 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 444/906] 10.222.0.36 () {56 vars in 1251 bytes} [Tue May 3 14:00:38 2022] GET /identity/v3/endpoints?service_id=0b0b6c9e83674c688e38409e992be248&interface=public®ion_id=RegionOne => generated 194 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 14:00:39.094397 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318bd654-b610-498e-8b19-49376bf0275e None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:39.099082 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 463/907] 10.222.0.36 () {60 vars in 1141 bytes} [Tue May 3 14:00:38 2022] POST /identity/v3/services => generated 241 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 14:00:39.099963 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d642b8d-48e8-46b3-bfc0-2250c8db7947 None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:39.204919 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318bd654-b610-498e-8b19-49376bf0275e None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:39.220162 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d642b8d-48e8-46b3-bfc0-2250c8db7947 None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:39.242640 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fd7ac9-5b68-431c-ad8e-5e1204be6479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:39.243718 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fd7ac9-5b68-431c-ad8e-5e1204be6479 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:39.244199 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fd7ac9-5b68-431c-ad8e-5e1204be6479 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:39.244673 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fd7ac9-5b68-431c-ad8e-5e1204be6479 None admin] PATH_INFO: `/v3/domains` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:39.245763 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fd7ac9-5b68-431c-ad8e-5e1204be6479 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80012) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:00:39.246288 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fd7ac9-5b68-431c-ad8e-5e1204be6479 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:39.248496 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fd7ac9-5b68-431c-ad8e-5e1204be6479 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:39.256758 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76724d9b-a8cf-4f6f-aae8-dbc847627d9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:39.257476 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76724d9b-a8cf-4f6f-aae8-dbc847627d9a None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:39.257762 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76724d9b-a8cf-4f6f-aae8-dbc847627d9a None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:39.258039 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76724d9b-a8cf-4f6f-aae8-dbc847627d9a None admin] PATH_INFO: `/v3/services` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:39.258750 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76724d9b-a8cf-4f6f-aae8-dbc847627d9a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:39.260214 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76724d9b-a8cf-4f6f-aae8-dbc847627d9a None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:39.268693 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 464/908] 10.222.0.36 () {56 vars in 1087 bytes} [Tue May 3 14:00:39 2022] GET /identity/v3/services => generated 1497 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 14:00:39.269395 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 445/909] 10.222.0.36 () {56 vars in 1109 bytes} [Tue May 3 14:00:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:00:39.270969 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76724d9b-a8cf-4f6f-aae8-dbc847627d9a None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:39.389898 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76724d9b-a8cf-4f6f-aae8-dbc847627d9a None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:39.428408 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0e4f2f-866c-466c-9930-51c4cb36c507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:39.429640 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0e4f2f-866c-466c-9930-51c4cb36c507 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:39.430154 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0e4f2f-866c-466c-9930-51c4cb36c507 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:39.430635 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0e4f2f-866c-466c-9930-51c4cb36c507 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:39.438772 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0e4f2f-866c-466c-9930-51c4cb36c507 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:39.440583 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0e4f2f-866c-466c-9930-51c4cb36c507 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:39.457007 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application [None req-3d0e4f2f-866c-466c-9930-51c4cb36c507 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 14:00:39.457007 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:00:39.457007 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 14:00:39.457007 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 14:00:39.457007 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 14:00:39.457007 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 14:00:39.457007 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 14:00:39.457007 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 14:00:39.457007 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 14:00:39.457007 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 14:00:39.457007 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 14:00:39.457007 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 14:00:39.457007 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 14:00:39.457007 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 14:00:39.457007 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 14:00:39.458058 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 14:00:39.458058 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 14:00:39.458058 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 14:00:39.458058 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 14:00:39.458058 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 14:00:39.458058 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 14:00:39.458058 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.get_or_create( May 03 14:00:39.458058 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 14:00:39.458058 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application with Lock( May 03 14:00:39.458058 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 14:00:39.458058 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._enter() May 03 14:00:39.458058 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 14:00:39.458058 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 14:00:39.458058 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 14:00:39.458058 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.creator() May 03 14:00:39.458058 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 14:00:39.458058 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application created_value = creator( May 03 14:00:39.458970 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 14:00:39.458970 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 14:00:39.458970 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 14:00:39.458970 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 14:00:39.458970 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 14:00:39.458970 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 14:00:39.458970 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 14:00:39.458970 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application May 03 14:00:39.461614 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 465/910] 10.222.0.36 () {56 vars in 1111 bytes} [Tue May 3 14:00:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 14:00:39.467978 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fd7ac9-5b68-431c-ad8e-5e1204be6479 None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:39.569959 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fd7ac9-5b68-431c-ad8e-5e1204be6479 None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:39.603926 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc10ee39-a238-4055-b34d-c314ef7a34cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:39.604593 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc10ee39-a238-4055-b34d-c314ef7a34cd None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:39.604924 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc10ee39-a238-4055-b34d-c314ef7a34cd None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:39.605204 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc10ee39-a238-4055-b34d-c314ef7a34cd None admin] PATH_INFO: `/v3/projects` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:39.606129 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc10ee39-a238-4055-b34d-c314ef7a34cd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80012) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:00:39.606444 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc10ee39-a238-4055-b34d-c314ef7a34cd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:39.607877 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc10ee39-a238-4055-b34d-c314ef7a34cd None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:39.619837 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 446/911] 10.222.0.36 () {56 vars in 1148 bytes} [Tue May 3 14:00:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:00:39.625884 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0e4f2f-866c-466c-9930-51c4cb36c507 None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:39.726658 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0e4f2f-866c-466c-9930-51c4cb36c507 None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:39.760471 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37af7143-535b-4c22-9e2c-399e72408ef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:39.761530 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37af7143-535b-4c22-9e2c-399e72408ef5 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:39.762029 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37af7143-535b-4c22-9e2c-399e72408ef5 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:39.762542 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37af7143-535b-4c22-9e2c-399e72408ef5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:39.763568 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37af7143-535b-4c22-9e2c-399e72408ef5 None admin] RBAC: Adding query filter params (role.id=83dea282ec144c95979d7e1b50c52a85, scope.project.id=de541be478754087934323bdbe41a579, user.id=dec39ff0b6544a738e5aae06e9a8cb38) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:00:39.764086 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37af7143-535b-4c22-9e2c-399e72408ef5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:39.765738 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37af7143-535b-4c22-9e2c-399e72408ef5 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:39.772115 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 466/912] 10.222.0.36 () {56 vars in 1374 bytes} [Tue May 3 14:00:39 2022] GET /identity/v3/role_assignments?user.id=dec39ff0b6544a738e5aae06e9a8cb38&scope.project.id=de541be478754087934323bdbe41a579&role.id=83dea282ec144c95979d7e1b50c52a85 => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:00:40.530056 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f0446d-5efd-40b6-93e0-5b3e3b145533 None None] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:40.530593 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f0446d-5efd-40b6-93e0-5b3e3b145533 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:40.530593 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f0446d-5efd-40b6-93e0-5b3e3b145533 None None] PATH_INFO: `/` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:40.532220 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 447/913] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 3 14:00:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 14:00:40.537665 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3061987-1377-4b84-a69d-05834d08860e None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:40.538081 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3061987-1377-4b84-a69d-05834d08860e None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:40.538252 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3061987-1377-4b84-a69d-05834d08860e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:40.555316 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-a3061987-1377-4b84-a69d-05834d08860e None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:00:40.556496 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-a3061987-1377-4b84-a69d-05834d08860e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:00:40.626269 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 467/914] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 3 14:00:40 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 14:00:40.648937 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f0446d-5efd-40b6-93e0-5b3e3b145533 None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:40.752521 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f0446d-5efd-40b6-93e0-5b3e3b145533 None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:40.786946 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dfdf36-96fe-4447-a418-77400ab93afe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:40.787682 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dfdf36-96fe-4447-a418-77400ab93afe None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:40.787962 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dfdf36-96fe-4447-a418-77400ab93afe None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:40.788234 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dfdf36-96fe-4447-a418-77400ab93afe None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:40.789072 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81dfdf36-96fe-4447-a418-77400ab93afe None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:40.790475 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81dfdf36-96fe-4447-a418-77400ab93afe None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:40.802653 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application [None req-81dfdf36-96fe-4447-a418-77400ab93afe None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 03 14:00:40.802653 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:00:40.802653 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 03 14:00:40.802653 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 03 14:00:40.802653 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 03 14:00:40.802653 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 03 14:00:40.802653 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 03 14:00:40.802653 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 14:00:40.802653 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 03 14:00:40.802653 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application May 03 14:00:40.802653 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 03 14:00:40.802653 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application May 03 14:00:40.802653 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:00:40.802653 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 14:00:40.802653 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 14:00:40.802653 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 14:00:40.802653 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 14:00:40.803673 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 14:00:40.803673 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 14:00:40.803673 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 14:00:40.803673 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 14:00:40.803673 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 14:00:40.803673 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 14:00:40.803673 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 03 14:00:40.803673 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._get_service(service_id) May 03 14:00:40.803673 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 03 14:00:40.803673 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 03 14:00:40.803673 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 14:00:40.803673 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 14:00:40.803673 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 14:00:40.803673 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 14:00:40.803673 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 14:00:40.803673 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.get_or_create( May 03 14:00:40.804686 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 14:00:40.804686 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application with Lock( May 03 14:00:40.804686 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 14:00:40.804686 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._enter() May 03 14:00:40.804686 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 14:00:40.804686 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 14:00:40.804686 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 14:00:40.804686 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.creator() May 03 14:00:40.804686 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 14:00:40.804686 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application created_value = creator( May 03 14:00:40.804686 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 03 14:00:40.804686 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 14:00:40.804686 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 03 14:00:40.804686 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application May 03 14:00:40.804686 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 448/915] 10.222.0.36 () {56 vars in 1114 bytes} [Tue May 3 14:00:40 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 14:00:40.809899 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3061987-1377-4b84-a69d-05834d08860e None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:40.914472 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3061987-1377-4b84-a69d-05834d08860e None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:40.950900 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576b82de-cde2-49ac-8640-9d4234784598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:40.951570 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576b82de-cde2-49ac-8640-9d4234784598 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:40.951915 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576b82de-cde2-49ac-8640-9d4234784598 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:40.952191 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576b82de-cde2-49ac-8640-9d4234784598 None admin] PATH_INFO: `/v3/services` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:40.952955 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576b82de-cde2-49ac-8640-9d4234784598 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:00:40.953263 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576b82de-cde2-49ac-8640-9d4234784598 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:40.954663 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576b82de-cde2-49ac-8640-9d4234784598 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:40.960203 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 468/916] 10.222.0.36 () {56 vars in 1114 bytes} [Tue May 3 14:00:40 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:00:40.966486 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dfdf36-96fe-4447-a418-77400ab93afe None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:41.071652 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dfdf36-96fe-4447-a418-77400ab93afe None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:41.106822 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f17327e-1d32-4362-9e19-16994cb06b10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:41.107498 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f17327e-1d32-4362-9e19-16994cb06b10 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:41.107780 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f17327e-1d32-4362-9e19-16994cb06b10 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:41.108058 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f17327e-1d32-4362-9e19-16994cb06b10 None admin] PATH_INFO: `/v3/services` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:41.108768 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f17327e-1d32-4362-9e19-16994cb06b10 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80012) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:00:41.109076 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f17327e-1d32-4362-9e19-16994cb06b10 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:41.110478 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f17327e-1d32-4362-9e19-16994cb06b10 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:41.115689 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 449/917] 10.222.0.36 () {56 vars in 1114 bytes} [Tue May 3 14:00:40 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:00:41.122421 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576b82de-cde2-49ac-8640-9d4234784598 None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:41.222647 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576b82de-cde2-49ac-8640-9d4234784598 None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:41.259537 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf29ba6-803f-4437-bc81-7c3ee12e7a1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:41.260219 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf29ba6-803f-4437-bc81-7c3ee12e7a1e None admin] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:41.260499 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf29ba6-803f-4437-bc81-7c3ee12e7a1e None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:41.260773 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf29ba6-803f-4437-bc81-7c3ee12e7a1e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:41.261569 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf29ba6-803f-4437-bc81-7c3ee12e7a1e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:41.263032 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf29ba6-803f-4437-bc81-7c3ee12e7a1e None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:41.286881 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 469/918] 10.222.0.36 () {60 vars in 1144 bytes} [Tue May 3 14:00:41 2022] POST /identity/v3/endpoints => generated 346 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 14:00:41.440082 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c8ec92-12e5-46b5-897c-9d1f8bf0a171 None None] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:41.440283 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c8ec92-12e5-46b5-897c-9d1f8bf0a171 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:41.440565 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c8ec92-12e5-46b5-897c-9d1f8bf0a171 None None] PATH_INFO: `/` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:41.442352 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 450/919] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 3 14:00:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 14:00:41.448613 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adfe357-7027-443e-b47f-3f0c0f197757 None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:41.448960 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adfe357-7027-443e-b47f-3f0c0f197757 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:41.449187 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adfe357-7027-443e-b47f-3f0c0f197757 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:41.468147 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-9adfe357-7027-443e-b47f-3f0c0f197757 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:00:41.469432 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-9adfe357-7027-443e-b47f-3f0c0f197757 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:00:41.543045 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 470/920] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 3 14:00:41 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 14:00:41.566355 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c8ec92-12e5-46b5-897c-9d1f8bf0a171 None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:41.617683 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc69bfe-89c5-4de6-8718-81f2b0c5da94 None None] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:41.618031 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc69bfe-89c5-4de6-8718-81f2b0c5da94 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:41.618246 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc69bfe-89c5-4de6-8718-81f2b0c5da94 None None] PATH_INFO: `/` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:41.620014 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 471/921] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 3 14:00:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 14:00:41.625144 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d240e0-ec4a-433d-907c-4ca08eb886d6 None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:41.625466 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d240e0-ec4a-433d-907c-4ca08eb886d6 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:41.625742 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d240e0-ec4a-433d-907c-4ca08eb886d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:41.642276 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-f4d240e0-ec4a-433d-907c-4ca08eb886d6 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:00:41.643442 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-f4d240e0-ec4a-433d-907c-4ca08eb886d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:00:41.676055 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c8ec92-12e5-46b5-897c-9d1f8bf0a171 None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:41.720171 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317bfe46-d5a1-48cb-a9b3-157e192fb58b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:41.720906 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317bfe46-d5a1-48cb-a9b3-157e192fb58b None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:41.721186 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317bfe46-d5a1-48cb-a9b3-157e192fb58b None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:41.721499 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317bfe46-d5a1-48cb-a9b3-157e192fb58b None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:41.722154 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317bfe46-d5a1-48cb-a9b3-157e192fb58b None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:41.723527 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317bfe46-d5a1-48cb-a9b3-157e192fb58b None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:41.728883 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 472/922] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 3 14:00:41 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 14:00:41.736334 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application [None req-317bfe46-d5a1-48cb-a9b3-157e192fb58b None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 03 14:00:41.736334 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:00:41.736334 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 03 14:00:41.736334 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 03 14:00:41.736334 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 03 14:00:41.736334 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 03 14:00:41.736334 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 03 14:00:41.736334 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 14:00:41.736334 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 03 14:00:41.736334 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application May 03 14:00:41.736334 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 03 14:00:41.736334 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application May 03 14:00:41.736334 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:00:41.736334 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 14:00:41.736334 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 14:00:41.736334 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 14:00:41.736334 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 14:00:41.737481 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 14:00:41.737481 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 14:00:41.737481 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 14:00:41.737481 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 14:00:41.737481 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 14:00:41.737481 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 14:00:41.737481 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 03 14:00:41.737481 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._get_service(service_id) May 03 14:00:41.737481 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 03 14:00:41.737481 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 03 14:00:41.737481 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 14:00:41.737481 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 14:00:41.737481 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 14:00:41.737481 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 14:00:41.737481 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 14:00:41.737481 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.get_or_create( May 03 14:00:41.738389 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 14:00:41.738389 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application with Lock( May 03 14:00:41.738389 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 14:00:41.738389 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._enter() May 03 14:00:41.738389 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 14:00:41.738389 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 14:00:41.738389 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 14:00:41.738389 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.creator() May 03 14:00:41.738389 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 14:00:41.738389 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application created_value = creator( May 03 14:00:41.738389 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 03 14:00:41.738389 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 14:00:41.738389 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 03 14:00:41.738389 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application May 03 14:00:41.738389 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 451/923] 10.222.0.36 () {56 vars in 1126 bytes} [Tue May 3 14:00:41 2022] GET /identity/v3/services/object-store => generated 93 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 14:00:41.744226 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d240e0-ec4a-433d-907c-4ca08eb886d6 None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:41.746293 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317bfe46-d5a1-48cb-a9b3-157e192fb58b None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:41.857031 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317bfe46-d5a1-48cb-a9b3-157e192fb58b None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:41.861410 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d240e0-ec4a-433d-907c-4ca08eb886d6 None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:41.890273 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4908a635-00fc-4f0b-a147-0e3ffd4d1a25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:41.891323 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4908a635-00fc-4f0b-a147-0e3ffd4d1a25 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:41.891807 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4908a635-00fc-4f0b-a147-0e3ffd4d1a25 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:41.892276 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4908a635-00fc-4f0b-a147-0e3ffd4d1a25 None admin] PATH_INFO: `/v3/services` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:41.893483 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4908a635-00fc-4f0b-a147-0e3ffd4d1a25 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80012) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:00:41.894008 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4908a635-00fc-4f0b-a147-0e3ffd4d1a25 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:41.895624 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4908a635-00fc-4f0b-a147-0e3ffd4d1a25 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:41.900840 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a39724-1544-4b11-9f14-aee57013ff6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:41.905558 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a39724-1544-4b11-9f14-aee57013ff6c None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:41.905558 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a39724-1544-4b11-9f14-aee57013ff6c None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:41.905558 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a39724-1544-4b11-9f14-aee57013ff6c None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:41.905558 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a39724-1544-4b11-9f14-aee57013ff6c None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:41.905558 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a39724-1544-4b11-9f14-aee57013ff6c None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:41.906349 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 452/924] 10.222.0.36 () {56 vars in 1122 bytes} [Tue May 3 14:00:41 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:00:41.907401 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4908a635-00fc-4f0b-a147-0e3ffd4d1a25 None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:41.919106 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application [None req-c5a39724-1544-4b11-9f14-aee57013ff6c None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 03 14:00:41.919106 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:00:41.919106 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 03 14:00:41.919106 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 03 14:00:41.919106 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 03 14:00:41.919106 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 03 14:00:41.919106 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 03 14:00:41.919106 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 14:00:41.919106 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 03 14:00:41.919106 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application May 03 14:00:41.919106 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 03 14:00:41.919106 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application May 03 14:00:41.919106 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:00:41.919106 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 14:00:41.919106 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 14:00:41.919106 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 14:00:41.920180 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 14:00:41.920180 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 14:00:41.920180 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 14:00:41.920180 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 14:00:41.920180 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 14:00:41.920180 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 14:00:41.920180 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 14:00:41.920180 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 03 14:00:41.920180 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._get_service(service_id) May 03 14:00:41.920180 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 03 14:00:41.920180 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 03 14:00:41.920180 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 14:00:41.920180 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 14:00:41.920180 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 14:00:41.920180 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 14:00:41.920180 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 14:00:41.921046 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.get_or_create( May 03 14:00:41.921046 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 14:00:41.921046 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application with Lock( May 03 14:00:41.921046 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 14:00:41.921046 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._enter() May 03 14:00:41.921046 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 14:00:41.921046 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 14:00:41.921046 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 14:00:41.921046 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.creator() May 03 14:00:41.921046 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 14:00:41.921046 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application created_value = creator( May 03 14:00:41.921046 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 03 14:00:41.921046 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 14:00:41.921046 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 03 14:00:41.921046 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application May 03 14:00:41.925379 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 473/925] 10.222.0.36 () {56 vars in 1132 bytes} [Tue May 3 14:00:41 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 14:00:41.927674 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a39724-1544-4b11-9f14-aee57013ff6c None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:42.034603 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4908a635-00fc-4f0b-a147-0e3ffd4d1a25 None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:42.041657 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a39724-1544-4b11-9f14-aee57013ff6c None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:42.077541 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8d4099-5003-454f-a1ae-3723b51127ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:42.078624 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8d4099-5003-454f-a1ae-3723b51127ce None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:42.079220 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8d4099-5003-454f-a1ae-3723b51127ce None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:42.079720 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8d4099-5003-454f-a1ae-3723b51127ce None admin] PATH_INFO: `/v3/services` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:42.080679 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8d4099-5003-454f-a1ae-3723b51127ce None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80012) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:00:42.081217 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8d4099-5003-454f-a1ae-3723b51127ce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:42.082926 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8d4099-5003-454f-a1ae-3723b51127ce None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:42.087826 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7f54bb-7f82-45ec-89c9-8b198de58ae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:42.088841 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7f54bb-7f82-45ec-89c9-8b198de58ae6 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:42.089126 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7f54bb-7f82-45ec-89c9-8b198de58ae6 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:42.089428 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7f54bb-7f82-45ec-89c9-8b198de58ae6 None admin] PATH_INFO: `/v3/services` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:42.095956 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7f54bb-7f82-45ec-89c9-8b198de58ae6 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:00:42.095956 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7f54bb-7f82-45ec-89c9-8b198de58ae6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:42.095956 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7f54bb-7f82-45ec-89c9-8b198de58ae6 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:42.096438 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 453/926] 10.222.0.36 () {56 vars in 1122 bytes} [Tue May 3 14:00:41 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:00:42.097621 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8d4099-5003-454f-a1ae-3723b51127ce None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:42.101403 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 474/927] 10.222.0.36 () {56 vars in 1126 bytes} [Tue May 3 14:00:41 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:00:42.106553 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7f54bb-7f82-45ec-89c9-8b198de58ae6 None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:42.219117 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8d4099-5003-454f-a1ae-3723b51127ce None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:42.229263 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7f54bb-7f82-45ec-89c9-8b198de58ae6 None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:42.256392 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6935d0f9-1c2f-4d92-82a2-7ae05c1fc4e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:42.257081 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6935d0f9-1c2f-4d92-82a2-7ae05c1fc4e5 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:42.257388 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6935d0f9-1c2f-4d92-82a2-7ae05c1fc4e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:42.257667 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6935d0f9-1c2f-4d92-82a2-7ae05c1fc4e5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:42.258458 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6935d0f9-1c2f-4d92-82a2-7ae05c1fc4e5 None admin] RBAC: Adding query filter params (interface=public, service_id=9126136cd0d643178d5b1cf6e302e87c, region_id=RegionOne) {{(pid=80012) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:00:42.258872 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6935d0f9-1c2f-4d92-82a2-7ae05c1fc4e5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:42.260189 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6935d0f9-1c2f-4d92-82a2-7ae05c1fc4e5 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:42.264429 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dcda80-2610-4a9a-82c5-5460374f6b73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:42.265116 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dcda80-2610-4a9a-82c5-5460374f6b73 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:42.265420 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dcda80-2610-4a9a-82c5-5460374f6b73 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:42.265762 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dcda80-2610-4a9a-82c5-5460374f6b73 None admin] PATH_INFO: `/v3/services` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:42.271220 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 454/928] 10.222.0.36 () {56 vars in 1251 bytes} [Tue May 3 14:00:42 2022] GET /identity/v3/endpoints?service_id=9126136cd0d643178d5b1cf6e302e87c&interface=public®ion_id=RegionOne => generated 194 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:00:42.271361 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dcda80-2610-4a9a-82c5-5460374f6b73 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:00:42.271361 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dcda80-2610-4a9a-82c5-5460374f6b73 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:42.271524 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f40d7c9-5d9c-4880-a4d6-957ede60ec53 None None] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:42.271524 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f40d7c9-5d9c-4880-a4d6-957ede60ec53 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:42.271658 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dcda80-2610-4a9a-82c5-5460374f6b73 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:42.271729 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f40d7c9-5d9c-4880-a4d6-957ede60ec53 None None] PATH_INFO: `/` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:42.271729 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 455/929] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 3 14:00:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 14:00:42.271874 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f40d7c9-5d9c-4880-a4d6-957ede60ec53 None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:42.279386 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 475/930] 10.222.0.36 () {56 vars in 1126 bytes} [Tue May 3 14:00:42 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 14:00:42.284773 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7316025a-0eea-4d6f-a95d-a10916177977 None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:42.284773 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7316025a-0eea-4d6f-a95d-a10916177977 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:42.284773 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7316025a-0eea-4d6f-a95d-a10916177977 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:42.299439 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-7316025a-0eea-4d6f-a95d-a10916177977 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:00:42.300618 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-7316025a-0eea-4d6f-a95d-a10916177977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:00:42.377316 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 476/931] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 3 14:00:42 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 14:00:42.377316 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7316025a-0eea-4d6f-a95d-a10916177977 None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:42.394753 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f40d7c9-5d9c-4880-a4d6-957ede60ec53 None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:42.430169 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f0b125-0f70-445d-bff9-4ab8eb39eb05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:42.430842 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f0b125-0f70-445d-bff9-4ab8eb39eb05 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:42.431122 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f0b125-0f70-445d-bff9-4ab8eb39eb05 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:42.431393 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f0b125-0f70-445d-bff9-4ab8eb39eb05 None admin] PATH_INFO: `/v3/services` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:42.432079 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f0b125-0f70-445d-bff9-4ab8eb39eb05 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:42.433503 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f0b125-0f70-445d-bff9-4ab8eb39eb05 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:42.449689 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 456/932] 10.222.0.36 () {56 vars in 1087 bytes} [Tue May 3 14:00:42 2022] GET /identity/v3/services => generated 1497 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 14:00:42.449689 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f0b125-0f70-445d-bff9-4ab8eb39eb05 None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:42.483931 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7316025a-0eea-4d6f-a95d-a10916177977 None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:42.530650 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84047dfc-7934-4b4d-8abe-d10750893e62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:42.531429 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84047dfc-7934-4b4d-8abe-d10750893e62 None admin] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:42.532059 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84047dfc-7934-4b4d-8abe-d10750893e62 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:42.532402 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84047dfc-7934-4b4d-8abe-d10750893e62 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:42.533867 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84047dfc-7934-4b4d-8abe-d10750893e62 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:42.536670 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84047dfc-7934-4b4d-8abe-d10750893e62 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:42.562975 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 477/933] 10.222.0.36 () {60 vars in 1144 bytes} [Tue May 3 14:00:42 2022] POST /identity/v3/endpoints => generated 347 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 14:00:42.575541 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f0b125-0f70-445d-bff9-4ab8eb39eb05 None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:42.622464 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcaade1-ad68-4255-a2b1-d215058f672b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:42.623616 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcaade1-ad68-4255-a2b1-d215058f672b None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:42.624052 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcaade1-ad68-4255-a2b1-d215058f672b None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:42.624499 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcaade1-ad68-4255-a2b1-d215058f672b None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:42.637726 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcaade1-ad68-4255-a2b1-d215058f672b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 14:00:42.646834 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application [None req-3dcaade1-ad68-4255-a2b1-d215058f672b None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 03 14:00:42.646834 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:00:42.646834 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 14:00:42.646834 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 14:00:42.646834 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 14:00:42.646834 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 14:00:42.646834 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 14:00:42.646834 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 14:00:42.646834 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 14:00:42.646834 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 14:00:42.646834 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 14:00:42.646834 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 14:00:42.646834 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 14:00:42.646834 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 14:00:42.646834 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 14:00:42.646834 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 14:00:42.648088 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 14:00:42.648088 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 14:00:42.648088 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 14:00:42.648088 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 14:00:42.648088 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 14:00:42.648088 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 14:00:42.648088 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 14:00:42.648088 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 14:00:42.648088 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 14:00:42.648088 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.get_or_create( May 03 14:00:42.648088 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 14:00:42.648088 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application with Lock( May 03 14:00:42.648088 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 14:00:42.648088 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._enter() May 03 14:00:42.648088 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 14:00:42.648088 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 14:00:42.649135 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 14:00:42.649135 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.creator() May 03 14:00:42.649135 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 14:00:42.649135 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application created_value = creator( May 03 14:00:42.649135 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 14:00:42.649135 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 14:00:42.649135 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 14:00:42.649135 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 14:00:42.649135 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 14:00:42.649135 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 14:00:42.649135 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 03 14:00:42.649135 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application May 03 14:00:42.651896 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 457/934] 10.222.0.36 () {56 vars in 1120 bytes} [Tue May 3 14:00:42 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 14:00:42.658124 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84047dfc-7934-4b4d-8abe-d10750893e62 None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:42.774923 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84047dfc-7934-4b4d-8abe-d10750893e62 None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:42.809579 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30995859-f6a0-44e6-96b8-b4a6c9f42917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:42.810604 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30995859-f6a0-44e6-96b8-b4a6c9f42917 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:42.811136 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30995859-f6a0-44e6-96b8-b4a6c9f42917 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:42.811620 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30995859-f6a0-44e6-96b8-b4a6c9f42917 None admin] PATH_INFO: `/v3/roles` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:42.812844 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30995859-f6a0-44e6-96b8-b4a6c9f42917 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:00:42.813435 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30995859-f6a0-44e6-96b8-b4a6c9f42917 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:42.815074 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30995859-f6a0-44e6-96b8-b4a6c9f42917 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:42.823912 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 478/935] 10.222.0.36 () {56 vars in 1115 bytes} [Tue May 3 14:00:42 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:00:42.829614 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcaade1-ad68-4255-a2b1-d215058f672b None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:42.937985 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcaade1-ad68-4255-a2b1-d215058f672b None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:42.970514 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c734a06a-8936-4a3c-b83a-466a9d75b7b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:42.971321 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c734a06a-8936-4a3c-b83a-466a9d75b7b7 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:42.971597 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c734a06a-8936-4a3c-b83a-466a9d75b7b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:42.971866 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c734a06a-8936-4a3c-b83a-466a9d75b7b7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:42.982322 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c734a06a-8936-4a3c-b83a-466a9d75b7b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:42.983758 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c734a06a-8936-4a3c-b83a-466a9d75b7b7 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:43.001467 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application [None req-c734a06a-8936-4a3c-b83a-466a9d75b7b7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 14:00:43.001467 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:00:43.001467 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 14:00:43.001467 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 14:00:43.001467 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 14:00:43.001467 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 14:00:43.001467 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 14:00:43.001467 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 14:00:43.001467 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 14:00:43.001467 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 14:00:43.001467 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 14:00:43.001467 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 14:00:43.001467 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 14:00:43.001467 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 14:00:43.001467 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 14:00:43.002624 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 14:00:43.002624 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 14:00:43.002624 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 14:00:43.002624 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 14:00:43.002624 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 14:00:43.002624 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 14:00:43.002624 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.get_or_create( May 03 14:00:43.002624 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 14:00:43.002624 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application with Lock( May 03 14:00:43.002624 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 14:00:43.002624 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._enter() May 03 14:00:43.002624 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 14:00:43.002624 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 14:00:43.002624 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 14:00:43.002624 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.creator() May 03 14:00:43.002624 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 14:00:43.002624 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application created_value = creator( May 03 14:00:43.003566 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 14:00:43.003566 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 14:00:43.003566 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 14:00:43.003566 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application May 03 14:00:43.004377 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 458/936] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 3 14:00:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 14:00:43.013986 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30995859-f6a0-44e6-96b8-b4a6c9f42917 None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:43.124394 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30995859-f6a0-44e6-96b8-b4a6c9f42917 None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:43.156763 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b4bc1f-a679-4f3d-bab4-1db1cf764a76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:43.157455 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b4bc1f-a679-4f3d-bab4-1db1cf764a76 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:43.157729 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b4bc1f-a679-4f3d-bab4-1db1cf764a76 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:43.157999 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b4bc1f-a679-4f3d-bab4-1db1cf764a76 None admin] PATH_INFO: `/v3/domains` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:43.158714 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b4bc1f-a679-4f3d-bab4-1db1cf764a76 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:00:43.159013 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b4bc1f-a679-4f3d-bab4-1db1cf764a76 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:43.160369 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b4bc1f-a679-4f3d-bab4-1db1cf764a76 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:43.172546 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 479/937] 10.222.0.36 () {56 vars in 1109 bytes} [Tue May 3 14:00:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:00:43.178016 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c734a06a-8936-4a3c-b83a-466a9d75b7b7 None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:43.276714 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c734a06a-8936-4a3c-b83a-466a9d75b7b7 None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:43.309901 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76e2b61-5ba1-448d-8fc2-bcf54f0d1010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:43.310724 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76e2b61-5ba1-448d-8fc2-bcf54f0d1010 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:43.311001 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76e2b61-5ba1-448d-8fc2-bcf54f0d1010 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:43.311272 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76e2b61-5ba1-448d-8fc2-bcf54f0d1010 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:43.319204 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76e2b61-5ba1-448d-8fc2-bcf54f0d1010 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:43.320668 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76e2b61-5ba1-448d-8fc2-bcf54f0d1010 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:43.337463 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application [None req-b76e2b61-5ba1-448d-8fc2-bcf54f0d1010 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 03 14:00:43.337463 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:00:43.337463 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 14:00:43.337463 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 14:00:43.337463 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 14:00:43.337463 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 14:00:43.337463 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 14:00:43.337463 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 14:00:43.337463 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 14:00:43.337463 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 14:00:43.337463 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 14:00:43.337463 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 14:00:43.337463 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 14:00:43.337463 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 14:00:43.337463 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 14:00:43.337463 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 14:00:43.338805 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 14:00:43.338805 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 14:00:43.338805 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 14:00:43.338805 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 14:00:43.338805 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 14:00:43.338805 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 14:00:43.338805 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 14:00:43.338805 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 14:00:43.338805 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 14:00:43.338805 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.get_or_create( May 03 14:00:43.338805 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 14:00:43.338805 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application with Lock( May 03 14:00:43.338805 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 14:00:43.338805 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._enter() May 03 14:00:43.338805 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 14:00:43.338805 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 14:00:43.338805 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 14:00:43.338805 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.creator() May 03 14:00:43.339774 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 14:00:43.339774 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application created_value = creator( May 03 14:00:43.339774 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 14:00:43.339774 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 14:00:43.339774 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 14:00:43.339774 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 14:00:43.339774 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 14:00:43.339774 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 14:00:43.339774 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 03 14:00:43.339774 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application May 03 14:00:43.339774 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 459/938] 10.222.0.36 () {56 vars in 1117 bytes} [Tue May 3 14:00:43 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 14:00:43.345252 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b4bc1f-a679-4f3d-bab4-1db1cf764a76 None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:43.447730 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b4bc1f-a679-4f3d-bab4-1db1cf764a76 None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:43.481316 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038d6e93-de5b-4202-bfc1-a72f932428f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:43.482095 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038d6e93-de5b-4202-bfc1-a72f932428f0 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:43.482373 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038d6e93-de5b-4202-bfc1-a72f932428f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:43.482647 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038d6e93-de5b-4202-bfc1-a72f932428f0 None admin] PATH_INFO: `/v3/users` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:43.483500 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038d6e93-de5b-4202-bfc1-a72f932428f0 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:00:43.483805 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038d6e93-de5b-4202-bfc1-a72f932428f0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:43.485269 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038d6e93-de5b-4202-bfc1-a72f932428f0 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:43.505920 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 480/939] 10.222.0.36 () {56 vars in 1149 bytes} [Tue May 3 14:00:43 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:00:43.511463 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76e2b61-5ba1-448d-8fc2-bcf54f0d1010 None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:43.609712 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76e2b61-5ba1-448d-8fc2-bcf54f0d1010 None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:43.642597 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f465b7-8831-4b1a-8632-cc45712ac81f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:43.643479 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f465b7-8831-4b1a-8632-cc45712ac81f None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:43.643818 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f465b7-8831-4b1a-8632-cc45712ac81f None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:43.644089 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f465b7-8831-4b1a-8632-cc45712ac81f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:43.655876 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f465b7-8831-4b1a-8632-cc45712ac81f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:43.657395 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f465b7-8831-4b1a-8632-cc45712ac81f None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:43.674990 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application [None req-72f465b7-8831-4b1a-8632-cc45712ac81f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 14:00:43.674990 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:00:43.674990 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 14:00:43.674990 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 14:00:43.674990 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 14:00:43.674990 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 14:00:43.674990 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 14:00:43.674990 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 14:00:43.674990 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 14:00:43.674990 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 14:00:43.674990 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 14:00:43.674990 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 14:00:43.674990 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 14:00:43.674990 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 14:00:43.674990 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 14:00:43.677160 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 14:00:43.677160 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 14:00:43.677160 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 14:00:43.677160 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 14:00:43.677160 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 14:00:43.677160 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 14:00:43.677160 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.get_or_create( May 03 14:00:43.677160 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 14:00:43.677160 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application with Lock( May 03 14:00:43.677160 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 14:00:43.677160 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._enter() May 03 14:00:43.677160 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 14:00:43.677160 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 14:00:43.677160 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 14:00:43.677160 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.creator() May 03 14:00:43.677160 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 14:00:43.677160 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application created_value = creator( May 03 14:00:43.679331 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 14:00:43.679331 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 14:00:43.679331 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 14:00:43.679331 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application May 03 14:00:43.679331 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 460/940] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 3 14:00:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 14:00:43.682800 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038d6e93-de5b-4202-bfc1-a72f932428f0 None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:43.684675 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f0df05-a013-45b9-b18f-8b618eabd797 None None] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:43.684959 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f0df05-a013-45b9-b18f-8b618eabd797 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:43.685234 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f0df05-a013-45b9-b18f-8b618eabd797 None None] PATH_INFO: `/` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:43.686879 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 461/941] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 3 14:00:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 14:00:43.692607 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01db69b5-0eff-4893-b584-f22fbf8c51ea None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:43.692890 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01db69b5-0eff-4893-b584-f22fbf8c51ea None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:43.693165 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01db69b5-0eff-4893-b584-f22fbf8c51ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:43.710648 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-01db69b5-0eff-4893-b584-f22fbf8c51ea None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:00:43.711817 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-01db69b5-0eff-4893-b584-f22fbf8c51ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:00:43.782907 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 462/942] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 3 14:00:43 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 03 14:00:43.803899 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038d6e93-de5b-4202-bfc1-a72f932428f0 None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:43.806807 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01db69b5-0eff-4893-b584-f22fbf8c51ea None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:43.849312 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc9cbb4-76f5-46b6-9b26-3adfa9bba5e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:43.850440 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc9cbb4-76f5-46b6-9b26-3adfa9bba5e1 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:43.850928 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc9cbb4-76f5-46b6-9b26-3adfa9bba5e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:43.851426 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc9cbb4-76f5-46b6-9b26-3adfa9bba5e1 None admin] PATH_INFO: `/v3/domains` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:43.852766 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc9cbb4-76f5-46b6-9b26-3adfa9bba5e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:00:43.853277 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc9cbb4-76f5-46b6-9b26-3adfa9bba5e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:43.855591 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc9cbb4-76f5-46b6-9b26-3adfa9bba5e1 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:43.869759 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 481/943] 10.222.0.36 () {56 vars in 1109 bytes} [Tue May 3 14:00:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:00:43.875978 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc9cbb4-76f5-46b6-9b26-3adfa9bba5e1 None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:43.918731 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01db69b5-0eff-4893-b584-f22fbf8c51ea None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:43.952447 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23af1ff5-89f6-40f2-af0f-3fbe36c60ae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:43.953112 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23af1ff5-89f6-40f2-af0f-3fbe36c60ae2 None admin] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:43.953422 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23af1ff5-89f6-40f2-af0f-3fbe36c60ae2 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:43.953697 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23af1ff5-89f6-40f2-af0f-3fbe36c60ae2 None admin] PATH_INFO: `/v3/projects` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:43.954413 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23af1ff5-89f6-40f2-af0f-3fbe36c60ae2 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:43.955849 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23af1ff5-89f6-40f2-af0f-3fbe36c60ae2 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:43.957228 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: WARNING keystone.server.flask.common [None req-23af1ff5-89f6-40f2-af0f-3fbe36c60ae2 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 03 14:00:43.976272 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.sql.core [None req-23af1ff5-89f6-40f2-af0f-3fbe36c60ae2 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 03 14:00:43.976272 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 03 14:00:43.976272 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [parameters: {'id': '2a9fc0e9ff75499ca8fbb965ef1020b1', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 03 14:00:43.976272 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80012) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 03 14:00:43.980935 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc9cbb4-76f5-46b6-9b26-3adfa9bba5e1 None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:43.996902 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application [None req-23af1ff5-89f6-40f2-af0f-3fbe36c60ae2 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 2a9fc0e9ff75499ca8fbb965ef1020b1.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 2a9fc0e9ff75499ca8fbb965ef1020b1. May 03 14:00:43.996902 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:00:43.996902 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 03 14:00:43.996902 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application self.dialect.do_execute( May 03 14:00:43.996902 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 03 14:00:43.996902 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 03 14:00:43.996902 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 03 14:00:43.996902 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application result = self._query(query) May 03 14:00:43.996902 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 03 14:00:43.996902 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application conn.query(q) May 03 14:00:43.996902 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 03 14:00:43.996902 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 03 14:00:43.996902 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 03 14:00:43.997865 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application result.read() May 03 14:00:43.997865 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 03 14:00:43.997865 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 03 14:00:43.997865 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 03 14:00:43.997865 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application packet.raise_for_error() May 03 14:00:43.997865 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 03 14:00:43.997865 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 03 14:00:43.997865 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 03 14:00:43.997865 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 03 14:00:43.997865 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 03 14:00:43.997865 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application May 03 14:00:43.997865 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 03 14:00:43.997865 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application May 03 14:00:43.997865 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:00:43.997865 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 03 14:00:43.997865 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 03 14:00:43.997865 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project May 03 14:00:43.997865 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return project_ref.to_dict() May 03 14:00:43.998881 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 03 14:00:43.998881 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application next(self.gen) May 03 14:00:43.998881 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 03 14:00:43.998881 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application yield resource May 03 14:00:43.998881 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 03 14:00:43.998881 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application next(self.gen) May 03 14:00:43.998881 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 03 14:00:43.998881 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application self.session.rollback() May 03 14:00:43.998881 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 03 14:00:43.998881 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application self.force_reraise() May 03 14:00:43.998881 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 03 14:00:43.998881 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application raise self.value May 03 14:00:43.998881 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 03 14:00:43.998881 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 03 14:00:43.998881 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 03 14:00:43.998881 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application session.commit() May 03 14:00:43.998881 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 03 14:00:43.999817 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 03 14:00:43.999817 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 03 14:00:43.999817 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application self._prepare_impl() May 03 14:00:43.999817 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 03 14:00:43.999817 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application self.session.flush() May 03 14:00:43.999817 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 03 14:00:43.999817 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application self._flush(objects) May 03 14:00:43.999817 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 03 14:00:43.999817 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 03 14:00:43.999817 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 03 14:00:43.999817 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application compat.raise_( May 03 14:00:43.999817 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 03 14:00:43.999817 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application raise exception May 03 14:00:43.999817 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 03 14:00:43.999817 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application flush_context.execute() May 03 14:00:43.999817 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 03 14:00:43.999817 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application rec.execute(self) May 03 14:00:44.002055 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 03 14:00:44.002055 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 03 14:00:44.002055 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 03 14:00:44.002055 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application _emit_insert_statements( May 03 14:00:44.002055 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 03 14:00:44.002055 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application c = connection._execute_20( May 03 14:00:44.002055 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 03 14:00:44.002055 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 03 14:00:44.002055 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 03 14:00:44.002055 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 03 14:00:44.002055 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 03 14:00:44.002055 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application ret = self._execute_context( May 03 14:00:44.002055 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 03 14:00:44.002055 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 03 14:00:44.002055 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 03 14:00:44.004001 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 03 14:00:44.004001 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 03 14:00:44.004001 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application raise exception May 03 14:00:44.004001 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 03 14:00:44.004001 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application self.dialect.do_execute( May 03 14:00:44.004001 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 03 14:00:44.004001 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 03 14:00:44.004001 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 03 14:00:44.004001 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application result = self._query(query) May 03 14:00:44.004001 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 03 14:00:44.004001 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application conn.query(q) May 03 14:00:44.004001 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 03 14:00:44.004001 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 03 14:00:44.004001 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 03 14:00:44.004001 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application result.read() May 03 14:00:44.004001 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 03 14:00:44.004001 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 03 14:00:44.006524 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 03 14:00:44.006524 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application packet.raise_for_error() May 03 14:00:44.006524 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 03 14:00:44.006524 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 03 14:00:44.006524 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 03 14:00:44.006524 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 03 14:00:44.006524 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 03 14:00:44.006524 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 03 14:00:44.006524 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application [parameters: {'id': '2a9fc0e9ff75499ca8fbb965ef1020b1', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 03 14:00:44.006524 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 03 14:00:44.006524 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application May 03 14:00:44.006524 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 03 14:00:44.006524 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application May 03 14:00:44.006524 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:00:44.006524 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project May 03 14:00:44.008426 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) May 03 14:00:44.008426 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 03 14:00:44.008426 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 03 14:00:44.008426 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. May 03 14:00:44.008426 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application May 03 14:00:44.008426 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 03 14:00:44.008426 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application May 03 14:00:44.008426 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:00:44.008426 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 14:00:44.008426 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 14:00:44.008426 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 14:00:44.008426 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 14:00:44.008426 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 14:00:44.008426 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 14:00:44.008426 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 14:00:44.008426 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 14:00:44.008426 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 14:00:44.012664 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 14:00:44.012664 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post May 03 14:00:44.012664 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( May 03 14:00:44.012664 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 14:00:44.012664 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 14:00:44.012664 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project May 03 14:00:44.012664 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application raise exception.Conflict( May 03 14:00:44.012664 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 2a9fc0e9ff75499ca8fbb965ef1020b1. May 03 14:00:44.012664 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application May 03 14:00:44.012664 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 463/944] 10.222.0.36 () {60 vars in 1140 bytes} [Tue May 3 14:00:43 2022] POST /identity/v3/projects => generated 262 bytes in 197 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 03 14:00:44.012664 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23af1ff5-89f6-40f2-af0f-3fbe36c60ae2 None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:44.032842 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2459199b-4e4a-4c6e-8060-a41e83a7c7f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:44.034059 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2459199b-4e4a-4c6e-8060-a41e83a7c7f0 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:44.034571 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2459199b-4e4a-4c6e-8060-a41e83a7c7f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:44.035058 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2459199b-4e4a-4c6e-8060-a41e83a7c7f0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:44.045639 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2459199b-4e4a-4c6e-8060-a41e83a7c7f0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:44.047194 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2459199b-4e4a-4c6e-8060-a41e83a7c7f0 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:44.074758 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application [None req-2459199b-4e4a-4c6e-8060-a41e83a7c7f0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 14:00:44.074758 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:00:44.074758 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 14:00:44.074758 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 14:00:44.074758 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 14:00:44.074758 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 14:00:44.074758 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 14:00:44.074758 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 14:00:44.074758 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 14:00:44.074758 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 14:00:44.074758 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 14:00:44.074758 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 14:00:44.074758 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 14:00:44.074758 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 14:00:44.074758 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 14:00:44.075934 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 14:00:44.075934 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 14:00:44.075934 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 14:00:44.075934 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 14:00:44.075934 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 14:00:44.075934 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 14:00:44.075934 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.get_or_create( May 03 14:00:44.075934 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 14:00:44.075934 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application with Lock( May 03 14:00:44.075934 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 14:00:44.075934 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._enter() May 03 14:00:44.075934 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 14:00:44.075934 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 14:00:44.075934 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 14:00:44.075934 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.creator() May 03 14:00:44.075934 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 14:00:44.075934 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application created_value = creator( May 03 14:00:44.076857 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 14:00:44.076857 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 14:00:44.076857 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 14:00:44.076857 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 14:00:44.076857 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 14:00:44.076857 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 14:00:44.076857 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 14:00:44.076857 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application May 03 14:00:44.079442 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 482/945] 10.222.0.36 () {56 vars in 1111 bytes} [Tue May 3 14:00:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 14:00:44.085200 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2459199b-4e4a-4c6e-8060-a41e83a7c7f0 None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:44.118975 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23af1ff5-89f6-40f2-af0f-3fbe36c60ae2 None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:44.160318 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8ffeca-a599-4a26-a5fc-9f7cb3fda5ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:44.161048 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8ffeca-a599-4a26-a5fc-9f7cb3fda5ed None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:44.161385 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8ffeca-a599-4a26-a5fc-9f7cb3fda5ed None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:44.161649 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8ffeca-a599-4a26-a5fc-9f7cb3fda5ed None admin] PATH_INFO: `/v3/projects/service` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:44.170556 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8ffeca-a599-4a26-a5fc-9f7cb3fda5ed None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:44.172890 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8ffeca-a599-4a26-a5fc-9f7cb3fda5ed None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:44.189639 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2459199b-4e4a-4c6e-8060-a41e83a7c7f0 None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:44.190990 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application [None req-9f8ffeca-a599-4a26-a5fc-9f7cb3fda5ed None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 14:00:44.190990 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:00:44.190990 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 14:00:44.190990 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 14:00:44.190990 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 14:00:44.190990 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 14:00:44.190990 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 14:00:44.190990 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 14:00:44.190990 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 14:00:44.190990 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 14:00:44.190990 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 14:00:44.190990 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 14:00:44.190990 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 14:00:44.190990 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 14:00:44.190990 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 14:00:44.191871 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 14:00:44.191871 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 14:00:44.191871 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 14:00:44.191871 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 14:00:44.191871 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 14:00:44.191871 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 14:00:44.191871 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.get_or_create( May 03 14:00:44.191871 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 14:00:44.191871 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application with Lock( May 03 14:00:44.191871 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 14:00:44.191871 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._enter() May 03 14:00:44.191871 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 14:00:44.191871 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 14:00:44.191871 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 14:00:44.191871 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.creator() May 03 14:00:44.191871 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 14:00:44.191871 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application created_value = creator( May 03 14:00:44.192800 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 14:00:44.192800 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 14:00:44.192800 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 14:00:44.192800 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 14:00:44.192800 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 14:00:44.192800 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 14:00:44.192800 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 14:00:44.192800 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application May 03 14:00:44.197430 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 464/946] 10.222.0.36 () {56 vars in 1111 bytes} [Tue May 3 14:00:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 14:00:44.199129 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8ffeca-a599-4a26-a5fc-9f7cb3fda5ed None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:44.237949 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c163cd5e-e11c-4841-8d15-f121b9b3907e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:44.238618 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c163cd5e-e11c-4841-8d15-f121b9b3907e None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:44.238901 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c163cd5e-e11c-4841-8d15-f121b9b3907e None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:44.239165 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c163cd5e-e11c-4841-8d15-f121b9b3907e None admin] PATH_INFO: `/v3/projects` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:44.239958 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c163cd5e-e11c-4841-8d15-f121b9b3907e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:00:44.240295 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c163cd5e-e11c-4841-8d15-f121b9b3907e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:44.242680 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c163cd5e-e11c-4841-8d15-f121b9b3907e None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:44.261923 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 483/947] 10.222.0.36 () {56 vars in 1148 bytes} [Tue May 3 14:00:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 14:00:44.264608 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c163cd5e-e11c-4841-8d15-f121b9b3907e None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:44.311103 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8ffeca-a599-4a26-a5fc-9f7cb3fda5ed None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:44.345324 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fae053e-3aee-4c65-8d87-b87264899654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:44.346360 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fae053e-3aee-4c65-8d87-b87264899654 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:44.346917 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fae053e-3aee-4c65-8d87-b87264899654 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:44.347416 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fae053e-3aee-4c65-8d87-b87264899654 None admin] PATH_INFO: `/v3/projects` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:44.348386 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fae053e-3aee-4c65-8d87-b87264899654 None admin] RBAC: Adding query filter params (name=service) {{(pid=80012) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:00:44.348896 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fae053e-3aee-4c65-8d87-b87264899654 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:44.350543 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fae053e-3aee-4c65-8d87-b87264899654 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:44.364214 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c163cd5e-e11c-4841-8d15-f121b9b3907e None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:44.373482 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 465/948] 10.222.0.36 () {56 vars in 1112 bytes} [Tue May 3 14:00:44 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:00:44.411488 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f000097-4ce9-444c-a842-7fdef8fd71af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:44.412752 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f000097-4ce9-444c-a842-7fdef8fd71af None admin] REQUEST_METHOD: `PUT` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:44.413232 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f000097-4ce9-444c-a842-7fdef8fd71af None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:44.413800 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f000097-4ce9-444c-a842-7fdef8fd71af None admin] PATH_INFO: `/v3/projects/de541be478754087934323bdbe41a579/users/dec39ff0b6544a738e5aae06e9a8cb38/roles/83dea282ec144c95979d7e1b50c52a85` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:44.417693 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f000097-4ce9-444c-a842-7fdef8fd71af None admin] RBAC: Authorizing `identity:create_grant(project_id=de541be478754087934323bdbe41a579, user_id=dec39ff0b6544a738e5aae06e9a8cb38, role_id=83dea282ec144c95979d7e1b50c52a85)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:44.419754 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f000097-4ce9-444c-a842-7fdef8fd71af None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:44.436206 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 484/949] 10.222.0.36 () {58 vars in 1439 bytes} [Tue May 3 14:00:44 2022] PUT /identity/v3/projects/de541be478754087934323bdbe41a579/users/dec39ff0b6544a738e5aae06e9a8cb38/roles/83dea282ec144c95979d7e1b50c52a85 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:00:44.849183 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192e5b5f-239e-4b28-a632-25a6b80d0540 None None] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:44.849782 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192e5b5f-239e-4b28-a632-25a6b80d0540 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:44.849782 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192e5b5f-239e-4b28-a632-25a6b80d0540 None None] PATH_INFO: `/` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:44.851425 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 466/950] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 3 14:00:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 14:00:44.856827 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ac5695-044e-4eee-b719-e622ff960c7b None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:44.857306 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ac5695-044e-4eee-b719-e622ff960c7b None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:44.857431 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ac5695-044e-4eee-b719-e622ff960c7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:44.874279 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-e1ac5695-044e-4eee-b719-e622ff960c7b None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:00:44.875741 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-e1ac5695-044e-4eee-b719-e622ff960c7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:00:44.943274 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4629fb-8a39-43d4-8185-bf153d8d7f59 None None] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:44.943553 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4629fb-8a39-43d4-8185-bf153d8d7f59 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:44.943827 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4629fb-8a39-43d4-8185-bf153d8d7f59 None None] PATH_INFO: `/` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:44.948231 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 467/951] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 3 14:00:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 14:00:44.950731 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dfaabe-505b-4b64-89e5-1af427e6147c None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:44.950963 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 485/952] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 3 14:00:44 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 14:00:44.951249 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dfaabe-505b-4b64-89e5-1af427e6147c None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:44.953458 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dfaabe-505b-4b64-89e5-1af427e6147c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:44.969542 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-a4dfaabe-505b-4b64-89e5-1af427e6147c None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:00:44.971317 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-a4dfaabe-505b-4b64-89e5-1af427e6147c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:00:44.981207 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ac5695-044e-4eee-b719-e622ff960c7b None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:45.061043 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 468/953] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 3 14:00:44 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 14:00:45.077026 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dfaabe-505b-4b64-89e5-1af427e6147c None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:45.111154 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ac5695-044e-4eee-b719-e622ff960c7b None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:45.154405 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c7e021-2289-494e-8393-0597289dde25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:45.155590 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c7e021-2289-494e-8393-0597289dde25 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:45.156063 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c7e021-2289-494e-8393-0597289dde25 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:45.156549 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c7e021-2289-494e-8393-0597289dde25 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:45.157432 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c7e021-2289-494e-8393-0597289dde25 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:45.158995 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c7e021-2289-494e-8393-0597289dde25 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:45.171440 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application [None req-36c7e021-2289-494e-8393-0597289dde25 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 03 14:00:45.171440 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:00:45.171440 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 03 14:00:45.171440 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 03 14:00:45.171440 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 03 14:00:45.171440 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 03 14:00:45.171440 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 03 14:00:45.171440 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 14:00:45.171440 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 03 14:00:45.171440 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application May 03 14:00:45.171440 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 03 14:00:45.171440 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application May 03 14:00:45.171440 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:00:45.171440 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 14:00:45.171440 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 14:00:45.171440 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 14:00:45.171440 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 14:00:45.172488 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 14:00:45.172488 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 14:00:45.172488 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 14:00:45.172488 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 14:00:45.172488 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 14:00:45.172488 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 14:00:45.172488 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 03 14:00:45.172488 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._get_service(service_id) May 03 14:00:45.172488 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 03 14:00:45.172488 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 03 14:00:45.172488 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 14:00:45.172488 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 14:00:45.172488 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 14:00:45.172488 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 14:00:45.172488 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 14:00:45.172488 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.get_or_create( May 03 14:00:45.173441 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 14:00:45.173441 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application with Lock( May 03 14:00:45.173441 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 14:00:45.173441 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._enter() May 03 14:00:45.173441 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 14:00:45.173441 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 14:00:45.173441 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 14:00:45.173441 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.creator() May 03 14:00:45.173441 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 14:00:45.173441 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application created_value = creator( May 03 14:00:45.173441 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 03 14:00:45.173441 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 14:00:45.173441 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 03 14:00:45.173441 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application May 03 14:00:45.181047 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 486/954] 10.222.0.36 () {56 vars in 1126 bytes} [Tue May 3 14:00:44 2022] GET /identity/v3/services/object-store => generated 93 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 14:00:45.182525 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c7e021-2289-494e-8393-0597289dde25 None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:45.195249 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dfaabe-505b-4b64-89e5-1af427e6147c None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:45.240487 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc4932b-bc56-4c65-ae75-ac323b278210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:45.241631 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc4932b-bc56-4c65-ae75-ac323b278210 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:45.241912 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc4932b-bc56-4c65-ae75-ac323b278210 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:45.242185 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc4932b-bc56-4c65-ae75-ac323b278210 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:45.243113 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc4932b-bc56-4c65-ae75-ac323b278210 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:45.244934 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc4932b-bc56-4c65-ae75-ac323b278210 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:45.259050 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application [None req-dbc4932b-bc56-4c65-ae75-ac323b278210 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 03 14:00:45.259050 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:00:45.259050 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 03 14:00:45.259050 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 03 14:00:45.259050 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 03 14:00:45.259050 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 03 14:00:45.259050 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 03 14:00:45.259050 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 14:00:45.259050 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 03 14:00:45.259050 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application May 03 14:00:45.259050 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 03 14:00:45.259050 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application May 03 14:00:45.259050 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:00:45.259050 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 14:00:45.259050 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 14:00:45.259050 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 14:00:45.259050 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 14:00:45.260128 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 14:00:45.260128 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 14:00:45.260128 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 14:00:45.260128 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 14:00:45.260128 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 14:00:45.260128 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 14:00:45.260128 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 03 14:00:45.260128 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._get_service(service_id) May 03 14:00:45.260128 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 03 14:00:45.260128 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 03 14:00:45.260128 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 14:00:45.260128 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 14:00:45.260128 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 14:00:45.260128 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 14:00:45.260128 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 14:00:45.260128 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.get_or_create( May 03 14:00:45.261609 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 14:00:45.261609 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application with Lock( May 03 14:00:45.261609 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 14:00:45.261609 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._enter() May 03 14:00:45.261609 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 14:00:45.261609 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 14:00:45.261609 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 14:00:45.261609 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.creator() May 03 14:00:45.261609 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 14:00:45.261609 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application created_value = creator( May 03 14:00:45.261609 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 03 14:00:45.261609 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 14:00:45.261609 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 03 14:00:45.261609 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application May 03 14:00:45.265742 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 469/955] 10.222.0.36 () {56 vars in 1111 bytes} [Tue May 3 14:00:45 2022] GET /identity/v3/services/compute => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 14:00:45.266605 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc4932b-bc56-4c65-ae75-ac323b278210 None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:45.289531 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c7e021-2289-494e-8393-0597289dde25 None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:45.323525 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68164e95-a4d9-4ab3-9dc2-f668088c9743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:45.324610 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68164e95-a4d9-4ab3-9dc2-f668088c9743 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:45.325114 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68164e95-a4d9-4ab3-9dc2-f668088c9743 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:45.325599 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68164e95-a4d9-4ab3-9dc2-f668088c9743 None admin] PATH_INFO: `/v3/services` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:45.326508 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68164e95-a4d9-4ab3-9dc2-f668088c9743 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:00:45.327004 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68164e95-a4d9-4ab3-9dc2-f668088c9743 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:45.328677 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68164e95-a4d9-4ab3-9dc2-f668088c9743 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:45.338882 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 487/956] 10.222.0.36 () {56 vars in 1122 bytes} [Tue May 3 14:00:45 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 14:00:45.340377 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68164e95-a4d9-4ab3-9dc2-f668088c9743 None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:45.366959 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc4932b-bc56-4c65-ae75-ac323b278210 None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:45.399698 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e69fd35-050c-47e9-b911-f3ec3454e688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:45.400368 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e69fd35-050c-47e9-b911-f3ec3454e688 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:45.400650 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e69fd35-050c-47e9-b911-f3ec3454e688 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:45.400924 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e69fd35-050c-47e9-b911-f3ec3454e688 None admin] PATH_INFO: `/v3/services` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:45.401657 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e69fd35-050c-47e9-b911-f3ec3454e688 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80012) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:00:45.401962 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e69fd35-050c-47e9-b911-f3ec3454e688 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:45.403613 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e69fd35-050c-47e9-b911-f3ec3454e688 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:45.413434 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 470/957] 10.222.0.36 () {56 vars in 1112 bytes} [Tue May 3 14:00:45 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:00:45.414471 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e69fd35-050c-47e9-b911-f3ec3454e688 None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:45.443307 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68164e95-a4d9-4ab3-9dc2-f668088c9743 None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:45.477650 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8794efa3-c643-4a88-9fd8-735622c90543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:45.478686 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8794efa3-c643-4a88-9fd8-735622c90543 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:45.479186 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8794efa3-c643-4a88-9fd8-735622c90543 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:45.479654 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8794efa3-c643-4a88-9fd8-735622c90543 None admin] PATH_INFO: `/v3/services` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:45.480554 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8794efa3-c643-4a88-9fd8-735622c90543 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:00:45.481167 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8794efa3-c643-4a88-9fd8-735622c90543 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:45.482766 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8794efa3-c643-4a88-9fd8-735622c90543 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:45.492904 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 488/958] 10.222.0.36 () {56 vars in 1122 bytes} [Tue May 3 14:00:45 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 14:00:45.494377 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8794efa3-c643-4a88-9fd8-735622c90543 None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:45.513797 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e69fd35-050c-47e9-b911-f3ec3454e688 None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:45.547649 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2086808-16d1-4f9c-a32e-0042b9c4bb4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:45.548674 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2086808-16d1-4f9c-a32e-0042b9c4bb4d None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:45.548674 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2086808-16d1-4f9c-a32e-0042b9c4bb4d None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:45.548862 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2086808-16d1-4f9c-a32e-0042b9c4bb4d None admin] PATH_INFO: `/v3/services` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:45.549578 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2086808-16d1-4f9c-a32e-0042b9c4bb4d None admin] RBAC: Adding query filter params (type=compute) {{(pid=80012) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:00:45.549883 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2086808-16d1-4f9c-a32e-0042b9c4bb4d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:45.551253 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2086808-16d1-4f9c-a32e-0042b9c4bb4d None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:45.556162 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 471/959] 10.222.0.36 () {56 vars in 1112 bytes} [Tue May 3 14:00:45 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:00:45.602550 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8794efa3-c643-4a88-9fd8-735622c90543 None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:45.640517 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4172fc4-0e39-4108-af7d-957085c272bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:45.641621 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4172fc4-0e39-4108-af7d-957085c272bc None admin] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:45.642135 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4172fc4-0e39-4108-af7d-957085c272bc None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:45.642630 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4172fc4-0e39-4108-af7d-957085c272bc None admin] PATH_INFO: `/v3/endpoints` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:45.643621 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4172fc4-0e39-4108-af7d-957085c272bc None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:45.645434 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4172fc4-0e39-4108-af7d-957085c272bc None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:45.673474 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 489/960] 10.222.0.36 () {60 vars in 1144 bytes} [Tue May 3 14:00:45 2022] POST /identity/v3/endpoints => generated 349 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 14:00:46.762899 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e290ba-a976-4bb9-88ca-2e7802ef3c52 None None] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:46.763432 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e290ba-a976-4bb9-88ca-2e7802ef3c52 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:46.763432 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e290ba-a976-4bb9-88ca-2e7802ef3c52 None None] PATH_INFO: `/` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:46.765105 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 472/961] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 3 14:00:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 14:00:46.770604 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f71f17d-e9ea-4ae5-b1ef-7e0432e653db None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:46.771424 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f71f17d-e9ea-4ae5-b1ef-7e0432e653db None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:46.771914 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f71f17d-e9ea-4ae5-b1ef-7e0432e653db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:46.789020 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-9f71f17d-e9ea-4ae5-b1ef-7e0432e653db None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:00:46.790529 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-9f71f17d-e9ea-4ae5-b1ef-7e0432e653db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:00:46.868653 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 490/962] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 3 14:00:46 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 14:00:46.892442 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e290ba-a976-4bb9-88ca-2e7802ef3c52 None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:46.998186 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e290ba-a976-4bb9-88ca-2e7802ef3c52 None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:47.031898 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6f40f7-4690-4609-89cd-5304e1ceea3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:47.032652 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6f40f7-4690-4609-89cd-5304e1ceea3f None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:47.032933 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6f40f7-4690-4609-89cd-5304e1ceea3f None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:47.033206 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6f40f7-4690-4609-89cd-5304e1ceea3f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:47.033538 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65757067-01b2-4a51-be93-439167aeaaa0 None None] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:47.033832 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65757067-01b2-4a51-be93-439167aeaaa0 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:47.034111 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65757067-01b2-4a51-be93-439167aeaaa0 None None] PATH_INFO: `/` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:47.035705 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 491/963] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 3 14:00:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 14:00:47.040792 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb425f0-56fc-4730-b8ee-139aa5a2fb80 None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:47.041085 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb425f0-56fc-4730-b8ee-139aa5a2fb80 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:47.041394 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb425f0-56fc-4730-b8ee-139aa5a2fb80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:47.050257 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6f40f7-4690-4609-89cd-5304e1ceea3f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 14:00:47.058595 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application [None req-1c6f40f7-4690-4609-89cd-5304e1ceea3f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 03 14:00:47.058595 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:00:47.058595 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 14:00:47.058595 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 14:00:47.058595 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 14:00:47.058595 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 14:00:47.058595 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 14:00:47.058595 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 14:00:47.058595 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 14:00:47.058595 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 14:00:47.058595 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 14:00:47.058595 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 14:00:47.058595 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 14:00:47.058595 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 14:00:47.058595 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 14:00:47.058595 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 14:00:47.059648 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 14:00:47.059648 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 14:00:47.059648 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 14:00:47.059648 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 14:00:47.059648 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 14:00:47.059648 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 14:00:47.059648 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 14:00:47.059648 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 14:00:47.059648 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 14:00:47.059648 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.get_or_create( May 03 14:00:47.059648 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 14:00:47.059648 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application with Lock( May 03 14:00:47.059648 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 14:00:47.059648 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._enter() May 03 14:00:47.059648 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 14:00:47.059648 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 14:00:47.060508 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 14:00:47.060508 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.creator() May 03 14:00:47.060508 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 14:00:47.060508 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application created_value = creator( May 03 14:00:47.060508 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 14:00:47.060508 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 14:00:47.060508 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 14:00:47.060508 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 14:00:47.060508 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 14:00:47.060508 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 14:00:47.060508 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 03 14:00:47.060508 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application May 03 14:00:47.060508 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 473/964] 10.222.0.36 () {56 vars in 1120 bytes} [Tue May 3 14:00:46 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 14:00:47.064030 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-3fb425f0-56fc-4730-b8ee-139aa5a2fb80 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:00:47.065465 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-3fb425f0-56fc-4730-b8ee-139aa5a2fb80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:00:47.068604 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6f40f7-4690-4609-89cd-5304e1ceea3f None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:47.153455 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 492/965] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 3 14:00:47 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 14:00:47.175056 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6f40f7-4690-4609-89cd-5304e1ceea3f None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:47.179780 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb425f0-56fc-4730-b8ee-139aa5a2fb80 None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:47.208704 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572589e7-935f-4db8-958b-efa2594e5d34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:47.209398 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572589e7-935f-4db8-958b-efa2594e5d34 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:47.209677 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572589e7-935f-4db8-958b-efa2594e5d34 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:47.209947 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572589e7-935f-4db8-958b-efa2594e5d34 None admin] PATH_INFO: `/v3/roles` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:47.210689 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572589e7-935f-4db8-958b-efa2594e5d34 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80012) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:00:47.210988 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572589e7-935f-4db8-958b-efa2594e5d34 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:47.212342 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572589e7-935f-4db8-958b-efa2594e5d34 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:47.226127 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 474/966] 10.222.0.36 () {56 vars in 1115 bytes} [Tue May 3 14:00:47 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:00:47.231771 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572589e7-935f-4db8-958b-efa2594e5d34 None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:47.284584 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb425f0-56fc-4730-b8ee-139aa5a2fb80 None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:47.317565 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7af089-2362-4fdd-9c58-ad6ea2e8e443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:47.318024 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7af089-2362-4fdd-9c58-ad6ea2e8e443 None admin] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:47.318301 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7af089-2362-4fdd-9c58-ad6ea2e8e443 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:47.318573 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7af089-2362-4fdd-9c58-ad6ea2e8e443 None admin] PATH_INFO: `/v3/users` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:47.319266 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7af089-2362-4fdd-9c58-ad6ea2e8e443 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:47.321391 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7af089-2362-4fdd-9c58-ad6ea2e8e443 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:47.322954 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: WARNING keystone.server.flask.common [None req-6c7af089-2362-4fdd-9c58-ad6ea2e8e443 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 03 14:00:47.335363 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.sql.core [None req-6c7af089-2362-4fdd-9c58-ad6ea2e8e443 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 03 14:00:47.335363 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 03 14:00:47.335363 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [parameters: {'user_id': '8d1d7f35456b45d987dcacf7f9925aff', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 03 14:00:47.335363 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80013) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 03 14:00:47.345024 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application [None req-6c7af089-2362-4fdd-9c58-ad6ea2e8e443 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 03 14:00:47.345024 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:00:47.345024 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 03 14:00:47.345024 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application self.dialect.do_execute( May 03 14:00:47.345024 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 03 14:00:47.345024 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 03 14:00:47.345024 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 03 14:00:47.345024 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application result = self._query(query) May 03 14:00:47.345024 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 03 14:00:47.345024 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application conn.query(q) May 03 14:00:47.345024 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 03 14:00:47.345024 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 03 14:00:47.345024 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 03 14:00:47.345024 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application result.read() May 03 14:00:47.345024 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 03 14:00:47.346042 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 03 14:00:47.346042 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 03 14:00:47.346042 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application packet.raise_for_error() May 03 14:00:47.346042 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 03 14:00:47.346042 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 03 14:00:47.346042 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 03 14:00:47.346042 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 03 14:00:47.346042 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 03 14:00:47.346042 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application May 03 14:00:47.346042 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 03 14:00:47.346042 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application May 03 14:00:47.346042 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:00:47.346042 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 03 14:00:47.346042 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 03 14:00:47.346042 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user May 03 14:00:47.346042 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) May 03 14:00:47.346042 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 03 14:00:47.346042 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application next(self.gen) May 03 14:00:47.347070 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 03 14:00:47.347070 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application yield resource May 03 14:00:47.347070 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 03 14:00:47.347070 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application next(self.gen) May 03 14:00:47.347070 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 03 14:00:47.347070 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application self.session.rollback() May 03 14:00:47.347070 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 03 14:00:47.347070 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application self.force_reraise() May 03 14:00:47.347070 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 03 14:00:47.347070 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application raise self.value May 03 14:00:47.347070 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 03 14:00:47.347070 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 03 14:00:47.347070 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 03 14:00:47.347070 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application session.commit() May 03 14:00:47.347070 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 03 14:00:47.347070 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 03 14:00:47.347070 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 03 14:00:47.348003 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application self._prepare_impl() May 03 14:00:47.348003 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 03 14:00:47.348003 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application self.session.flush() May 03 14:00:47.348003 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 03 14:00:47.348003 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application self._flush(objects) May 03 14:00:47.348003 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 03 14:00:47.348003 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 03 14:00:47.348003 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 03 14:00:47.348003 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application compat.raise_( May 03 14:00:47.348003 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 03 14:00:47.348003 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application raise exception May 03 14:00:47.348003 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 03 14:00:47.348003 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application flush_context.execute() May 03 14:00:47.348003 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 03 14:00:47.348003 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application rec.execute(self) May 03 14:00:47.348003 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 03 14:00:47.348003 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 03 14:00:47.348934 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 03 14:00:47.348934 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application _emit_insert_statements( May 03 14:00:47.348934 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements May 03 14:00:47.348934 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application result = connection._execute_20( May 03 14:00:47.348934 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 03 14:00:47.348934 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 03 14:00:47.348934 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 03 14:00:47.348934 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 03 14:00:47.348934 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 03 14:00:47.348934 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application ret = self._execute_context( May 03 14:00:47.348934 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 03 14:00:47.348934 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 03 14:00:47.348934 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 03 14:00:47.348934 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 03 14:00:47.348934 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 03 14:00:47.348934 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application raise exception May 03 14:00:47.349838 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 03 14:00:47.349838 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application self.dialect.do_execute( May 03 14:00:47.349838 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 03 14:00:47.349838 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 03 14:00:47.349838 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 03 14:00:47.349838 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application result = self._query(query) May 03 14:00:47.349838 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 03 14:00:47.349838 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application conn.query(q) May 03 14:00:47.349838 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 03 14:00:47.349838 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 03 14:00:47.349838 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 03 14:00:47.349838 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application result.read() May 03 14:00:47.349838 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 03 14:00:47.349838 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 03 14:00:47.349838 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 03 14:00:47.349838 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application packet.raise_for_error() May 03 14:00:47.350722 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 03 14:00:47.350722 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 03 14:00:47.350722 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 03 14:00:47.350722 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 03 14:00:47.350722 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 03 14:00:47.350722 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 03 14:00:47.350722 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application [parameters: {'user_id': '8d1d7f35456b45d987dcacf7f9925aff', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 03 14:00:47.350722 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 03 14:00:47.350722 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application May 03 14:00:47.350722 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 03 14:00:47.350722 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application May 03 14:00:47.350722 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:00:47.350722 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 14:00:47.350722 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 14:00:47.350722 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 14:00:47.351555 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 14:00:47.351555 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 14:00:47.351555 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 14:00:47.351555 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 14:00:47.351555 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 14:00:47.351555 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 14:00:47.351555 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 14:00:47.351555 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post May 03 14:00:47.351555 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( May 03 14:00:47.351555 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 14:00:47.351555 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 14:00:47.351555 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 14:00:47.351555 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 14:00:47.351555 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 14:00:47.351555 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 14:00:47.351555 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user May 03 14:00:47.351555 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) May 03 14:00:47.352489 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects May 03 14:00:47.352489 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) May 03 14:00:47.352489 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 03 14:00:47.352489 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 03 14:00:47.352489 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 03 14:00:47.352489 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application May 03 14:00:47.352489 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 493/967] 10.222.0.36 () {60 vars in 1131 bytes} [Tue May 3 14:00:47 2022] POST /identity/v3/users => generated 160 bytes in 167 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 03 14:00:47.352489 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7af089-2362-4fdd-9c58-ad6ea2e8e443 None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:47.370684 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572589e7-935f-4db8-958b-efa2594e5d34 None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:47.412141 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfed7b5d-736e-4f40-9188-c59b2d132bcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:47.413891 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfed7b5d-736e-4f40-9188-c59b2d132bcb None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:47.414520 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfed7b5d-736e-4f40-9188-c59b2d132bcb None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:47.415129 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfed7b5d-736e-4f40-9188-c59b2d132bcb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:47.429491 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfed7b5d-736e-4f40-9188-c59b2d132bcb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:47.431996 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfed7b5d-736e-4f40-9188-c59b2d132bcb None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:47.454090 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application [None req-dfed7b5d-736e-4f40-9188-c59b2d132bcb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 14:00:47.454090 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:00:47.454090 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 14:00:47.454090 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 14:00:47.454090 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 14:00:47.454090 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 14:00:47.454090 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 14:00:47.454090 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 14:00:47.454090 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 14:00:47.454090 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 14:00:47.454090 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 14:00:47.454090 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 14:00:47.454090 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 14:00:47.454090 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 14:00:47.454090 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 14:00:47.455082 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 14:00:47.455082 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 14:00:47.455082 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 14:00:47.455082 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 14:00:47.455082 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 14:00:47.455082 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 14:00:47.455082 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.get_or_create( May 03 14:00:47.455082 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 14:00:47.455082 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application with Lock( May 03 14:00:47.455082 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 14:00:47.455082 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._enter() May 03 14:00:47.455082 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 14:00:47.455082 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 14:00:47.455082 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 14:00:47.455082 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.creator() May 03 14:00:47.455082 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 14:00:47.455082 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application created_value = creator( May 03 14:00:47.455996 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 14:00:47.455996 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 14:00:47.455996 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 14:00:47.455996 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application May 03 14:00:47.463338 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 475/968] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 3 14:00:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 14:00:47.463934 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfed7b5d-736e-4f40-9188-c59b2d132bcb None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:47.477618 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7af089-2362-4fdd-9c58-ad6ea2e8e443 None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:47.518796 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d807f8dd-891d-4e4e-87d6-41db96244d48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:47.519829 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d807f8dd-891d-4e4e-87d6-41db96244d48 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:47.520146 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d807f8dd-891d-4e4e-87d6-41db96244d48 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:47.520382 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d807f8dd-891d-4e4e-87d6-41db96244d48 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:47.530143 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d807f8dd-891d-4e4e-87d6-41db96244d48 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:47.532119 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d807f8dd-891d-4e4e-87d6-41db96244d48 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:47.550721 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application [None req-d807f8dd-891d-4e4e-87d6-41db96244d48 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 03 14:00:47.550721 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:00:47.550721 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 14:00:47.550721 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 14:00:47.550721 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 14:00:47.550721 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 14:00:47.550721 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 14:00:47.550721 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 14:00:47.550721 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 14:00:47.550721 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 14:00:47.550721 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 14:00:47.550721 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 14:00:47.550721 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 14:00:47.550721 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 14:00:47.550721 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 14:00:47.550721 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 14:00:47.551775 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 14:00:47.551775 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 14:00:47.551775 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 14:00:47.551775 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 14:00:47.551775 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 14:00:47.551775 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 14:00:47.551775 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 14:00:47.551775 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 14:00:47.551775 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 14:00:47.551775 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.get_or_create( May 03 14:00:47.551775 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 14:00:47.551775 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application with Lock( May 03 14:00:47.551775 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 14:00:47.551775 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._enter() May 03 14:00:47.551775 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 14:00:47.551775 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 14:00:47.551775 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 14:00:47.551775 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.creator() May 03 14:00:47.552795 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 14:00:47.552795 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application created_value = creator( May 03 14:00:47.552795 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 14:00:47.552795 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 14:00:47.552795 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 14:00:47.552795 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 14:00:47.552795 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 14:00:47.552795 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 14:00:47.552795 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 03 14:00:47.552795 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application May 03 14:00:47.557098 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 494/969] 10.222.0.36 () {56 vars in 1099 bytes} [Tue May 3 14:00:47 2022] GET /identity/v3/users/cinder => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 14:00:47.557972 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d807f8dd-891d-4e4e-87d6-41db96244d48 None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:47.587834 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfed7b5d-736e-4f40-9188-c59b2d132bcb None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:47.631797 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc9f7ac-cdc6-4c85-94ec-84eb3b94d0fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:47.632471 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc9f7ac-cdc6-4c85-94ec-84eb3b94d0fd None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:47.632754 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc9f7ac-cdc6-4c85-94ec-84eb3b94d0fd None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:47.633031 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc9f7ac-cdc6-4c85-94ec-84eb3b94d0fd None admin] PATH_INFO: `/v3/domains` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:47.633870 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc9f7ac-cdc6-4c85-94ec-84eb3b94d0fd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80012) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:00:47.634202 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc9f7ac-cdc6-4c85-94ec-84eb3b94d0fd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:47.635572 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc9f7ac-cdc6-4c85-94ec-84eb3b94d0fd None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:47.653338 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 476/970] 10.222.0.36 () {56 vars in 1109 bytes} [Tue May 3 14:00:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 14:00:47.657211 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc9f7ac-cdc6-4c85-94ec-84eb3b94d0fd None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:47.669100 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d807f8dd-891d-4e4e-87d6-41db96244d48 None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:47.705177 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660ad787-98b4-4a49-9036-534a48302cd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:47.705995 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660ad787-98b4-4a49-9036-534a48302cd9 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:47.706342 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660ad787-98b4-4a49-9036-534a48302cd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:47.706684 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660ad787-98b4-4a49-9036-534a48302cd9 None admin] PATH_INFO: `/v3/users` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:47.707576 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660ad787-98b4-4a49-9036-534a48302cd9 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:00:47.707970 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660ad787-98b4-4a49-9036-534a48302cd9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:47.709619 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660ad787-98b4-4a49-9036-534a48302cd9 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:47.757805 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 495/971] 10.222.0.36 () {56 vars in 1101 bytes} [Tue May 3 14:00:47 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:00:47.790373 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc9f7ac-cdc6-4c85-94ec-84eb3b94d0fd None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:47.829348 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4baa023-354a-46f1-940a-055b2d3f28e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:47.830482 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4baa023-354a-46f1-940a-055b2d3f28e9 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:47.830976 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4baa023-354a-46f1-940a-055b2d3f28e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:47.831426 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4baa023-354a-46f1-940a-055b2d3f28e9 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:47.840401 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4baa023-354a-46f1-940a-055b2d3f28e9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:47.842251 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4baa023-354a-46f1-940a-055b2d3f28e9 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:47.858989 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application [None req-f4baa023-354a-46f1-940a-055b2d3f28e9 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 03 14:00:47.858989 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:00:47.858989 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 14:00:47.858989 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 14:00:47.858989 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 14:00:47.858989 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 14:00:47.858989 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 14:00:47.858989 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 14:00:47.858989 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 14:00:47.858989 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 14:00:47.858989 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 14:00:47.858989 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 14:00:47.858989 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 14:00:47.858989 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 14:00:47.858989 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 14:00:47.858989 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 14:00:47.860047 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 14:00:47.860047 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 14:00:47.860047 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 14:00:47.860047 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 14:00:47.860047 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 14:00:47.860047 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 14:00:47.860047 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 14:00:47.860047 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 14:00:47.860047 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 14:00:47.860047 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.get_or_create( May 03 14:00:47.860047 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 14:00:47.860047 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application with Lock( May 03 14:00:47.860047 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 14:00:47.860047 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._enter() May 03 14:00:47.860047 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 14:00:47.860047 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 14:00:47.860047 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 14:00:47.860047 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.creator() May 03 14:00:47.861031 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 14:00:47.861031 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application created_value = creator( May 03 14:00:47.861031 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 14:00:47.861031 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 14:00:47.861031 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 14:00:47.861031 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 14:00:47.861031 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 14:00:47.861031 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 14:00:47.861031 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 03 14:00:47.861031 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application May 03 14:00:47.863439 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 477/972] 10.222.0.36 () {56 vars in 1117 bytes} [Tue May 3 14:00:47 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 14:00:47.872731 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660ad787-98b4-4a49-9036-534a48302cd9 None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:47.873312 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ceeed5-460a-4283-af38-e394cc5067f5 None None] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:47.873312 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ceeed5-460a-4283-af38-e394cc5067f5 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:47.873312 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ceeed5-460a-4283-af38-e394cc5067f5 None None] PATH_INFO: `/` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:47.873312 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 478/973] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 3 14:00:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 14:00:47.878919 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb10e5a-77f3-4a00-9ad8-8ae815e7f935 None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:47.879200 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb10e5a-77f3-4a00-9ad8-8ae815e7f935 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:47.879474 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb10e5a-77f3-4a00-9ad8-8ae815e7f935 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:47.897913 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-acb10e5a-77f3-4a00-9ad8-8ae815e7f935 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:00:47.899388 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-acb10e5a-77f3-4a00-9ad8-8ae815e7f935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:00:47.977824 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 479/974] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 3 14:00:47 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 03 14:00:47.979151 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc12ee0-8810-4c33-918f-5de1c9944378 None None] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:47.979544 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc12ee0-8810-4c33-918f-5de1c9944378 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:47.979914 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc12ee0-8810-4c33-918f-5de1c9944378 None None] PATH_INFO: `/` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:47.985487 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 480/975] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 3 14:00:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 14:00:47.987124 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d1a4b8-0a0e-4ed6-8a5d-27f9b09d361a None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:47.987390 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d1a4b8-0a0e-4ed6-8a5d-27f9b09d361a None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:47.987670 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d1a4b8-0a0e-4ed6-8a5d-27f9b09d361a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:47.993109 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660ad787-98b4-4a49-9036-534a48302cd9 None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:48.006058 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-04d1a4b8-0a0e-4ed6-8a5d-27f9b09d361a None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:00:48.007341 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-04d1a4b8-0a0e-4ed6-8a5d-27f9b09d361a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:00:48.034847 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486ec09b-07eb-4112-94ec-672c7f0b189c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:48.035886 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486ec09b-07eb-4112-94ec-672c7f0b189c None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:48.036028 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486ec09b-07eb-4112-94ec-672c7f0b189c None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:48.036190 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486ec09b-07eb-4112-94ec-672c7f0b189c None admin] PATH_INFO: `/v3/users` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:48.037052 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486ec09b-07eb-4112-94ec-672c7f0b189c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:00:48.037630 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486ec09b-07eb-4112-94ec-672c7f0b189c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:48.040083 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486ec09b-07eb-4112-94ec-672c7f0b189c None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:48.063763 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 496/976] 10.222.0.36 () {56 vars in 1149 bytes} [Tue May 3 14:00:47 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:00:48.063763 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486ec09b-07eb-4112-94ec-672c7f0b189c None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:48.086054 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 481/977] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 3 14:00:47 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 14:00:48.087220 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d1a4b8-0a0e-4ed6-8a5d-27f9b09d361a None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:48.156834 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486ec09b-07eb-4112-94ec-672c7f0b189c None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:48.184731 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d1a4b8-0a0e-4ed6-8a5d-27f9b09d361a None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:48.188896 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2344965f-addc-446e-be96-c8e53e738b87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:48.189577 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2344965f-addc-446e-be96-c8e53e738b87 None admin] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:48.189851 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2344965f-addc-446e-be96-c8e53e738b87 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:48.190103 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2344965f-addc-446e-be96-c8e53e738b87 None admin] PATH_INFO: `/v3/services` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:48.190810 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2344965f-addc-446e-be96-c8e53e738b87 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:48.192155 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2344965f-addc-446e-be96-c8e53e738b87 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:48.207111 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 497/978] 10.222.0.36 () {60 vars in 1141 bytes} [Tue May 3 14:00:48 2022] POST /identity/v3/services => generated 242 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 14:00:48.208079 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2344965f-addc-446e-be96-c8e53e738b87 None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:48.228582 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd4e77b-e762-4245-9ab0-9258706bc6ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:48.229246 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd4e77b-e762-4245-9ab0-9258706bc6ed None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:48.229552 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd4e77b-e762-4245-9ab0-9258706bc6ed None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:48.229822 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd4e77b-e762-4245-9ab0-9258706bc6ed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:48.301587 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd4e77b-e762-4245-9ab0-9258706bc6ed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:48.303064 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd4e77b-e762-4245-9ab0-9258706bc6ed None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:48.314957 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2344965f-addc-446e-be96-c8e53e738b87 None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:48.351924 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75206db-129a-4873-8b0f-ce5e83fd9ff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:48.352658 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75206db-129a-4873-8b0f-ce5e83fd9ff9 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:48.352938 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75206db-129a-4873-8b0f-ce5e83fd9ff9 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:48.353195 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75206db-129a-4873-8b0f-ce5e83fd9ff9 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:48.353897 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75206db-129a-4873-8b0f-ce5e83fd9ff9 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:48.355265 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75206db-129a-4873-8b0f-ce5e83fd9ff9 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:48.372129 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application [None req-a75206db-129a-4873-8b0f-ce5e83fd9ff9 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 03 14:00:48.372129 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:00:48.372129 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 03 14:00:48.372129 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 03 14:00:48.372129 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 03 14:00:48.372129 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 03 14:00:48.372129 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 03 14:00:48.372129 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 14:00:48.372129 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 03 14:00:48.372129 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application May 03 14:00:48.372129 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 03 14:00:48.372129 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application May 03 14:00:48.372129 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:00:48.372129 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 14:00:48.372129 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 14:00:48.372129 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 14:00:48.372129 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 14:00:48.373486 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 14:00:48.373486 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 14:00:48.373486 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 14:00:48.373486 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 14:00:48.373486 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 14:00:48.373486 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 14:00:48.373486 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 03 14:00:48.373486 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._get_service(service_id) May 03 14:00:48.373486 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 03 14:00:48.373486 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 03 14:00:48.373486 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 14:00:48.373486 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 14:00:48.373486 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 14:00:48.373486 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 14:00:48.373486 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 14:00:48.373486 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.get_or_create( May 03 14:00:48.374395 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 14:00:48.374395 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application with Lock( May 03 14:00:48.374395 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 14:00:48.374395 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._enter() May 03 14:00:48.374395 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 14:00:48.374395 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 14:00:48.374395 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 14:00:48.374395 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.creator() May 03 14:00:48.374395 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 14:00:48.374395 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application created_value = creator( May 03 14:00:48.374395 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 03 14:00:48.374395 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 14:00:48.374395 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 03 14:00:48.374395 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application May 03 14:00:48.374395 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 498/979] 10.222.0.36 () {56 vars in 1126 bytes} [Tue May 3 14:00:48 2022] GET /identity/v3/services/object-store => generated 93 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 14:00:48.379877 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75206db-129a-4873-8b0f-ce5e83fd9ff9 None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:48.414765 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 482/980] 10.222.0.36 () {58 vars in 1282 bytes} [Tue May 3 14:00:48 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 03 14:00:48.420829 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd4e77b-e762-4245-9ab0-9258706bc6ed None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:48.481451 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75206db-129a-4873-8b0f-ce5e83fd9ff9 None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:48.514135 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec763976-e110-4030-a08a-8287d960fdae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:48.514813 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec763976-e110-4030-a08a-8287d960fdae None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:48.515096 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec763976-e110-4030-a08a-8287d960fdae None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:48.515369 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec763976-e110-4030-a08a-8287d960fdae None admin] PATH_INFO: `/v3/services` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:48.516075 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec763976-e110-4030-a08a-8287d960fdae None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:00:48.516382 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec763976-e110-4030-a08a-8287d960fdae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:48.517791 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec763976-e110-4030-a08a-8287d960fdae None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:48.519288 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd4e77b-e762-4245-9ab0-9258706bc6ed None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:48.522597 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 499/981] 10.222.0.36 () {56 vars in 1122 bytes} [Tue May 3 14:00:48 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:00:48.528165 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec763976-e110-4030-a08a-8287d960fdae None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:48.558299 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a229db40-6927-4aa5-806a-a166baebb43f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:48.559676 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a229db40-6927-4aa5-806a-a166baebb43f None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:48.560135 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a229db40-6927-4aa5-806a-a166baebb43f None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:48.560580 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a229db40-6927-4aa5-806a-a166baebb43f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:48.570771 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a229db40-6927-4aa5-806a-a166baebb43f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:48.572460 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a229db40-6927-4aa5-806a-a166baebb43f None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:48.591771 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application [None req-a229db40-6927-4aa5-806a-a166baebb43f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 14:00:48.591771 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:00:48.591771 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 14:00:48.591771 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 14:00:48.591771 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 14:00:48.591771 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 14:00:48.591771 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 14:00:48.591771 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 14:00:48.591771 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 14:00:48.591771 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 14:00:48.591771 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 14:00:48.591771 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 14:00:48.591771 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 14:00:48.591771 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 14:00:48.591771 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 14:00:48.592753 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 14:00:48.592753 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 14:00:48.592753 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 14:00:48.592753 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 14:00:48.592753 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 14:00:48.592753 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 14:00:48.592753 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.get_or_create( May 03 14:00:48.592753 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 14:00:48.592753 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application with Lock( May 03 14:00:48.592753 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 14:00:48.592753 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._enter() May 03 14:00:48.592753 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 14:00:48.592753 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 14:00:48.592753 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 14:00:48.592753 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.creator() May 03 14:00:48.592753 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 14:00:48.592753 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application created_value = creator( May 03 14:00:48.593711 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 14:00:48.593711 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 14:00:48.593711 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 14:00:48.593711 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application May 03 14:00:48.593711 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 483/982] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 3 14:00:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 14:00:48.599860 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a229db40-6927-4aa5-806a-a166baebb43f None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:48.635545 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec763976-e110-4030-a08a-8287d960fdae None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:48.668921 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5138d8e5-f93f-4c2a-a0ad-904a38b2de19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:48.669920 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5138d8e5-f93f-4c2a-a0ad-904a38b2de19 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:48.670413 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5138d8e5-f93f-4c2a-a0ad-904a38b2de19 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:48.670863 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5138d8e5-f93f-4c2a-a0ad-904a38b2de19 None admin] PATH_INFO: `/v3/services` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:48.671738 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5138d8e5-f93f-4c2a-a0ad-904a38b2de19 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:00:48.672227 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5138d8e5-f93f-4c2a-a0ad-904a38b2de19 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:48.673619 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5138d8e5-f93f-4c2a-a0ad-904a38b2de19 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:48.678649 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 500/983] 10.222.0.36 () {56 vars in 1122 bytes} [Tue May 3 14:00:48 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 14:00:48.684805 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5138d8e5-f93f-4c2a-a0ad-904a38b2de19 None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:48.697276 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a229db40-6927-4aa5-806a-a166baebb43f None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:48.732131 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c12d89f-7b39-4ef5-85de-6286a94a8be8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:48.732793 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c12d89f-7b39-4ef5-85de-6286a94a8be8 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:48.733034 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c12d89f-7b39-4ef5-85de-6286a94a8be8 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:48.733337 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c12d89f-7b39-4ef5-85de-6286a94a8be8 None admin] PATH_INFO: `/v3/domains` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:48.734091 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c12d89f-7b39-4ef5-85de-6286a94a8be8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80012) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:00:48.734392 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c12d89f-7b39-4ef5-85de-6286a94a8be8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:48.735749 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c12d89f-7b39-4ef5-85de-6286a94a8be8 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:48.747069 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 484/984] 10.222.0.36 () {56 vars in 1109 bytes} [Tue May 3 14:00:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 14:00:48.752512 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c12d89f-7b39-4ef5-85de-6286a94a8be8 None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:48.782818 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5138d8e5-f93f-4c2a-a0ad-904a38b2de19 None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:48.816211 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409d3b80-a60c-42db-b29c-a57391f4522e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:48.817197 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409d3b80-a60c-42db-b29c-a57391f4522e None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:48.817696 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409d3b80-a60c-42db-b29c-a57391f4522e None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:48.818029 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409d3b80-a60c-42db-b29c-a57391f4522e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:48.818885 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409d3b80-a60c-42db-b29c-a57391f4522e None admin] RBAC: Adding query filter params (interface=admin, service_id=9126136cd0d643178d5b1cf6e302e87c, region_id=RegionOne) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:00:48.819258 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409d3b80-a60c-42db-b29c-a57391f4522e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:48.820678 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409d3b80-a60c-42db-b29c-a57391f4522e None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:48.825856 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 501/985] 10.222.0.36 () {56 vars in 1249 bytes} [Tue May 3 14:00:48 2022] GET /identity/v3/endpoints?service_id=9126136cd0d643178d5b1cf6e302e87c&interface=admin®ion_id=RegionOne => generated 193 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:00:48.831087 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409d3b80-a60c-42db-b29c-a57391f4522e None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:48.845852 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c12d89f-7b39-4ef5-85de-6286a94a8be8 None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:48.878867 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572e5661-954f-4028-8ab1-e79d38ffabda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:48.879972 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572e5661-954f-4028-8ab1-e79d38ffabda None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:48.880331 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572e5661-954f-4028-8ab1-e79d38ffabda None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:48.880719 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572e5661-954f-4028-8ab1-e79d38ffabda None admin] PATH_INFO: `/v3/projects/service` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:48.887616 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572e5661-954f-4028-8ab1-e79d38ffabda None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:48.888998 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572e5661-954f-4028-8ab1-e79d38ffabda None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:48.903772 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application [None req-572e5661-954f-4028-8ab1-e79d38ffabda None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 14:00:48.903772 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:00:48.903772 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 14:00:48.903772 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 14:00:48.903772 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 14:00:48.903772 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 14:00:48.903772 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 14:00:48.903772 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 14:00:48.903772 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 14:00:48.903772 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 14:00:48.903772 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 14:00:48.903772 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 14:00:48.903772 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 14:00:48.903772 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 14:00:48.903772 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 14:00:48.904818 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 14:00:48.904818 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 14:00:48.904818 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 14:00:48.904818 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 14:00:48.904818 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 14:00:48.904818 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 14:00:48.904818 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.get_or_create( May 03 14:00:48.904818 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 14:00:48.904818 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application with Lock( May 03 14:00:48.904818 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 14:00:48.904818 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._enter() May 03 14:00:48.904818 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 14:00:48.904818 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 14:00:48.904818 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 14:00:48.904818 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.creator() May 03 14:00:48.904818 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 14:00:48.904818 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application created_value = creator( May 03 14:00:48.905829 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 14:00:48.905829 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 14:00:48.905829 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 14:00:48.905829 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 14:00:48.905829 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 14:00:48.905829 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 14:00:48.905829 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 14:00:48.905829 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application May 03 14:00:48.905829 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 485/986] 10.222.0.36 () {56 vars in 1111 bytes} [Tue May 3 14:00:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 14:00:48.910665 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572e5661-954f-4028-8ab1-e79d38ffabda None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:48.929734 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409d3b80-a60c-42db-b29c-a57391f4522e None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:48.962283 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc495712-e270-444e-8e18-9a15601aed60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:48.962948 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc495712-e270-444e-8e18-9a15601aed60 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:48.963219 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc495712-e270-444e-8e18-9a15601aed60 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:48.963803 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc495712-e270-444e-8e18-9a15601aed60 None admin] PATH_INFO: `/v3/services` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:48.964485 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc495712-e270-444e-8e18-9a15601aed60 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:48.965950 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc495712-e270-444e-8e18-9a15601aed60 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:48.977628 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 502/987] 10.222.0.36 () {56 vars in 1087 bytes} [Tue May 3 14:00:48 2022] GET /identity/v3/services => generated 1727 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 14:00:49.016084 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572e5661-954f-4028-8ab1-e79d38ffabda None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:49.054371 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fe4fe6-f124-492f-9678-e88dcef91bdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:49.055195 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fe4fe6-f124-492f-9678-e88dcef91bdf None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:49.055573 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fe4fe6-f124-492f-9678-e88dcef91bdf None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:49.055929 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fe4fe6-f124-492f-9678-e88dcef91bdf None admin] PATH_INFO: `/v3/projects` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:49.056831 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fe4fe6-f124-492f-9678-e88dcef91bdf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80012) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:00:49.057236 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fe4fe6-f124-492f-9678-e88dcef91bdf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:49.058962 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fe4fe6-f124-492f-9678-e88dcef91bdf None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:49.074979 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 486/988] 10.222.0.36 () {56 vars in 1148 bytes} [Tue May 3 14:00:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 14:00:49.081209 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc495712-e270-444e-8e18-9a15601aed60 None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:49.185389 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc495712-e270-444e-8e18-9a15601aed60 None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:49.217451 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26467190-a67e-4725-8c94-6c5503703819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:49.218111 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26467190-a67e-4725-8c94-6c5503703819 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:49.218391 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26467190-a67e-4725-8c94-6c5503703819 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:49.218684 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26467190-a67e-4725-8c94-6c5503703819 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:49.219511 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26467190-a67e-4725-8c94-6c5503703819 None admin] RBAC: Adding query filter params (role.id=83dea282ec144c95979d7e1b50c52a85, scope.project.id=de541be478754087934323bdbe41a579, user.id=dec39ff0b6544a738e5aae06e9a8cb38) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:00:49.219821 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26467190-a67e-4725-8c94-6c5503703819 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:49.221249 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26467190-a67e-4725-8c94-6c5503703819 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:49.227257 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 503/989] 10.222.0.36 () {56 vars in 1374 bytes} [Tue May 3 14:00:49 2022] GET /identity/v3/role_assignments?user.id=dec39ff0b6544a738e5aae06e9a8cb38&scope.project.id=de541be478754087934323bdbe41a579&role.id=83dea282ec144c95979d7e1b50c52a85 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:00:50.449629 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882f6e7e-6e40-43a1-983b-6de433e258f8 None None] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:50.450117 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882f6e7e-6e40-43a1-983b-6de433e258f8 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:50.450117 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882f6e7e-6e40-43a1-983b-6de433e258f8 None None] PATH_INFO: `/` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:50.451606 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 487/990] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 3 14:00:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 14:00:50.456943 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd672d2-305a-420d-b50c-848424c86453 None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:50.457714 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd672d2-305a-420d-b50c-848424c86453 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:50.458131 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd672d2-305a-420d-b50c-848424c86453 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:50.475611 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-9fd672d2-305a-420d-b50c-848424c86453 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:00:50.477334 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-9fd672d2-305a-420d-b50c-848424c86453 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:00:50.545333 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 504/991] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 3 14:00:50 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 14:00:50.564485 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882f6e7e-6e40-43a1-983b-6de433e258f8 None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:50.667382 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882f6e7e-6e40-43a1-983b-6de433e258f8 None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:50.700551 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ead93b8-3a67-497d-9bef-b21f40484044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:50.701272 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ead93b8-3a67-497d-9bef-b21f40484044 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:50.701574 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ead93b8-3a67-497d-9bef-b21f40484044 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:50.701843 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ead93b8-3a67-497d-9bef-b21f40484044 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:50.702499 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ead93b8-3a67-497d-9bef-b21f40484044 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:50.703880 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ead93b8-3a67-497d-9bef-b21f40484044 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:50.716510 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application [None req-6ead93b8-3a67-497d-9bef-b21f40484044 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 03 14:00:50.716510 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:00:50.716510 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 03 14:00:50.716510 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 03 14:00:50.716510 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 03 14:00:50.716510 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 03 14:00:50.716510 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 03 14:00:50.716510 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 14:00:50.716510 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 03 14:00:50.716510 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application May 03 14:00:50.716510 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 03 14:00:50.716510 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application May 03 14:00:50.716510 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:00:50.716510 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 14:00:50.716510 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 14:00:50.716510 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 14:00:50.716510 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 14:00:50.717807 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 14:00:50.717807 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 14:00:50.717807 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 14:00:50.717807 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 14:00:50.717807 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 14:00:50.717807 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 14:00:50.717807 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 03 14:00:50.717807 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._get_service(service_id) May 03 14:00:50.717807 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 03 14:00:50.717807 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 03 14:00:50.717807 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 14:00:50.717807 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 14:00:50.717807 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 14:00:50.717807 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 14:00:50.717807 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 14:00:50.717807 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.get_or_create( May 03 14:00:50.718697 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 14:00:50.718697 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application with Lock( May 03 14:00:50.718697 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 14:00:50.718697 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._enter() May 03 14:00:50.718697 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 14:00:50.718697 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 14:00:50.718697 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 14:00:50.718697 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.creator() May 03 14:00:50.718697 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 14:00:50.718697 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application created_value = creator( May 03 14:00:50.718697 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 03 14:00:50.718697 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 14:00:50.718697 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 03 14:00:50.718697 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application May 03 14:00:50.718697 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 488/992] 10.222.0.36 () {56 vars in 1111 bytes} [Tue May 3 14:00:50 2022] GET /identity/v3/services/compute => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 14:00:50.725479 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd672d2-305a-420d-b50c-848424c86453 None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:50.821303 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd672d2-305a-420d-b50c-848424c86453 None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:50.856724 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab784d01-cce8-40aa-949d-38f02ba4a6ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:50.857406 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab784d01-cce8-40aa-949d-38f02ba4a6ed None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:50.857682 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab784d01-cce8-40aa-949d-38f02ba4a6ed None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:50.857956 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab784d01-cce8-40aa-949d-38f02ba4a6ed None admin] PATH_INFO: `/v3/services` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:50.858662 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab784d01-cce8-40aa-949d-38f02ba4a6ed None admin] RBAC: Adding query filter params (name=compute) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:00:50.858965 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab784d01-cce8-40aa-949d-38f02ba4a6ed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:50.860332 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab784d01-cce8-40aa-949d-38f02ba4a6ed None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:50.865236 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 505/993] 10.222.0.36 () {56 vars in 1112 bytes} [Tue May 3 14:00:50 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:00:50.870812 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ead93b8-3a67-497d-9bef-b21f40484044 None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:50.975740 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ead93b8-3a67-497d-9bef-b21f40484044 None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:51.008367 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12542116-6b02-41d7-bff1-618c3b89e2ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:51.009029 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12542116-6b02-41d7-bff1-618c3b89e2ee None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:51.009315 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12542116-6b02-41d7-bff1-618c3b89e2ee None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:51.009599 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12542116-6b02-41d7-bff1-618c3b89e2ee None admin] PATH_INFO: `/v3/services` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:51.010303 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12542116-6b02-41d7-bff1-618c3b89e2ee None admin] RBAC: Adding query filter params (type=compute) {{(pid=80012) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:00:51.010605 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12542116-6b02-41d7-bff1-618c3b89e2ee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:51.011991 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12542116-6b02-41d7-bff1-618c3b89e2ee None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:51.016866 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 489/994] 10.222.0.36 () {56 vars in 1112 bytes} [Tue May 3 14:00:50 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:00:51.022599 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab784d01-cce8-40aa-949d-38f02ba4a6ed None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:51.136803 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab784d01-cce8-40aa-949d-38f02ba4a6ed None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:51.171235 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e395f33d-37d5-4ee5-8710-23491dc5bc58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:51.171939 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e395f33d-37d5-4ee5-8710-23491dc5bc58 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:51.172220 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e395f33d-37d5-4ee5-8710-23491dc5bc58 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:51.172491 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e395f33d-37d5-4ee5-8710-23491dc5bc58 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:51.173273 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e395f33d-37d5-4ee5-8710-23491dc5bc58 None admin] RBAC: Adding query filter params (interface=public, service_id=2ca162bad9524443acf9bda9b617bd6f, region_id=RegionOne) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:00:51.173607 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e395f33d-37d5-4ee5-8710-23491dc5bc58 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:51.174972 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e395f33d-37d5-4ee5-8710-23491dc5bc58 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:51.180110 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 506/995] 10.222.0.36 () {56 vars in 1251 bytes} [Tue May 3 14:00:51 2022] GET /identity/v3/endpoints?service_id=2ca162bad9524443acf9bda9b617bd6f&interface=public®ion_id=RegionOne => generated 194 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:00:51.185660 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12542116-6b02-41d7-bff1-618c3b89e2ee None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:51.227433 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0367088-0e6e-49c3-8c1c-5b649fddd96b None None] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:51.227622 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0367088-0e6e-49c3-8c1c-5b649fddd96b None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:51.227907 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0367088-0e6e-49c3-8c1c-5b649fddd96b None None] PATH_INFO: `/` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:51.229433 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 507/996] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 3 14:00:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 14:00:51.234719 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc246ac-0618-4c70-8e36-2212a728b8d4 None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:51.234995 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc246ac-0618-4c70-8e36-2212a728b8d4 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:51.235277 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc246ac-0618-4c70-8e36-2212a728b8d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:51.251980 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-9fc246ac-0618-4c70-8e36-2212a728b8d4 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:00:51.253156 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-9fc246ac-0618-4c70-8e36-2212a728b8d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:00:51.284344 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12542116-6b02-41d7-bff1-618c3b89e2ee None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:51.319801 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be63c1f-7bce-436e-97a8-8cca29f60ef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:51.320483 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be63c1f-7bce-436e-97a8-8cca29f60ef0 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:51.320767 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be63c1f-7bce-436e-97a8-8cca29f60ef0 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:51.321047 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be63c1f-7bce-436e-97a8-8cca29f60ef0 None admin] PATH_INFO: `/v3/services` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:51.321764 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be63c1f-7bce-436e-97a8-8cca29f60ef0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:51.323159 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be63c1f-7bce-436e-97a8-8cca29f60ef0 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:51.325161 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 508/997] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 3 14:00:51 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 03 14:00:51.334642 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 490/998] 10.222.0.36 () {56 vars in 1087 bytes} [Tue May 3 14:00:51 2022] GET /identity/v3/services => generated 1727 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 14:00:51.349057 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc246ac-0618-4c70-8e36-2212a728b8d4 None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:51.452090 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc246ac-0618-4c70-8e36-2212a728b8d4 None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:51.488938 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608ee9bb-ef50-40f9-a0b2-5592261cc475 None None] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:51.489508 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608ee9bb-ef50-40f9-a0b2-5592261cc475 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:51.489508 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608ee9bb-ef50-40f9-a0b2-5592261cc475 None None] PATH_INFO: `/` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:51.490958 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 491/999] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 3 14:00:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 14:00:51.491232 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d851d82e-11da-40d8-847d-581612fdc432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:51.492121 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d851d82e-11da-40d8-847d-581612fdc432 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:51.492390 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d851d82e-11da-40d8-847d-581612fdc432 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:51.492665 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d851d82e-11da-40d8-847d-581612fdc432 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:51.493335 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d851d82e-11da-40d8-847d-581612fdc432 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:51.494936 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d851d82e-11da-40d8-847d-581612fdc432 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:51.496387 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16cade8-abbd-49a7-a66e-08bb25f5cd0c None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:51.496654 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16cade8-abbd-49a7-a66e-08bb25f5cd0c None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:51.496920 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16cade8-abbd-49a7-a66e-08bb25f5cd0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:51.507942 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application [None req-d851d82e-11da-40d8-847d-581612fdc432 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 03 14:00:51.507942 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:00:51.507942 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 03 14:00:51.507942 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 03 14:00:51.507942 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 03 14:00:51.507942 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 03 14:00:51.507942 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 03 14:00:51.507942 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 14:00:51.507942 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 03 14:00:51.507942 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application May 03 14:00:51.507942 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 03 14:00:51.507942 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application May 03 14:00:51.507942 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:00:51.507942 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 14:00:51.507942 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 14:00:51.507942 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 14:00:51.507942 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 14:00:51.509064 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 14:00:51.509064 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 14:00:51.509064 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 14:00:51.509064 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 14:00:51.509064 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 14:00:51.509064 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 14:00:51.509064 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 03 14:00:51.509064 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._get_service(service_id) May 03 14:00:51.509064 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 03 14:00:51.509064 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 03 14:00:51.509064 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 14:00:51.509064 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 14:00:51.509064 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 14:00:51.509064 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 14:00:51.509064 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 14:00:51.509064 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.get_or_create( May 03 14:00:51.514228 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 14:00:51.514228 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application with Lock( May 03 14:00:51.514228 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 14:00:51.514228 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._enter() May 03 14:00:51.514228 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 14:00:51.514228 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 14:00:51.514228 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 14:00:51.514228 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.creator() May 03 14:00:51.514228 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 14:00:51.514228 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application created_value = creator( May 03 14:00:51.514228 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 03 14:00:51.514228 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 14:00:51.514228 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 03 14:00:51.514228 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application May 03 14:00:51.514228 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 509/1000] 10.222.0.36 () {56 vars in 1126 bytes} [Tue May 3 14:00:51 2022] GET /identity/v3/services/object-store => generated 93 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 14:00:51.515073 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-a16cade8-abbd-49a7-a66e-08bb25f5cd0c None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:00:51.515269 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-a16cade8-abbd-49a7-a66e-08bb25f5cd0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:00:51.517974 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d851d82e-11da-40d8-847d-581612fdc432 None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:51.582304 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 492/1001] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 3 14:00:51 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 03 14:00:51.604333 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16cade8-abbd-49a7-a66e-08bb25f5cd0c None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:51.617605 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d851d82e-11da-40d8-847d-581612fdc432 None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:51.654585 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d259cc3f-c9d5-4a0b-b638-f716b76f0b59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:51.655254 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d259cc3f-c9d5-4a0b-b638-f716b76f0b59 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:51.655535 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d259cc3f-c9d5-4a0b-b638-f716b76f0b59 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:51.655810 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d259cc3f-c9d5-4a0b-b638-f716b76f0b59 None admin] PATH_INFO: `/v3/services` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:51.656525 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d259cc3f-c9d5-4a0b-b638-f716b76f0b59 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:00:51.656825 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d259cc3f-c9d5-4a0b-b638-f716b76f0b59 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:51.658231 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d259cc3f-c9d5-4a0b-b638-f716b76f0b59 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:51.663016 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 510/1002] 10.222.0.36 () {56 vars in 1122 bytes} [Tue May 3 14:00:51 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:00:51.668438 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d259cc3f-c9d5-4a0b-b638-f716b76f0b59 None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:51.699038 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16cade8-abbd-49a7-a66e-08bb25f5cd0c None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:51.733841 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2687a20-a2d2-4bf1-8bf2-ced0952403dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:51.734640 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2687a20-a2d2-4bf1-8bf2-ced0952403dc None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:51.734918 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2687a20-a2d2-4bf1-8bf2-ced0952403dc None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:51.735193 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2687a20-a2d2-4bf1-8bf2-ced0952403dc None admin] PATH_INFO: `/v3/services/image` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:51.735838 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2687a20-a2d2-4bf1-8bf2-ced0952403dc None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:51.737208 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2687a20-a2d2-4bf1-8bf2-ced0952403dc None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:51.748755 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application [None req-c2687a20-a2d2-4bf1-8bf2-ced0952403dc None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 03 14:00:51.748755 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:00:51.748755 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 03 14:00:51.748755 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 03 14:00:51.748755 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 03 14:00:51.748755 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 03 14:00:51.748755 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 03 14:00:51.748755 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 14:00:51.748755 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 03 14:00:51.748755 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application May 03 14:00:51.748755 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 03 14:00:51.748755 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application May 03 14:00:51.748755 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:00:51.748755 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 14:00:51.748755 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 14:00:51.748755 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 14:00:51.748755 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 14:00:51.749994 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 14:00:51.749994 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 14:00:51.749994 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 14:00:51.749994 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 14:00:51.749994 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 14:00:51.749994 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 14:00:51.749994 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 03 14:00:51.749994 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._get_service(service_id) May 03 14:00:51.749994 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 03 14:00:51.749994 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 03 14:00:51.749994 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 14:00:51.749994 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 14:00:51.749994 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 14:00:51.749994 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 14:00:51.749994 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 14:00:51.749994 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.get_or_create( May 03 14:00:51.750995 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 14:00:51.750995 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application with Lock( May 03 14:00:51.750995 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 14:00:51.750995 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._enter() May 03 14:00:51.750995 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 14:00:51.750995 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 14:00:51.750995 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 14:00:51.750995 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.creator() May 03 14:00:51.750995 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 14:00:51.750995 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application created_value = creator( May 03 14:00:51.750995 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 03 14:00:51.750995 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 14:00:51.750995 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 03 14:00:51.750995 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application May 03 14:00:51.750995 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 493/1003] 10.222.0.36 () {56 vars in 1105 bytes} [Tue May 3 14:00:51 2022] GET /identity/v3/services/image => generated 86 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 14:00:51.755662 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2687a20-a2d2-4bf1-8bf2-ced0952403dc None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:51.769733 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d259cc3f-c9d5-4a0b-b638-f716b76f0b59 None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:51.802746 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10730fa4-84c0-44ee-b5dc-8c338130a95e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:51.803403 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10730fa4-84c0-44ee-b5dc-8c338130a95e None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:51.803681 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10730fa4-84c0-44ee-b5dc-8c338130a95e None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:51.803937 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10730fa4-84c0-44ee-b5dc-8c338130a95e None admin] PATH_INFO: `/v3/services` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:51.804653 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10730fa4-84c0-44ee-b5dc-8c338130a95e None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:00:51.804959 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10730fa4-84c0-44ee-b5dc-8c338130a95e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:51.806349 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10730fa4-84c0-44ee-b5dc-8c338130a95e None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:51.811198 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 511/1004] 10.222.0.36 () {56 vars in 1122 bytes} [Tue May 3 14:00:51 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 14:00:51.816769 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10730fa4-84c0-44ee-b5dc-8c338130a95e None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:51.852665 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2687a20-a2d2-4bf1-8bf2-ced0952403dc None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:51.886719 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e389ae-a46f-42de-bd68-af79d3d358e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:51.887408 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e389ae-a46f-42de-bd68-af79d3d358e2 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:51.887685 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e389ae-a46f-42de-bd68-af79d3d358e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:51.887959 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e389ae-a46f-42de-bd68-af79d3d358e2 None admin] PATH_INFO: `/v3/services` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:51.888669 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e389ae-a46f-42de-bd68-af79d3d358e2 None admin] RBAC: Adding query filter params (name=image) {{(pid=80012) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:00:51.888968 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e389ae-a46f-42de-bd68-af79d3d358e2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:51.890358 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e389ae-a46f-42de-bd68-af79d3d358e2 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:51.899552 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 494/1005] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 3 14:00:51 2022] GET /identity/v3/services?name=image => generated 122 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 14:00:51.900502 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e389ae-a46f-42de-bd68-af79d3d358e2 None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:51.917118 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10730fa4-84c0-44ee-b5dc-8c338130a95e None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:51.950429 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7547d39-7885-4e2e-8aa3-084f8705aded None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:51.951081 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7547d39-7885-4e2e-8aa3-084f8705aded None admin] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:51.951365 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7547d39-7885-4e2e-8aa3-084f8705aded None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:51.951637 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7547d39-7885-4e2e-8aa3-084f8705aded None admin] PATH_INFO: `/v3/endpoints` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:51.952359 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7547d39-7885-4e2e-8aa3-084f8705aded None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:51.953755 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7547d39-7885-4e2e-8aa3-084f8705aded None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:51.969315 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 512/1006] 10.222.0.36 () {60 vars in 1144 bytes} [Tue May 3 14:00:51 2022] POST /identity/v3/endpoints => generated 325 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 14:00:52.004038 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e389ae-a46f-42de-bd68-af79d3d358e2 None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:52.047260 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134aa497-991d-4557-a5af-2545e9592140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:52.047943 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134aa497-991d-4557-a5af-2545e9592140 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:52.048224 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134aa497-991d-4557-a5af-2545e9592140 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:52.048502 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134aa497-991d-4557-a5af-2545e9592140 None admin] PATH_INFO: `/v3/services` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:52.049228 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134aa497-991d-4557-a5af-2545e9592140 None admin] RBAC: Adding query filter params (type=image) {{(pid=80012) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:00:52.049567 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134aa497-991d-4557-a5af-2545e9592140 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:52.050982 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134aa497-991d-4557-a5af-2545e9592140 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:52.068516 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 495/1007] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 3 14:00:51 2022] GET /identity/v3/services?type=image => generated 122 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:00:53.569304 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9c1c90-ea9c-4808-8df3-78d21d56dd6d None None] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:53.569864 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9c1c90-ea9c-4808-8df3-78d21d56dd6d None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:53.569864 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9c1c90-ea9c-4808-8df3-78d21d56dd6d None None] PATH_INFO: `/` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:53.571206 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 513/1008] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 3 14:00:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 14:00:53.576668 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34958f5-1e4a-4c48-acaf-7d49c1acd1d7 None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:53.577110 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34958f5-1e4a-4c48-acaf-7d49c1acd1d7 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:53.577205 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34958f5-1e4a-4c48-acaf-7d49c1acd1d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:53.594311 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-c34958f5-1e4a-4c48-acaf-7d49c1acd1d7 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:00:53.595464 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-c34958f5-1e4a-4c48-acaf-7d49c1acd1d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:00:53.661301 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 496/1009] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 3 14:00:53 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 03 14:00:53.684071 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9c1c90-ea9c-4808-8df3-78d21d56dd6d None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:53.787097 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9c1c90-ea9c-4808-8df3-78d21d56dd6d None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:53.819008 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b53fba-dee2-455f-8b3e-eec52634be4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:53.819936 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b53fba-dee2-455f-8b3e-eec52634be4e None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:53.820135 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b53fba-dee2-455f-8b3e-eec52634be4e None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:53.820370 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b53fba-dee2-455f-8b3e-eec52634be4e None admin] PATH_INFO: `/v3/services/compute` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:53.821007 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b53fba-dee2-455f-8b3e-eec52634be4e None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:53.822402 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b53fba-dee2-455f-8b3e-eec52634be4e None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:53.834084 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application [None req-87b53fba-dee2-455f-8b3e-eec52634be4e None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 03 14:00:53.834084 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:00:53.834084 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 03 14:00:53.834084 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 03 14:00:53.834084 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 03 14:00:53.834084 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 03 14:00:53.834084 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 03 14:00:53.834084 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 14:00:53.834084 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 03 14:00:53.834084 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application May 03 14:00:53.834084 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 03 14:00:53.834084 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application May 03 14:00:53.834084 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:00:53.834084 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 14:00:53.834084 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 14:00:53.834084 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 14:00:53.834084 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 14:00:53.835091 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 14:00:53.835091 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 14:00:53.835091 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 14:00:53.835091 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 14:00:53.835091 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 14:00:53.835091 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 14:00:53.835091 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 03 14:00:53.835091 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._get_service(service_id) May 03 14:00:53.835091 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 03 14:00:53.835091 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 03 14:00:53.835091 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 14:00:53.835091 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 14:00:53.835091 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 14:00:53.835091 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 14:00:53.835091 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 14:00:53.835091 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.get_or_create( May 03 14:00:53.841529 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 14:00:53.841529 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application with Lock( May 03 14:00:53.841529 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 14:00:53.841529 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._enter() May 03 14:00:53.841529 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 14:00:53.841529 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 14:00:53.841529 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 14:00:53.841529 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.creator() May 03 14:00:53.841529 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 14:00:53.841529 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application created_value = creator( May 03 14:00:53.841529 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 03 14:00:53.841529 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 14:00:53.841529 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 03 14:00:53.841529 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application May 03 14:00:53.841529 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 514/1010] 10.222.0.36 () {56 vars in 1111 bytes} [Tue May 3 14:00:53 2022] GET /identity/v3/services/compute => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 14:00:53.842358 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34958f5-1e4a-4c48-acaf-7d49c1acd1d7 None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:53.939081 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34958f5-1e4a-4c48-acaf-7d49c1acd1d7 None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:53.973417 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee89873-ba18-41a8-a245-7bd51b64177f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:53.974080 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee89873-ba18-41a8-a245-7bd51b64177f None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:53.974358 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee89873-ba18-41a8-a245-7bd51b64177f None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:53.974632 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee89873-ba18-41a8-a245-7bd51b64177f None admin] PATH_INFO: `/v3/services` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:53.975333 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee89873-ba18-41a8-a245-7bd51b64177f None admin] RBAC: Adding query filter params (name=compute) {{(pid=80012) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:00:53.975636 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee89873-ba18-41a8-a245-7bd51b64177f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:53.976991 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee89873-ba18-41a8-a245-7bd51b64177f None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:53.981947 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 497/1011] 10.222.0.36 () {56 vars in 1112 bytes} [Tue May 3 14:00:53 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 14:00:53.987530 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b53fba-dee2-455f-8b3e-eec52634be4e None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:54.103858 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b53fba-dee2-455f-8b3e-eec52634be4e None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:54.139425 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59e7da9-0e50-4a22-80ef-ab0ed7d9d28b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:54.140090 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59e7da9-0e50-4a22-80ef-ab0ed7d9d28b None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:54.140365 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59e7da9-0e50-4a22-80ef-ab0ed7d9d28b None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:54.140638 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59e7da9-0e50-4a22-80ef-ab0ed7d9d28b None admin] PATH_INFO: `/v3/services` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:54.141363 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59e7da9-0e50-4a22-80ef-ab0ed7d9d28b None admin] RBAC: Adding query filter params (type=compute) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:00:54.141669 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59e7da9-0e50-4a22-80ef-ab0ed7d9d28b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:54.143039 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59e7da9-0e50-4a22-80ef-ab0ed7d9d28b None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:54.148131 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 515/1012] 10.222.0.36 () {56 vars in 1112 bytes} [Tue May 3 14:00:53 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:00:54.153798 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee89873-ba18-41a8-a245-7bd51b64177f None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:54.222292 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8251c9f1-371e-4738-b126-b8009f564ee9 None None] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:54.222536 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8251c9f1-371e-4738-b126-b8009f564ee9 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:54.222829 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8251c9f1-371e-4738-b126-b8009f564ee9 None None] PATH_INFO: `/` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:54.224356 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 516/1013] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 3 14:00:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 14:00:54.230173 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe40ee4-bb19-4ae2-a84f-2bff4600c793 None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:54.230419 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe40ee4-bb19-4ae2-a84f-2bff4600c793 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:54.230773 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe40ee4-bb19-4ae2-a84f-2bff4600c793 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:54.247130 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-afe40ee4-bb19-4ae2-a84f-2bff4600c793 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:00:54.248306 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-afe40ee4-bb19-4ae2-a84f-2bff4600c793 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:00:54.250681 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee89873-ba18-41a8-a245-7bd51b64177f None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:54.284185 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dd271b-a7e1-4e3c-9c68-60c1f7d454dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:54.284838 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dd271b-a7e1-4e3c-9c68-60c1f7d454dc None admin] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:54.285108 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dd271b-a7e1-4e3c-9c68-60c1f7d454dc None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:54.285407 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dd271b-a7e1-4e3c-9c68-60c1f7d454dc None admin] PATH_INFO: `/v3/endpoints` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:54.286151 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99dd271b-a7e1-4e3c-9c68-60c1f7d454dc None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:54.287523 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99dd271b-a7e1-4e3c-9c68-60c1f7d454dc None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:54.305942 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 498/1014] 10.222.0.36 () {60 vars in 1144 bytes} [Tue May 3 14:00:54 2022] POST /identity/v3/endpoints => generated 334 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 14:00:54.307269 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3946610-8f0e-4d25-b7e2-125dc1242233 None None] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:54.307569 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3946610-8f0e-4d25-b7e2-125dc1242233 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:54.307844 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3946610-8f0e-4d25-b7e2-125dc1242233 None None] PATH_INFO: `/` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:54.309120 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 499/1015] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 3 14:00:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 14:00:54.314922 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25389394-9804-46d9-81ee-5164c1e9fc16 None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:54.315212 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25389394-9804-46d9-81ee-5164c1e9fc16 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:54.315492 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25389394-9804-46d9-81ee-5164c1e9fc16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:54.329417 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 517/1016] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 3 14:00:54 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 03 14:00:54.333693 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-25389394-9804-46d9-81ee-5164c1e9fc16 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:00:54.334899 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-25389394-9804-46d9-81ee-5164c1e9fc16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:00:54.351134 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe40ee4-bb19-4ae2-a84f-2bff4600c793 None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:54.408735 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 500/1017] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 3 14:00:54 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 03 14:00:54.431332 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25389394-9804-46d9-81ee-5164c1e9fc16 None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:54.455768 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe40ee4-bb19-4ae2-a84f-2bff4600c793 None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:54.490846 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7142874-d5cc-49bb-91bf-a115040f2ad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:54.491663 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7142874-d5cc-49bb-91bf-a115040f2ad1 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:54.491937 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7142874-d5cc-49bb-91bf-a115040f2ad1 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:54.492205 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7142874-d5cc-49bb-91bf-a115040f2ad1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:54.494058 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7142874-d5cc-49bb-91bf-a115040f2ad1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:54.494890 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7142874-d5cc-49bb-91bf-a115040f2ad1 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:54.502182 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 518/1018] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 3 14:00:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 14:00:54.502521 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7142874-d5cc-49bb-91bf-a115040f2ad1 None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:54.534629 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25389394-9804-46d9-81ee-5164c1e9fc16 None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:54.568450 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bbb96d-951f-406a-85ce-5f7ddc285d98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:54.569120 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bbb96d-951f-406a-85ce-5f7ddc285d98 None admin] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:54.569439 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bbb96d-951f-406a-85ce-5f7ddc285d98 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:54.569713 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bbb96d-951f-406a-85ce-5f7ddc285d98 None admin] PATH_INFO: `/v3/services` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:54.570915 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bbb96d-951f-406a-85ce-5f7ddc285d98 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:54.572151 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bbb96d-951f-406a-85ce-5f7ddc285d98 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:54.586958 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 501/1019] 10.222.0.36 () {60 vars in 1141 bytes} [Tue May 3 14:00:54 2022] POST /identity/v3/services => generated 242 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 14:00:54.618272 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7142874-d5cc-49bb-91bf-a115040f2ad1 None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:54.663112 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0bbdf4-5aea-43f0-8446-0785e197b000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:54.663697 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0bbdf4-5aea-43f0-8446-0785e197b000 None admin] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:54.663976 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0bbdf4-5aea-43f0-8446-0785e197b000 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:54.664251 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0bbdf4-5aea-43f0-8446-0785e197b000 None admin] PATH_INFO: `/v3/projects` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:54.664956 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0bbdf4-5aea-43f0-8446-0785e197b000 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:54.666430 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0bbdf4-5aea-43f0-8446-0785e197b000 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:54.705369 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 519/1020] 10.222.0.36 () {60 vars in 1141 bytes} [Tue May 3 14:00:54 2022] POST /identity/v3/projects => generated 311 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 14:00:56.641303 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdfea54-a4a9-4c7b-b2d7-532bdd6814f9 None None] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:56.641874 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdfea54-a4a9-4c7b-b2d7-532bdd6814f9 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:56.641874 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdfea54-a4a9-4c7b-b2d7-532bdd6814f9 None None] PATH_INFO: `/` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:56.643614 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 502/1021] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 3 14:00:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 14:00:56.649818 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47da52ea-b1ae-4bcb-b3d9-be7d5f9a187d None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:56.650405 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47da52ea-b1ae-4bcb-b3d9-be7d5f9a187d None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:56.650405 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47da52ea-b1ae-4bcb-b3d9-be7d5f9a187d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:56.668861 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-47da52ea-b1ae-4bcb-b3d9-be7d5f9a187d None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:00:56.670243 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-47da52ea-b1ae-4bcb-b3d9-be7d5f9a187d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:00:56.739704 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 520/1022] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 3 14:00:56 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 14:00:56.763282 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdfea54-a4a9-4c7b-b2d7-532bdd6814f9 None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:56.839869 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaac8a53-5827-407f-8825-c748209d56e7 None None] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:56.841361 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaac8a53-5827-407f-8825-c748209d56e7 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:56.841361 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaac8a53-5827-407f-8825-c748209d56e7 None None] PATH_INFO: `/` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:56.842128 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 521/1023] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 3 14:00:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 14:00:56.847047 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2c3d2f-1ff0-4c91-9c80-f9c094136090 None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:56.847318 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2c3d2f-1ff0-4c91-9c80-f9c094136090 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:56.847609 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2c3d2f-1ff0-4c91-9c80-f9c094136090 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:56.865422 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-1d2c3d2f-1ff0-4c91-9c80-f9c094136090 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:00:56.866891 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-1d2c3d2f-1ff0-4c91-9c80-f9c094136090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:00:56.870953 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdfea54-a4a9-4c7b-b2d7-532bdd6814f9 None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:56.905171 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab1ea6c-c4b6-42d5-bf09-04a3a918708f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:56.906252 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab1ea6c-c4b6-42d5-bf09-04a3a918708f None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:56.906533 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab1ea6c-c4b6-42d5-bf09-04a3a918708f None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:56.906807 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab1ea6c-c4b6-42d5-bf09-04a3a918708f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:56.917249 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab1ea6c-c4b6-42d5-bf09-04a3a918708f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 14:00:56.925543 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application [None req-7ab1ea6c-c4b6-42d5-bf09-04a3a918708f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 03 14:00:56.925543 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:00:56.925543 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 14:00:56.925543 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 14:00:56.925543 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 14:00:56.925543 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 14:00:56.925543 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 14:00:56.925543 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 14:00:56.925543 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 14:00:56.925543 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 14:00:56.925543 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 14:00:56.925543 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 14:00:56.925543 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 14:00:56.925543 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 14:00:56.925543 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 14:00:56.925543 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 14:00:56.926550 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 14:00:56.926550 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 14:00:56.926550 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 14:00:56.926550 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 14:00:56.926550 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 14:00:56.926550 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 14:00:56.926550 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 14:00:56.926550 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 14:00:56.926550 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 14:00:56.926550 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.get_or_create( May 03 14:00:56.926550 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 14:00:56.926550 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application with Lock( May 03 14:00:56.926550 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 14:00:56.926550 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._enter() May 03 14:00:56.926550 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 14:00:56.926550 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 14:00:56.927453 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 14:00:56.927453 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.creator() May 03 14:00:56.927453 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 14:00:56.927453 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application created_value = creator( May 03 14:00:56.927453 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 14:00:56.927453 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 14:00:56.927453 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 14:00:56.927453 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 14:00:56.927453 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 14:00:56.927453 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 14:00:56.927453 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 03 14:00:56.927453 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application May 03 14:00:56.927453 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 503/1024] 10.222.0.36 () {56 vars in 1120 bytes} [Tue May 3 14:00:56 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 14:00:56.932762 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab1ea6c-c4b6-42d5-bf09-04a3a918708f None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:56.938048 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 522/1025] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 3 14:00:56 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 03 14:00:56.948091 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b18912e-9146-4a4e-b820-c2dc3278f6a8 None None] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:56.948377 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b18912e-9146-4a4e-b820-c2dc3278f6a8 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:56.948654 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b18912e-9146-4a4e-b820-c2dc3278f6a8 None None] PATH_INFO: `/` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:56.950223 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 523/1026] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 3 14:00:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 14:00:56.954840 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1cbead-3f7b-4fcf-a5c8-13efbd1fef87 None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:56.955075 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1cbead-3f7b-4fcf-a5c8-13efbd1fef87 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:56.955301 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1cbead-3f7b-4fcf-a5c8-13efbd1fef87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:56.971652 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-3a1cbead-3f7b-4fcf-a5c8-13efbd1fef87 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:00:56.972807 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-3a1cbead-3f7b-4fcf-a5c8-13efbd1fef87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:00:57.028381 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab1ea6c-c4b6-42d5-bf09-04a3a918708f None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:57.039668 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 524/1027] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 3 14:00:56 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 03 14:00:57.040673 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1cbead-3f7b-4fcf-a5c8-13efbd1fef87 None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:57.060441 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cda6a61-5f84-4b45-8d04-c9eaebbf942c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:57.061207 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cda6a61-5f84-4b45-8d04-c9eaebbf942c None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:57.061585 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cda6a61-5f84-4b45-8d04-c9eaebbf942c None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:57.061920 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cda6a61-5f84-4b45-8d04-c9eaebbf942c None admin] PATH_INFO: `/v3/roles` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:57.062729 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cda6a61-5f84-4b45-8d04-c9eaebbf942c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80012) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:00:57.063094 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cda6a61-5f84-4b45-8d04-c9eaebbf942c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:57.064493 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cda6a61-5f84-4b45-8d04-c9eaebbf942c None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:57.072744 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 504/1028] 10.222.0.36 () {56 vars in 1115 bytes} [Tue May 3 14:00:56 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 14:00:57.073547 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cda6a61-5f84-4b45-8d04-c9eaebbf942c None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:57.138472 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1cbead-3f7b-4fcf-a5c8-13efbd1fef87 None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:57.167466 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cda6a61-5f84-4b45-8d04-c9eaebbf942c None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:57.172004 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239de2dd-a2c8-4f53-86a0-75415d13392d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:57.172784 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239de2dd-a2c8-4f53-86a0-75415d13392d None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:57.173059 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239de2dd-a2c8-4f53-86a0-75415d13392d None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:57.173350 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239de2dd-a2c8-4f53-86a0-75415d13392d None admin] PATH_INFO: `/v3/services/image` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:57.173991 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239de2dd-a2c8-4f53-86a0-75415d13392d None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:57.175352 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239de2dd-a2c8-4f53-86a0-75415d13392d None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:57.186732 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application [None req-239de2dd-a2c8-4f53-86a0-75415d13392d None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 03 14:00:57.186732 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:00:57.186732 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 03 14:00:57.186732 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 03 14:00:57.186732 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 03 14:00:57.186732 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 03 14:00:57.186732 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 03 14:00:57.186732 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 14:00:57.186732 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 03 14:00:57.186732 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application May 03 14:00:57.186732 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 03 14:00:57.186732 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application May 03 14:00:57.186732 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:00:57.186732 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 14:00:57.186732 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 14:00:57.186732 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 14:00:57.186732 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 14:00:57.187838 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 14:00:57.187838 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 14:00:57.187838 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 14:00:57.187838 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 14:00:57.187838 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 14:00:57.187838 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 14:00:57.187838 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 03 14:00:57.187838 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._get_service(service_id) May 03 14:00:57.187838 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 03 14:00:57.187838 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 03 14:00:57.187838 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 14:00:57.187838 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 14:00:57.187838 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 14:00:57.187838 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 14:00:57.187838 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 14:00:57.187838 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.get_or_create( May 03 14:00:57.188719 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 14:00:57.188719 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application with Lock( May 03 14:00:57.188719 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 14:00:57.188719 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._enter() May 03 14:00:57.188719 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 14:00:57.188719 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 14:00:57.188719 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 14:00:57.188719 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.creator() May 03 14:00:57.188719 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 14:00:57.188719 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application created_value = creator( May 03 14:00:57.188719 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 03 14:00:57.188719 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 14:00:57.188719 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 03 14:00:57.188719 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application May 03 14:00:57.188719 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 525/1029] 10.222.0.36 () {56 vars in 1105 bytes} [Tue May 3 14:00:57 2022] GET /identity/v3/services/image => generated 86 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 14:00:57.189574 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239de2dd-a2c8-4f53-86a0-75415d13392d None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:57.202071 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35da2af9-2827-4bbc-9494-ac11aa449c25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:57.202875 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35da2af9-2827-4bbc-9494-ac11aa449c25 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:57.203157 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35da2af9-2827-4bbc-9494-ac11aa449c25 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:57.203414 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35da2af9-2827-4bbc-9494-ac11aa449c25 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:57.204603 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35da2af9-2827-4bbc-9494-ac11aa449c25 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:57.206056 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35da2af9-2827-4bbc-9494-ac11aa449c25 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:57.207680 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 505/1030] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 3 14:00:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:00:57.208419 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35da2af9-2827-4bbc-9494-ac11aa449c25 None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:57.283766 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239de2dd-a2c8-4f53-86a0-75415d13392d None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:57.305808 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35da2af9-2827-4bbc-9494-ac11aa449c25 None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:57.315232 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb6ac8f-ff2a-4494-8b34-9207161f8696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:57.316025 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb6ac8f-ff2a-4494-8b34-9207161f8696 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:57.316310 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb6ac8f-ff2a-4494-8b34-9207161f8696 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:57.316589 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb6ac8f-ff2a-4494-8b34-9207161f8696 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:57.327039 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb6ac8f-ff2a-4494-8b34-9207161f8696 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:57.328474 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb6ac8f-ff2a-4494-8b34-9207161f8696 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:57.340069 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7af4d7-d4fa-478f-9124-21188aab3edf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:57.340957 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7af4d7-d4fa-478f-9124-21188aab3edf None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:57.341243 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7af4d7-d4fa-478f-9124-21188aab3edf None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:57.341622 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7af4d7-d4fa-478f-9124-21188aab3edf None admin] PATH_INFO: `/v3/services` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:57.342348 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7af4d7-d4fa-478f-9124-21188aab3edf None admin] RBAC: Adding query filter params (name=image) {{(pid=80012) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:00:57.342655 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7af4d7-d4fa-478f-9124-21188aab3edf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:57.344088 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7af4d7-d4fa-478f-9124-21188aab3edf None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:57.345072 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application [None req-3fb6ac8f-ff2a-4494-8b34-9207161f8696 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 14:00:57.345072 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:00:57.345072 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 14:00:57.345072 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 14:00:57.345072 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 14:00:57.345072 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 14:00:57.345072 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 14:00:57.345072 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 14:00:57.345072 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 14:00:57.345072 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 14:00:57.345072 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 14:00:57.345072 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 14:00:57.345072 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 14:00:57.345072 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 14:00:57.345072 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 14:00:57.346120 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 14:00:57.346120 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 14:00:57.346120 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 14:00:57.346120 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 14:00:57.346120 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 14:00:57.346120 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 14:00:57.346120 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.get_or_create( May 03 14:00:57.346120 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 14:00:57.346120 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application with Lock( May 03 14:00:57.346120 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 14:00:57.346120 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._enter() May 03 14:00:57.346120 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 14:00:57.346120 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 14:00:57.346120 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 14:00:57.346120 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.creator() May 03 14:00:57.346120 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 14:00:57.346120 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application created_value = creator( May 03 14:00:57.347098 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 14:00:57.347098 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 14:00:57.347098 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 14:00:57.347098 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application May 03 14:00:57.347098 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 526/1031] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 3 14:00:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 14:00:57.347401 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb6ac8f-ff2a-4494-8b34-9207161f8696 None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:57.350378 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 506/1032] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 3 14:00:57 2022] GET /identity/v3/services?name=image => generated 122 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:00:57.355409 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7af4d7-d4fa-478f-9124-21188aab3edf None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:57.445810 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb6ac8f-ff2a-4494-8b34-9207161f8696 None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:57.452946 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7af4d7-d4fa-478f-9124-21188aab3edf None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:57.479437 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d33c906-7512-4367-90a4-58530220989a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:57.480114 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d33c906-7512-4367-90a4-58530220989a None admin] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:57.480415 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d33c906-7512-4367-90a4-58530220989a None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:57.480716 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d33c906-7512-4367-90a4-58530220989a None admin] PATH_INFO: `/v3/users` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:57.481447 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d33c906-7512-4367-90a4-58530220989a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:57.482861 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d33c906-7512-4367-90a4-58530220989a None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:57.486578 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dc61fd-0eef-42ef-b15e-7d0191cb9b3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:57.487258 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dc61fd-0eef-42ef-b15e-7d0191cb9b3c None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:57.487540 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dc61fd-0eef-42ef-b15e-7d0191cb9b3c None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:57.487815 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dc61fd-0eef-42ef-b15e-7d0191cb9b3c None admin] PATH_INFO: `/v3/domains` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:57.488530 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dc61fd-0eef-42ef-b15e-7d0191cb9b3c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80012) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:00:57.488841 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dc61fd-0eef-42ef-b15e-7d0191cb9b3c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:57.490237 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dc61fd-0eef-42ef-b15e-7d0191cb9b3c None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:57.502779 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 507/1033] 10.222.0.36 () {56 vars in 1109 bytes} [Tue May 3 14:00:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:00:57.502924 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 527/1034] 10.222.0.36 () {60 vars in 1132 bytes} [Tue May 3 14:00:57 2022] POST /identity/v3/users => generated 285 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 14:00:57.506109 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d33c906-7512-4367-90a4-58530220989a None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:57.514769 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dc61fd-0eef-42ef-b15e-7d0191cb9b3c None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:57.614192 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d33c906-7512-4367-90a4-58530220989a None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:57.620167 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dc61fd-0eef-42ef-b15e-7d0191cb9b3c None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:57.651633 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acf172f-20d6-44d8-9ab6-4b3f9162202e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:57.652503 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acf172f-20d6-44d8-9ab6-4b3f9162202e None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:57.652916 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acf172f-20d6-44d8-9ab6-4b3f9162202e None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:57.653235 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acf172f-20d6-44d8-9ab6-4b3f9162202e None admin] PATH_INFO: `/v3/services` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:57.654107 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acf172f-20d6-44d8-9ab6-4b3f9162202e None admin] RBAC: Adding query filter params (type=image) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:00:57.654443 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acf172f-20d6-44d8-9ab6-4b3f9162202e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:57.656022 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acf172f-20d6-44d8-9ab6-4b3f9162202e None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:57.660007 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70f6581-3e98-4771-8338-8f9b6fbc4809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:57.661637 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70f6581-3e98-4771-8338-8f9b6fbc4809 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:57.662151 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70f6581-3e98-4771-8338-8f9b6fbc4809 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:57.662691 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70f6581-3e98-4771-8338-8f9b6fbc4809 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:57.663079 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 528/1035] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 3 14:00:57 2022] GET /identity/v3/services?type=image => generated 350 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:00:57.669613 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acf172f-20d6-44d8-9ab6-4b3f9162202e None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:57.676364 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70f6581-3e98-4771-8338-8f9b6fbc4809 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:57.677872 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70f6581-3e98-4771-8338-8f9b6fbc4809 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:57.693720 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application [None req-b70f6581-3e98-4771-8338-8f9b6fbc4809 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 03 14:00:57.693720 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:00:57.693720 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 14:00:57.693720 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 14:00:57.693720 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 14:00:57.693720 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 14:00:57.693720 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 14:00:57.693720 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 14:00:57.693720 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 14:00:57.693720 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 14:00:57.693720 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 14:00:57.693720 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 14:00:57.693720 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 14:00:57.693720 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 14:00:57.693720 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 14:00:57.693720 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 14:00:57.694795 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 14:00:57.694795 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 14:00:57.694795 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 14:00:57.694795 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 14:00:57.694795 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 14:00:57.694795 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 14:00:57.694795 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 14:00:57.694795 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 14:00:57.694795 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 14:00:57.694795 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.get_or_create( May 03 14:00:57.694795 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 14:00:57.694795 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application with Lock( May 03 14:00:57.694795 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 14:00:57.694795 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._enter() May 03 14:00:57.694795 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 14:00:57.694795 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 14:00:57.694795 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 14:00:57.694795 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.creator() May 03 14:00:57.696456 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 14:00:57.696456 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application created_value = creator( May 03 14:00:57.696456 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 14:00:57.696456 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 14:00:57.696456 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 14:00:57.696456 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 14:00:57.696456 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 14:00:57.696456 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 14:00:57.696456 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 03 14:00:57.696456 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application May 03 14:00:57.696456 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 508/1036] 10.222.0.36 () {56 vars in 1093 bytes} [Tue May 3 14:00:57 2022] GET /identity/v3/users/nova => generated 82 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 14:00:57.701405 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70f6581-3e98-4771-8338-8f9b6fbc4809 None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:57.771113 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acf172f-20d6-44d8-9ab6-4b3f9162202e None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:57.800399 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70f6581-3e98-4771-8338-8f9b6fbc4809 None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:57.804067 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7db3dc0-1293-44b6-9114-4d5f10e69c36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:57.804725 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7db3dc0-1293-44b6-9114-4d5f10e69c36 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:57.805008 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7db3dc0-1293-44b6-9114-4d5f10e69c36 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:57.805269 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7db3dc0-1293-44b6-9114-4d5f10e69c36 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:57.806095 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7db3dc0-1293-44b6-9114-4d5f10e69c36 None admin] RBAC: Adding query filter params (interface=public, service_id=4789376fc1b64ed898e58a60cfa4d30d, region_id=RegionOne) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:00:57.806378 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7db3dc0-1293-44b6-9114-4d5f10e69c36 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:57.807744 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7db3dc0-1293-44b6-9114-4d5f10e69c36 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:57.818099 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 529/1037] 10.222.0.36 () {56 vars in 1251 bytes} [Tue May 3 14:00:57 2022] GET /identity/v3/endpoints?service_id=4789376fc1b64ed898e58a60cfa4d30d&interface=public®ion_id=RegionOne => generated 194 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:00:57.819062 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7db3dc0-1293-44b6-9114-4d5f10e69c36 None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:57.833902 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257691f2-3672-42d6-874a-f3069755a6bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:57.834573 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257691f2-3672-42d6-874a-f3069755a6bb None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:57.834851 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257691f2-3672-42d6-874a-f3069755a6bb None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:57.835123 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257691f2-3672-42d6-874a-f3069755a6bb None admin] PATH_INFO: `/v3/users` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:57.835955 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257691f2-3672-42d6-874a-f3069755a6bb None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80012) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:00:57.836259 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257691f2-3672-42d6-874a-f3069755a6bb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:57.837710 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257691f2-3672-42d6-874a-f3069755a6bb None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:57.860136 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 509/1038] 10.222.0.36 () {56 vars in 1133 bytes} [Tue May 3 14:00:57 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 14:00:57.861693 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257691f2-3672-42d6-874a-f3069755a6bb None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:57.922961 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7db3dc0-1293-44b6-9114-4d5f10e69c36 None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:57.955957 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fad205-934b-4396-9f16-34b5412e78cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:57.956545 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fad205-934b-4396-9f16-34b5412e78cf None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:57.956828 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fad205-934b-4396-9f16-34b5412e78cf None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:57.957103 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fad205-934b-4396-9f16-34b5412e78cf None admin] PATH_INFO: `/v3/services` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:57.957835 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fad205-934b-4396-9f16-34b5412e78cf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:57.958588 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257691f2-3672-42d6-874a-f3069755a6bb None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:57.959212 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fad205-934b-4396-9f16-34b5412e78cf None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:57.966484 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 530/1039] 10.222.0.36 () {56 vars in 1087 bytes} [Tue May 3 14:00:57 2022] GET /identity/v3/services => generated 1957 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 14:00:58.006216 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1900ed28-c5f9-41a6-9cf3-94ad284e7d9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:58.006880 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1900ed28-c5f9-41a6-9cf3-94ad284e7d9f None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:58.007158 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1900ed28-c5f9-41a6-9cf3-94ad284e7d9f None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:58.007438 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1900ed28-c5f9-41a6-9cf3-94ad284e7d9f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:58.079250 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1900ed28-c5f9-41a6-9cf3-94ad284e7d9f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:58.080722 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1900ed28-c5f9-41a6-9cf3-94ad284e7d9f None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:58.184845 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 510/1040] 10.222.0.36 () {58 vars in 1282 bytes} [Tue May 3 14:00:57 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 03 14:00:58.190417 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fad205-934b-4396-9f16-34b5412e78cf None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:58.286062 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fad205-934b-4396-9f16-34b5412e78cf None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:58.319469 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39c5b64-72b1-4faf-838a-f72cf05ff873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:58.320264 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39c5b64-72b1-4faf-838a-f72cf05ff873 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:58.320541 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39c5b64-72b1-4faf-838a-f72cf05ff873 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:58.320811 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39c5b64-72b1-4faf-838a-f72cf05ff873 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:58.331690 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39c5b64-72b1-4faf-838a-f72cf05ff873 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:58.333170 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39c5b64-72b1-4faf-838a-f72cf05ff873 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:58.350636 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application [None req-b39c5b64-72b1-4faf-838a-f72cf05ff873 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 14:00:58.350636 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:00:58.350636 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 14:00:58.350636 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 14:00:58.350636 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 14:00:58.350636 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 14:00:58.350636 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 14:00:58.350636 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 14:00:58.350636 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 14:00:58.350636 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 14:00:58.350636 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 14:00:58.350636 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 14:00:58.350636 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 14:00:58.350636 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 14:00:58.350636 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 14:00:58.351627 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 14:00:58.351627 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 14:00:58.351627 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 14:00:58.351627 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 14:00:58.351627 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 14:00:58.351627 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 14:00:58.351627 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.get_or_create( May 03 14:00:58.351627 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 14:00:58.351627 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application with Lock( May 03 14:00:58.351627 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 14:00:58.351627 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._enter() May 03 14:00:58.351627 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 14:00:58.351627 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 14:00:58.351627 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 14:00:58.351627 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.creator() May 03 14:00:58.351627 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 14:00:58.351627 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application created_value = creator( May 03 14:00:58.352544 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 14:00:58.352544 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 14:00:58.352544 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 14:00:58.352544 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application May 03 14:00:58.353342 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 531/1041] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 3 14:00:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 14:00:58.358013 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1900ed28-c5f9-41a6-9cf3-94ad284e7d9f None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:58.455909 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1900ed28-c5f9-41a6-9cf3-94ad284e7d9f None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:58.489764 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ae23ab-dbda-4b0d-ac48-27986fb35df9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:58.490416 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ae23ab-dbda-4b0d-ac48-27986fb35df9 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:58.490655 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ae23ab-dbda-4b0d-ac48-27986fb35df9 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:58.490959 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ae23ab-dbda-4b0d-ac48-27986fb35df9 None admin] PATH_INFO: `/v3/domains` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:58.491672 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ae23ab-dbda-4b0d-ac48-27986fb35df9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80012) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:00:58.491973 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ae23ab-dbda-4b0d-ac48-27986fb35df9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:58.493331 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ae23ab-dbda-4b0d-ac48-27986fb35df9 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:58.509025 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 511/1042] 10.222.0.36 () {56 vars in 1109 bytes} [Tue May 3 14:00:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:00:58.510258 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39c5b64-72b1-4faf-838a-f72cf05ff873 None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:58.607120 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39c5b64-72b1-4faf-838a-f72cf05ff873 None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:58.639517 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364b13b6-fd02-4697-9134-bafddcc219c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:58.640312 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364b13b6-fd02-4697-9134-bafddcc219c9 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:58.640558 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364b13b6-fd02-4697-9134-bafddcc219c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:58.640851 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364b13b6-fd02-4697-9134-bafddcc219c9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:58.647545 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364b13b6-fd02-4697-9134-bafddcc219c9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:58.648975 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364b13b6-fd02-4697-9134-bafddcc219c9 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:58.664021 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application [None req-364b13b6-fd02-4697-9134-bafddcc219c9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 14:00:58.664021 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:00:58.664021 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 14:00:58.664021 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 14:00:58.664021 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 14:00:58.664021 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 14:00:58.664021 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 14:00:58.664021 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 14:00:58.664021 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 14:00:58.664021 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 14:00:58.664021 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 14:00:58.664021 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 14:00:58.664021 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 14:00:58.664021 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 14:00:58.664021 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 14:00:58.669683 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 14:00:58.669683 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 14:00:58.669683 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 14:00:58.669683 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 14:00:58.669683 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 14:00:58.669683 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 14:00:58.669683 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.get_or_create( May 03 14:00:58.669683 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 14:00:58.669683 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application with Lock( May 03 14:00:58.669683 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 14:00:58.669683 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._enter() May 03 14:00:58.669683 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 14:00:58.669683 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 14:00:58.669683 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 14:00:58.669683 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.creator() May 03 14:00:58.669683 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 14:00:58.669683 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application created_value = creator( May 03 14:00:58.670665 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 14:00:58.670665 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 14:00:58.670665 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 14:00:58.670665 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 14:00:58.670665 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 14:00:58.670665 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 14:00:58.670665 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 14:00:58.670665 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application May 03 14:00:58.670665 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 532/1043] 10.222.0.36 () {56 vars in 1111 bytes} [Tue May 3 14:00:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 14:00:58.673941 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ae23ab-dbda-4b0d-ac48-27986fb35df9 None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:58.771342 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ae23ab-dbda-4b0d-ac48-27986fb35df9 None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:58.804889 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e135755-f22e-4720-8628-670a59a3f910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:58.805834 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e135755-f22e-4720-8628-670a59a3f910 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:58.806254 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e135755-f22e-4720-8628-670a59a3f910 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:58.806690 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e135755-f22e-4720-8628-670a59a3f910 None admin] PATH_INFO: `/v3/projects` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:58.807608 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e135755-f22e-4720-8628-670a59a3f910 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80012) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:00:58.808051 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e135755-f22e-4720-8628-670a59a3f910 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:58.809869 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e135755-f22e-4720-8628-670a59a3f910 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:58.822624 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 512/1044] 10.222.0.36 () {56 vars in 1148 bytes} [Tue May 3 14:00:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:00:58.829047 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364b13b6-fd02-4697-9134-bafddcc219c9 None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:00:58.926865 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364b13b6-fd02-4697-9134-bafddcc219c9 None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:00:58.960956 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4393464-ffbf-47c3-a5a7-9e15a348f551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:00:58.961644 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4393464-ffbf-47c3-a5a7-9e15a348f551 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:58.961919 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4393464-ffbf-47c3-a5a7-9e15a348f551 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:58.962147 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4393464-ffbf-47c3-a5a7-9e15a348f551 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:58.962991 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4393464-ffbf-47c3-a5a7-9e15a348f551 None admin] RBAC: Adding query filter params (role.id=83dea282ec144c95979d7e1b50c52a85, scope.project.id=de541be478754087934323bdbe41a579, user.id=63489e658c094a2598a2ac62159d2fda) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:00:58.963291 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4393464-ffbf-47c3-a5a7-9e15a348f551 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:00:58.965058 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4393464-ffbf-47c3-a5a7-9e15a348f551 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:00:58.977383 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 533/1045] 10.222.0.36 () {56 vars in 1374 bytes} [Tue May 3 14:00:58 2022] GET /identity/v3/role_assignments?user.id=63489e658c094a2598a2ac62159d2fda&scope.project.id=de541be478754087934323bdbe41a579&role.id=83dea282ec144c95979d7e1b50c52a85 => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:00:59.790818 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f760c53-7ced-4807-acb5-0b75d6885dea None None] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:59.791412 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f760c53-7ced-4807-acb5-0b75d6885dea None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:59.791412 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f760c53-7ced-4807-acb5-0b75d6885dea None None] PATH_INFO: `/` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:59.792967 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 513/1046] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 3 14:00:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 14:00:59.798258 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77400e66-af16-4f94-8057-387144fb0aac None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:00:59.798694 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77400e66-af16-4f94-8057-387144fb0aac None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:00:59.798770 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77400e66-af16-4f94-8057-387144fb0aac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:00:59.815634 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-77400e66-af16-4f94-8057-387144fb0aac None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:00:59.816799 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-77400e66-af16-4f94-8057-387144fb0aac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:00:59.884695 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 534/1047] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 3 14:00:59 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 14:00:59.907936 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f760c53-7ced-4807-acb5-0b75d6885dea None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:01:00.009004 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f760c53-7ced-4807-acb5-0b75d6885dea None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:01:00.050653 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7005f8f2-bd75-445f-94b4-62837f2c8da0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:01:00.051383 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7005f8f2-bd75-445f-94b4-62837f2c8da0 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:01:00.051619 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7005f8f2-bd75-445f-94b4-62837f2c8da0 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:01:00.051924 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7005f8f2-bd75-445f-94b4-62837f2c8da0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:01:00.066289 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7005f8f2-bd75-445f-94b4-62837f2c8da0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 14:01:00.074257 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application [None req-7005f8f2-bd75-445f-94b4-62837f2c8da0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 03 14:01:00.074257 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:01:00.074257 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 14:01:00.074257 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 14:01:00.074257 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 14:01:00.074257 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 14:01:00.074257 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 14:01:00.074257 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 14:01:00.074257 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 14:01:00.074257 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 14:01:00.074257 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 14:01:00.074257 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 14:01:00.074257 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 14:01:00.074257 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 14:01:00.074257 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 14:01:00.074257 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 14:01:00.075292 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 14:01:00.075292 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 14:01:00.075292 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 14:01:00.075292 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 14:01:00.075292 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 14:01:00.075292 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 14:01:00.075292 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 14:01:00.075292 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 14:01:00.075292 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 14:01:00.075292 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.get_or_create( May 03 14:01:00.075292 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 14:01:00.075292 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application with Lock( May 03 14:01:00.075292 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 14:01:00.075292 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._enter() May 03 14:01:00.075292 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 14:01:00.075292 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 14:01:00.076201 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 14:01:00.076201 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.creator() May 03 14:01:00.076201 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 14:01:00.076201 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application created_value = creator( May 03 14:01:00.076201 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 14:01:00.076201 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 14:01:00.076201 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 14:01:00.076201 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 14:01:00.076201 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 14:01:00.076201 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 14:01:00.076201 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 03 14:01:00.076201 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application May 03 14:01:00.077570 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 514/1048] 10.222.0.36 () {56 vars in 1096 bytes} [Tue May 3 14:00:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 14:01:00.081869 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77400e66-af16-4f94-8057-387144fb0aac None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:01:00.176252 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77400e66-af16-4f94-8057-387144fb0aac None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:01:00.211262 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbab0e6d-ec9d-4260-81f4-7ef30c8a442a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:01:00.211945 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbab0e6d-ec9d-4260-81f4-7ef30c8a442a None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:01:00.212225 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbab0e6d-ec9d-4260-81f4-7ef30c8a442a None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:01:00.212495 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbab0e6d-ec9d-4260-81f4-7ef30c8a442a None admin] PATH_INFO: `/v3/roles` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:01:00.213240 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbab0e6d-ec9d-4260-81f4-7ef30c8a442a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:01:00.213892 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbab0e6d-ec9d-4260-81f4-7ef30c8a442a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:01:00.215318 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbab0e6d-ec9d-4260-81f4-7ef30c8a442a None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:01:00.223711 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 535/1049] 10.222.0.36 () {56 vars in 1099 bytes} [Tue May 3 14:01:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 14:01:00.229319 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7005f8f2-bd75-445f-94b4-62837f2c8da0 None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:01:00.231780 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18824407-3116-4a8c-863d-98f17c2ff73d None None] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:01:00.232059 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18824407-3116-4a8c-863d-98f17c2ff73d None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:01:00.232353 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18824407-3116-4a8c-863d-98f17c2ff73d None None] PATH_INFO: `/` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:01:00.234967 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 536/1050] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 3 14:01:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 14:01:00.238885 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74675bf1-1759-45aa-8d1f-0efa549ff3dd None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:01:00.239189 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74675bf1-1759-45aa-8d1f-0efa549ff3dd None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:01:00.239467 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74675bf1-1759-45aa-8d1f-0efa549ff3dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:01:00.256571 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-74675bf1-1759-45aa-8d1f-0efa549ff3dd None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:01:00.257773 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-74675bf1-1759-45aa-8d1f-0efa549ff3dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:01:00.320252 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 537/1051] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 3 14:01:00 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 03 14:01:00.325105 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7005f8f2-bd75-445f-94b4-62837f2c8da0 None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:01:00.343016 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74675bf1-1759-45aa-8d1f-0efa549ff3dd None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:01:00.358883 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9dd9c2-1dfd-4254-b2c5-c4af5dc89cf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:01:00.360097 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9dd9c2-1dfd-4254-b2c5-c4af5dc89cf0 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:01:00.360377 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9dd9c2-1dfd-4254-b2c5-c4af5dc89cf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:01:00.360648 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9dd9c2-1dfd-4254-b2c5-c4af5dc89cf0 None admin] PATH_INFO: `/v3/users/454beff0dbba4ad69f19c87143755d1f` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:01:00.373805 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9dd9c2-1dfd-4254-b2c5-c4af5dc89cf0 None admin] RBAC: Authorizing `identity:get_user(user_id=454beff0dbba4ad69f19c87143755d1f)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:01:00.375277 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9dd9c2-1dfd-4254-b2c5-c4af5dc89cf0 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:01:00.381677 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 515/1052] 10.222.0.36 () {56 vars in 1177 bytes} [Tue May 3 14:01:00 2022] GET /identity/v3/users/454beff0dbba4ad69f19c87143755d1f => generated 285 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:01:00.382630 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9dd9c2-1dfd-4254-b2c5-c4af5dc89cf0 None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:01:00.443244 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74675bf1-1759-45aa-8d1f-0efa549ff3dd None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:01:00.476703 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d59b18-aeaf-4ec5-8103-1d7580721326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:01:00.477539 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d59b18-aeaf-4ec5-8103-1d7580721326 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:01:00.477820 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d59b18-aeaf-4ec5-8103-1d7580721326 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:01:00.478097 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d59b18-aeaf-4ec5-8103-1d7580721326 None admin] PATH_INFO: `/v3/services/image` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:01:00.478754 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d59b18-aeaf-4ec5-8103-1d7580721326 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:01:00.480125 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d59b18-aeaf-4ec5-8103-1d7580721326 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:01:00.481407 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9dd9c2-1dfd-4254-b2c5-c4af5dc89cf0 None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:01:00.491933 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application [None req-b0d59b18-aeaf-4ec5-8103-1d7580721326 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 03 14:01:00.491933 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:01:00.491933 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 03 14:01:00.491933 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 03 14:01:00.491933 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 03 14:01:00.491933 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 03 14:01:00.491933 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 03 14:01:00.491933 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 14:01:00.491933 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 03 14:01:00.491933 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application May 03 14:01:00.491933 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 03 14:01:00.491933 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application May 03 14:01:00.491933 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:01:00.491933 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 14:01:00.491933 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 14:01:00.491933 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 14:01:00.491933 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 14:01:00.492973 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 14:01:00.492973 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 14:01:00.492973 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 14:01:00.492973 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 14:01:00.492973 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 14:01:00.492973 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 14:01:00.492973 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 03 14:01:00.492973 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._get_service(service_id) May 03 14:01:00.492973 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 03 14:01:00.492973 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 03 14:01:00.492973 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 14:01:00.492973 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 14:01:00.492973 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 14:01:00.492973 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 14:01:00.492973 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 14:01:00.492973 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.get_or_create( May 03 14:01:00.493907 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 14:01:00.493907 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application with Lock( May 03 14:01:00.493907 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 14:01:00.493907 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._enter() May 03 14:01:00.493907 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 14:01:00.493907 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 14:01:00.493907 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 14:01:00.493907 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.creator() May 03 14:01:00.493907 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 14:01:00.493907 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application created_value = creator( May 03 14:01:00.493907 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 03 14:01:00.493907 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 14:01:00.493907 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 03 14:01:00.493907 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application May 03 14:01:00.493907 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 538/1053] 10.222.0.36 () {56 vars in 1105 bytes} [Tue May 3 14:01:00 2022] GET /identity/v3/services/image => generated 86 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 14:01:00.499439 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d59b18-aeaf-4ec5-8103-1d7580721326 None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:01:00.518031 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a079770-2cc0-4229-97c5-9fef76f39877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:01:00.518687 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a079770-2cc0-4229-97c5-9fef76f39877 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:01:00.518967 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a079770-2cc0-4229-97c5-9fef76f39877 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:01:00.519242 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a079770-2cc0-4229-97c5-9fef76f39877 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:01:00.587478 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a079770-2cc0-4229-97c5-9fef76f39877 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:01:00.589566 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a079770-2cc0-4229-97c5-9fef76f39877 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:01:00.598184 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d59b18-aeaf-4ec5-8103-1d7580721326 None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:01:00.630853 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f14cdc-7738-46f2-8eb6-caeee55be2da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:01:00.631523 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f14cdc-7738-46f2-8eb6-caeee55be2da None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:01:00.631807 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f14cdc-7738-46f2-8eb6-caeee55be2da None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:01:00.632082 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f14cdc-7738-46f2-8eb6-caeee55be2da None admin] PATH_INFO: `/v3/services` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:01:00.632801 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f14cdc-7738-46f2-8eb6-caeee55be2da None admin] RBAC: Adding query filter params (name=image) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:01:00.633109 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f14cdc-7738-46f2-8eb6-caeee55be2da None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:01:00.634523 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f14cdc-7738-46f2-8eb6-caeee55be2da None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:01:00.639442 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 539/1054] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 3 14:01:00 2022] GET /identity/v3/services?name=image => generated 122 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 14:01:00.645116 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f14cdc-7738-46f2-8eb6-caeee55be2da None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:01:00.691059 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 516/1055] 10.222.0.36 () {58 vars in 1282 bytes} [Tue May 3 14:01:00 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 03 14:01:00.696752 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a079770-2cc0-4229-97c5-9fef76f39877 None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:01:00.745764 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f14cdc-7738-46f2-8eb6-caeee55be2da None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:01:00.778494 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46eec318-e703-4c28-adbc-8bd1e5831d76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:01:00.779153 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eec318-e703-4c28-adbc-8bd1e5831d76 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:01:00.779428 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eec318-e703-4c28-adbc-8bd1e5831d76 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:01:00.779696 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eec318-e703-4c28-adbc-8bd1e5831d76 None admin] PATH_INFO: `/v3/services` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:01:00.780421 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46eec318-e703-4c28-adbc-8bd1e5831d76 None admin] RBAC: Adding query filter params (type=image) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:01:00.780720 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46eec318-e703-4c28-adbc-8bd1e5831d76 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:01:00.782104 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46eec318-e703-4c28-adbc-8bd1e5831d76 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:01:00.791456 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 540/1056] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 3 14:01:00 2022] GET /identity/v3/services?type=image => generated 350 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 14:01:00.792377 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46eec318-e703-4c28-adbc-8bd1e5831d76 None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:01:00.795382 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a079770-2cc0-4229-97c5-9fef76f39877 None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:01:00.828003 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9493194a-1876-4065-8709-860c089db365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:01:00.828870 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9493194a-1876-4065-8709-860c089db365 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:01:00.829149 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9493194a-1876-4065-8709-860c089db365 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:01:00.829451 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9493194a-1876-4065-8709-860c089db365 None admin] PATH_INFO: `/v3/projects/fcb3f0754da4449aa4e3612cb2852ae3` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:01:00.830628 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9493194a-1876-4065-8709-860c089db365 None admin] RBAC: Authorizing `identity:get_project(project_id=fcb3f0754da4449aa4e3612cb2852ae3)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:01:00.832065 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9493194a-1876-4065-8709-860c089db365 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:01:00.839199 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 517/1057] 10.222.0.36 () {56 vars in 1186 bytes} [Tue May 3 14:01:00 2022] GET /identity/v3/projects/fcb3f0754da4449aa4e3612cb2852ae3 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 14:01:00.840793 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9493194a-1876-4065-8709-860c089db365 None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:01:00.889092 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46eec318-e703-4c28-adbc-8bd1e5831d76 None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:01:00.921338 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5656d8-a14d-4384-8f35-400e4e66f0c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:01:00.922044 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5656d8-a14d-4384-8f35-400e4e66f0c9 None admin] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:01:00.922364 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5656d8-a14d-4384-8f35-400e4e66f0c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:01:00.922647 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5656d8-a14d-4384-8f35-400e4e66f0c9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:01:00.923402 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5656d8-a14d-4384-8f35-400e4e66f0c9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:01:00.924822 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5656d8-a14d-4384-8f35-400e4e66f0c9 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:01:00.940479 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9493194a-1876-4065-8709-860c089db365 None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:01:00.945100 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 541/1058] 10.222.0.36 () {60 vars in 1144 bytes} [Tue May 3 14:01:00 2022] POST /identity/v3/endpoints => generated 327 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 14:01:00.984904 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4998ed8f-c09e-40b0-902a-aabb2bd37d84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:01:00.985599 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4998ed8f-c09e-40b0-902a-aabb2bd37d84 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:01:00.985876 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4998ed8f-c09e-40b0-902a-aabb2bd37d84 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:01:00.986148 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4998ed8f-c09e-40b0-902a-aabb2bd37d84 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:01:00.987034 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4998ed8f-c09e-40b0-902a-aabb2bd37d84 None admin] RBAC: Adding query filter params (role.id=36abe9b50fd8479c86c4f8f70fd85aa3, scope.project.id=fcb3f0754da4449aa4e3612cb2852ae3, user.id=454beff0dbba4ad69f19c87143755d1f) {{(pid=80012) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:01:00.987343 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4998ed8f-c09e-40b0-902a-aabb2bd37d84 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:01:00.988854 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4998ed8f-c09e-40b0-902a-aabb2bd37d84 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:01:01.001336 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 518/1059] 10.222.0.36 () {56 vars in 1374 bytes} [Tue May 3 14:01:00 2022] GET /identity/v3/role_assignments?user.id=454beff0dbba4ad69f19c87143755d1f&scope.project.id=fcb3f0754da4449aa4e3612cb2852ae3&role.id=36abe9b50fd8479c86c4f8f70fd85aa3 => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:01:01.202731 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebadb5a-eb30-443b-8544-914480da25ae None None] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:01:01.203075 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebadb5a-eb30-443b-8544-914480da25ae None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:01:01.203252 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebadb5a-eb30-443b-8544-914480da25ae None None] PATH_INFO: `/` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:01:01.204582 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 542/1060] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 3 14:01:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 14:01:01.210126 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9e61e4-260a-437f-bae1-062b980b8eaa None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:01:01.210412 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9e61e4-260a-437f-bae1-062b980b8eaa None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:01:01.210683 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9e61e4-260a-437f-bae1-062b980b8eaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:01:01.227520 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-7e9e61e4-260a-437f-bae1-062b980b8eaa None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:01:01.228699 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-7e9e61e4-260a-437f-bae1-062b980b8eaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:01:01.294645 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 519/1061] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 3 14:01:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 14:01:01.316515 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebadb5a-eb30-443b-8544-914480da25ae None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:01:01.417159 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebadb5a-eb30-443b-8544-914480da25ae None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:01:01.450517 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417334e3-364d-4201-939c-6341be08f717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:01:01.451301 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417334e3-364d-4201-939c-6341be08f717 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:01:01.451546 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417334e3-364d-4201-939c-6341be08f717 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:01:01.451839 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417334e3-364d-4201-939c-6341be08f717 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:01:01.462310 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417334e3-364d-4201-939c-6341be08f717 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 14:01:01.470621 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application [None req-417334e3-364d-4201-939c-6341be08f717 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 03 14:01:01.470621 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:01:01.470621 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 14:01:01.470621 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 14:01:01.470621 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 14:01:01.470621 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 14:01:01.470621 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 14:01:01.470621 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 14:01:01.470621 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 14:01:01.470621 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 14:01:01.470621 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 14:01:01.470621 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 14:01:01.470621 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 14:01:01.470621 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 14:01:01.470621 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 14:01:01.470621 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 14:01:01.471586 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 14:01:01.471586 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 14:01:01.471586 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 14:01:01.471586 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 14:01:01.471586 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 14:01:01.471586 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 14:01:01.471586 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 14:01:01.471586 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 14:01:01.471586 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 14:01:01.471586 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.get_or_create( May 03 14:01:01.471586 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 14:01:01.471586 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application with Lock( May 03 14:01:01.471586 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 14:01:01.471586 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._enter() May 03 14:01:01.471586 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 14:01:01.471586 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 14:01:01.472450 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 14:01:01.472450 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.creator() May 03 14:01:01.472450 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 14:01:01.472450 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application created_value = creator( May 03 14:01:01.472450 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 14:01:01.472450 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 14:01:01.472450 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 14:01:01.472450 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 14:01:01.472450 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 14:01:01.472450 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 14:01:01.472450 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 03 14:01:01.472450 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application May 03 14:01:01.472450 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 543/1062] 10.222.0.36 () {56 vars in 1120 bytes} [Tue May 3 14:01:01 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 14:01:01.479546 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9e61e4-260a-437f-bae1-062b980b8eaa None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:01:01.573476 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9e61e4-260a-437f-bae1-062b980b8eaa None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:01:01.606876 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266cde6f-81bc-4752-8e60-c21ad3a866f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:01:01.607538 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266cde6f-81bc-4752-8e60-c21ad3a866f8 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:01:01.607813 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266cde6f-81bc-4752-8e60-c21ad3a866f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:01:01.608078 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266cde6f-81bc-4752-8e60-c21ad3a866f8 None admin] PATH_INFO: `/v3/roles` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:01:01.608812 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266cde6f-81bc-4752-8e60-c21ad3a866f8 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80012) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:01:01.609110 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266cde6f-81bc-4752-8e60-c21ad3a866f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:01:01.610497 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266cde6f-81bc-4752-8e60-c21ad3a866f8 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:01:01.618225 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 520/1063] 10.222.0.36 () {56 vars in 1115 bytes} [Tue May 3 14:01:01 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 14:01:01.624033 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417334e3-364d-4201-939c-6341be08f717 None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:01:01.718037 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417334e3-364d-4201-939c-6341be08f717 None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:01:01.749716 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290c58d3-62a7-4680-873f-d3ed584f75d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:01:01.750512 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290c58d3-62a7-4680-873f-d3ed584f75d4 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:01:01.750781 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290c58d3-62a7-4680-873f-d3ed584f75d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:01:01.751044 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290c58d3-62a7-4680-873f-d3ed584f75d4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:01:01.760785 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290c58d3-62a7-4680-873f-d3ed584f75d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:01:01.762304 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290c58d3-62a7-4680-873f-d3ed584f75d4 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:01:01.779070 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application [None req-290c58d3-62a7-4680-873f-d3ed584f75d4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 14:01:01.779070 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:01:01.779070 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 14:01:01.779070 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 14:01:01.779070 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 14:01:01.779070 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 14:01:01.779070 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 14:01:01.779070 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 14:01:01.779070 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 14:01:01.779070 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 14:01:01.779070 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 14:01:01.779070 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 14:01:01.779070 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 14:01:01.779070 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 14:01:01.779070 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 14:01:01.780014 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 14:01:01.780014 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 14:01:01.780014 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 14:01:01.780014 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 14:01:01.780014 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 14:01:01.780014 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 14:01:01.780014 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.get_or_create( May 03 14:01:01.780014 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 14:01:01.780014 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application with Lock( May 03 14:01:01.780014 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 14:01:01.780014 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._enter() May 03 14:01:01.780014 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 14:01:01.780014 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 14:01:01.780014 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 14:01:01.780014 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.creator() May 03 14:01:01.780014 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 14:01:01.780014 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application created_value = creator( May 03 14:01:01.780953 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 14:01:01.780953 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 14:01:01.780953 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 14:01:01.780953 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application May 03 14:01:01.785264 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 544/1064] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 3 14:01:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 14:01:01.786293 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266cde6f-81bc-4752-8e60-c21ad3a866f8 None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:01:01.883667 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266cde6f-81bc-4752-8e60-c21ad3a866f8 None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:01:01.915504 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948a3b7a-758e-412f-88e9-fe60601a3528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:01:01.916160 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948a3b7a-758e-412f-88e9-fe60601a3528 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:01:01.916433 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948a3b7a-758e-412f-88e9-fe60601a3528 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:01:01.916699 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948a3b7a-758e-412f-88e9-fe60601a3528 None admin] PATH_INFO: `/v3/domains` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:01:01.917436 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948a3b7a-758e-412f-88e9-fe60601a3528 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80012) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:01:01.917737 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948a3b7a-758e-412f-88e9-fe60601a3528 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:01:01.919308 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948a3b7a-758e-412f-88e9-fe60601a3528 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:01:01.930576 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 521/1065] 10.222.0.36 () {56 vars in 1109 bytes} [Tue May 3 14:01:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 14:01:01.936049 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290c58d3-62a7-4680-873f-d3ed584f75d4 None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:01:02.032639 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290c58d3-62a7-4680-873f-d3ed584f75d4 None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:01:02.067423 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca64db1a-a660-471c-94fb-73201d3add51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:01:02.068231 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca64db1a-a660-471c-94fb-73201d3add51 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:01:02.068505 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca64db1a-a660-471c-94fb-73201d3add51 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:01:02.068767 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca64db1a-a660-471c-94fb-73201d3add51 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:01:02.077001 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca64db1a-a660-471c-94fb-73201d3add51 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:01:02.078480 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca64db1a-a660-471c-94fb-73201d3add51 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:01:02.093426 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application [None req-ca64db1a-a660-471c-94fb-73201d3add51 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 03 14:01:02.093426 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:01:02.093426 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 14:01:02.093426 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 14:01:02.093426 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 14:01:02.093426 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 14:01:02.093426 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 14:01:02.093426 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 14:01:02.093426 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 14:01:02.093426 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 14:01:02.093426 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 14:01:02.093426 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 14:01:02.093426 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 14:01:02.093426 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 14:01:02.093426 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 14:01:02.093426 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 14:01:02.094434 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 14:01:02.094434 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 14:01:02.094434 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 14:01:02.094434 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 14:01:02.094434 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 14:01:02.094434 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 14:01:02.094434 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 14:01:02.094434 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 14:01:02.094434 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 14:01:02.094434 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.get_or_create( May 03 14:01:02.094434 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 14:01:02.094434 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application with Lock( May 03 14:01:02.094434 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 14:01:02.094434 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._enter() May 03 14:01:02.094434 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 14:01:02.094434 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 14:01:02.094434 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 14:01:02.094434 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.creator() May 03 14:01:02.100646 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 14:01:02.100646 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application created_value = creator( May 03 14:01:02.100646 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 14:01:02.100646 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 14:01:02.100646 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 14:01:02.100646 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 14:01:02.100646 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 14:01:02.100646 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 14:01:02.100646 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 03 14:01:02.100646 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application May 03 14:01:02.100646 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 545/1066] 10.222.0.36 () {56 vars in 1093 bytes} [Tue May 3 14:01:01 2022] GET /identity/v3/users/nova => generated 82 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 14:01:02.101276 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948a3b7a-758e-412f-88e9-fe60601a3528 None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:01:02.201608 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948a3b7a-758e-412f-88e9-fe60601a3528 None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:01:02.235468 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ac6848-ad44-4c44-82ae-0d56c3936362 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:01:02.236132 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ac6848-ad44-4c44-82ae-0d56c3936362 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:01:02.236409 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ac6848-ad44-4c44-82ae-0d56c3936362 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:01:02.236676 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ac6848-ad44-4c44-82ae-0d56c3936362 None admin] PATH_INFO: `/v3/users` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:01:02.237560 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ac6848-ad44-4c44-82ae-0d56c3936362 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80012) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:01:02.237862 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ac6848-ad44-4c44-82ae-0d56c3936362 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:01:02.239279 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ac6848-ad44-4c44-82ae-0d56c3936362 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:01:02.256208 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 522/1067] 10.222.0.36 () {56 vars in 1133 bytes} [Tue May 3 14:01:02 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:01:02.261885 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca64db1a-a660-471c-94fb-73201d3add51 None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:01:02.359792 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca64db1a-a660-471c-94fb-73201d3add51 None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:01:02.393326 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092b6194-8efe-41ef-882f-39cf49654773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:01:02.394122 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092b6194-8efe-41ef-882f-39cf49654773 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:01:02.394395 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092b6194-8efe-41ef-882f-39cf49654773 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:01:02.394654 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092b6194-8efe-41ef-882f-39cf49654773 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:01:02.404491 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092b6194-8efe-41ef-882f-39cf49654773 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:01:02.405945 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092b6194-8efe-41ef-882f-39cf49654773 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:01:02.422651 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application [None req-092b6194-8efe-41ef-882f-39cf49654773 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 14:01:02.422651 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:01:02.422651 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 14:01:02.422651 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 14:01:02.422651 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 14:01:02.422651 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 14:01:02.422651 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 14:01:02.422651 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 14:01:02.422651 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 14:01:02.422651 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 14:01:02.422651 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 14:01:02.422651 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 14:01:02.422651 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 14:01:02.422651 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 14:01:02.422651 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 14:01:02.423568 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 14:01:02.423568 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 14:01:02.423568 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 14:01:02.423568 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 14:01:02.423568 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 14:01:02.423568 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 14:01:02.423568 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.get_or_create( May 03 14:01:02.423568 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 14:01:02.423568 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application with Lock( May 03 14:01:02.423568 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 14:01:02.423568 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._enter() May 03 14:01:02.423568 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 14:01:02.423568 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 14:01:02.423568 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 14:01:02.423568 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.creator() May 03 14:01:02.423568 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 14:01:02.423568 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application created_value = creator( May 03 14:01:02.429463 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 14:01:02.429463 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 14:01:02.429463 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 14:01:02.429463 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application May 03 14:01:02.429463 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 546/1068] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 3 14:01:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 14:01:02.429832 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ac6848-ad44-4c44-82ae-0d56c3936362 None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:01:02.533640 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ac6848-ad44-4c44-82ae-0d56c3936362 None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:01:02.568433 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4f9058-2f36-4999-9313-e372880628e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:01:02.569102 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4f9058-2f36-4999-9313-e372880628e3 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:01:02.569390 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4f9058-2f36-4999-9313-e372880628e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:01:02.569663 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4f9058-2f36-4999-9313-e372880628e3 None admin] PATH_INFO: `/v3/domains` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:01:02.570389 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4f9058-2f36-4999-9313-e372880628e3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80012) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:01:02.570697 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4f9058-2f36-4999-9313-e372880628e3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:01:02.572059 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4f9058-2f36-4999-9313-e372880628e3 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:01:02.584065 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 523/1069] 10.222.0.36 () {56 vars in 1109 bytes} [Tue May 3 14:01:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:01:02.590237 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092b6194-8efe-41ef-882f-39cf49654773 None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:01:02.691111 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092b6194-8efe-41ef-882f-39cf49654773 None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:01:02.726332 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e75668-8219-4d55-af56-5f5f576dfd83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:01:02.727135 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e75668-8219-4d55-af56-5f5f576dfd83 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:01:02.727385 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e75668-8219-4d55-af56-5f5f576dfd83 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:01:02.727685 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e75668-8219-4d55-af56-5f5f576dfd83 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:01:02.734517 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e75668-8219-4d55-af56-5f5f576dfd83 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:01:02.735955 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e75668-8219-4d55-af56-5f5f576dfd83 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:01:02.749566 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application [None req-d6e75668-8219-4d55-af56-5f5f576dfd83 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 14:01:02.749566 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:01:02.749566 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 14:01:02.749566 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 14:01:02.749566 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 14:01:02.749566 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 14:01:02.749566 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 14:01:02.749566 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 14:01:02.749566 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 14:01:02.749566 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 14:01:02.749566 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 14:01:02.749566 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 14:01:02.749566 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 14:01:02.749566 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 14:01:02.749566 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 14:01:02.750494 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 14:01:02.750494 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 14:01:02.750494 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 14:01:02.750494 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 14:01:02.750494 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 14:01:02.750494 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 14:01:02.750494 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.get_or_create( May 03 14:01:02.750494 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 14:01:02.750494 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application with Lock( May 03 14:01:02.750494 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 14:01:02.750494 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._enter() May 03 14:01:02.750494 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 14:01:02.750494 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 14:01:02.750494 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 14:01:02.750494 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.creator() May 03 14:01:02.750494 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 14:01:02.750494 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application created_value = creator( May 03 14:01:02.756285 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 14:01:02.756285 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 14:01:02.756285 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 14:01:02.756285 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 14:01:02.756285 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 14:01:02.756285 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 14:01:02.756285 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 14:01:02.756285 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application May 03 14:01:02.756285 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 547/1070] 10.222.0.36 () {56 vars in 1111 bytes} [Tue May 3 14:01:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 14:01:02.758308 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4f9058-2f36-4999-9313-e372880628e3 None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:01:02.864280 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4f9058-2f36-4999-9313-e372880628e3 None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:01:02.898868 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81817cf-b384-4896-add3-2d327a32c2f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:01:02.899556 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81817cf-b384-4896-add3-2d327a32c2f7 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:01:02.899777 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81817cf-b384-4896-add3-2d327a32c2f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:01:02.900071 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81817cf-b384-4896-add3-2d327a32c2f7 None admin] PATH_INFO: `/v3/projects` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:01:02.900861 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81817cf-b384-4896-add3-2d327a32c2f7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80012) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:01:02.901172 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81817cf-b384-4896-add3-2d327a32c2f7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:01:02.902902 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81817cf-b384-4896-add3-2d327a32c2f7 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:01:02.914858 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 524/1071] 10.222.0.36 () {56 vars in 1148 bytes} [Tue May 3 14:01:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:01:02.921118 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e75668-8219-4d55-af56-5f5f576dfd83 None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:01:03.020876 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e75668-8219-4d55-af56-5f5f576dfd83 None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:01:03.063570 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c51e94-83ec-4a31-8416-f6125e26d7e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:01:03.064900 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c51e94-83ec-4a31-8416-f6125e26d7e6 None admin] REQUEST_METHOD: `PUT` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:01:03.065436 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c51e94-83ec-4a31-8416-f6125e26d7e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:01:03.066447 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c51e94-83ec-4a31-8416-f6125e26d7e6 None admin] PATH_INFO: `/v3/projects/de541be478754087934323bdbe41a579/users/63489e658c094a2598a2ac62159d2fda/roles/83dea282ec144c95979d7e1b50c52a85` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:01:03.068901 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c51e94-83ec-4a31-8416-f6125e26d7e6 None admin] RBAC: Authorizing `identity:create_grant(project_id=de541be478754087934323bdbe41a579, user_id=63489e658c094a2598a2ac62159d2fda, role_id=83dea282ec144c95979d7e1b50c52a85)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:01:03.070390 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c51e94-83ec-4a31-8416-f6125e26d7e6 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:01:03.085725 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 548/1072] 10.222.0.36 () {58 vars in 1439 bytes} [Tue May 3 14:01:02 2022] PUT /identity/v3/projects/de541be478754087934323bdbe41a579/users/63489e658c094a2598a2ac62159d2fda/roles/83dea282ec144c95979d7e1b50c52a85 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:01:03.228181 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0188747-c179-4413-ab7b-92b31e7a7c8f None None] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:01:03.228431 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe222c2e-e15c-47b4-a7c9-e344098dec37 None None] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:01:03.228524 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0188747-c179-4413-ab7b-92b31e7a7c8f None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:01:03.228614 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe222c2e-e15c-47b4-a7c9-e344098dec37 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:01:03.228687 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0188747-c179-4413-ab7b-92b31e7a7c8f None None] PATH_INFO: `/` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:01:03.228963 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe222c2e-e15c-47b4-a7c9-e344098dec37 None None] PATH_INFO: `/` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:01:03.230564 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 525/1073] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 3 14:01:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 14:01:03.230787 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 549/1074] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 3 14:01:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 14:01:03.235946 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064f484e-925f-4aa1-b578-3db6d101565b None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:01:03.236234 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064f484e-925f-4aa1-b578-3db6d101565b None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:01:03.236735 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064f484e-925f-4aa1-b578-3db6d101565b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:01:03.238203 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860e668a-3e11-4c45-88a1-1c950d8b7fdf None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:01:03.238516 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860e668a-3e11-4c45-88a1-1c950d8b7fdf None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:01:03.238749 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860e668a-3e11-4c45-88a1-1c950d8b7fdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:01:03.256186 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-064f484e-925f-4aa1-b578-3db6d101565b None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:01:03.257426 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-064f484e-925f-4aa1-b578-3db6d101565b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:01:03.257763 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-860e668a-3e11-4c45-88a1-1c950d8b7fdf None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:01:03.258909 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-860e668a-3e11-4c45-88a1-1c950d8b7fdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:01:03.328025 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 550/1075] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 3 14:01:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 03 14:01:03.329478 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 526/1076] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 3 14:01:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 14:01:03.350206 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860e668a-3e11-4c45-88a1-1c950d8b7fdf None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:01:03.352204 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064f484e-925f-4aa1-b578-3db6d101565b None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:01:03.444615 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860e668a-3e11-4c45-88a1-1c950d8b7fdf None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:01:03.444879 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064f484e-925f-4aa1-b578-3db6d101565b None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:01:03.477804 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d122f010-6bde-45dc-88f8-5cda9c88927a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:01:03.478626 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d122f010-6bde-45dc-88f8-5cda9c88927a None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:01:03.478905 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d122f010-6bde-45dc-88f8-5cda9c88927a None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:01:03.479263 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d122f010-6bde-45dc-88f8-5cda9c88927a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:01:03.479716 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461f8b26-918b-4a37-ad95-7b4fd09a2321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:01:03.480433 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461f8b26-918b-4a37-ad95-7b4fd09a2321 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:01:03.480821 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461f8b26-918b-4a37-ad95-7b4fd09a2321 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:01:03.481229 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461f8b26-918b-4a37-ad95-7b4fd09a2321 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:01:03.490744 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d122f010-6bde-45dc-88f8-5cda9c88927a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 14:01:03.499165 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application [None req-d122f010-6bde-45dc-88f8-5cda9c88927a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 03 14:01:03.499165 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:01:03.499165 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 14:01:03.499165 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 14:01:03.499165 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 14:01:03.499165 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 14:01:03.499165 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 14:01:03.499165 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 14:01:03.499165 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 14:01:03.499165 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 14:01:03.499165 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 14:01:03.499165 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 14:01:03.499165 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 14:01:03.499165 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 14:01:03.499165 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 14:01:03.499165 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 14:01:03.500413 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 14:01:03.500413 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 14:01:03.500413 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 14:01:03.500413 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 14:01:03.500413 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 14:01:03.500413 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 14:01:03.500413 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 14:01:03.500413 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 14:01:03.500413 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 14:01:03.500413 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.get_or_create( May 03 14:01:03.500413 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 14:01:03.500413 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application with Lock( May 03 14:01:03.500413 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 14:01:03.500413 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._enter() May 03 14:01:03.500413 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 14:01:03.500413 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 14:01:03.501519 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 14:01:03.501519 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.creator() May 03 14:01:03.501519 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 14:01:03.501519 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application created_value = creator( May 03 14:01:03.501519 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 14:01:03.501519 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 14:01:03.501519 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 14:01:03.501519 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 14:01:03.501519 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 14:01:03.501519 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 14:01:03.501519 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 03 14:01:03.501519 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application May 03 14:01:03.504029 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 551/1077] 10.222.0.36 () {56 vars in 1096 bytes} [Tue May 3 14:01:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 14:01:03.509795 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d122f010-6bde-45dc-88f8-5cda9c88927a None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:01:03.549502 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461f8b26-918b-4a37-ad95-7b4fd09a2321 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:01:03.550944 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461f8b26-918b-4a37-ad95-7b4fd09a2321 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:01:03.608144 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d122f010-6bde-45dc-88f8-5cda9c88927a None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:01:03.640918 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dc2a9e-7965-41c8-a30c-b4fae3df2896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:01:03.641612 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dc2a9e-7965-41c8-a30c-b4fae3df2896 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:01:03.641893 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dc2a9e-7965-41c8-a30c-b4fae3df2896 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:01:03.642163 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dc2a9e-7965-41c8-a30c-b4fae3df2896 None admin] PATH_INFO: `/v3/roles` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:01:03.642896 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dc2a9e-7965-41c8-a30c-b4fae3df2896 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:01:03.643391 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dc2a9e-7965-41c8-a30c-b4fae3df2896 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:01:03.644132 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 527/1078] 10.222.0.36 () {58 vars in 1282 bytes} [Tue May 3 14:01:03 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 03 14:01:03.644939 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dc2a9e-7965-41c8-a30c-b4fae3df2896 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:01:03.650074 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461f8b26-918b-4a37-ad95-7b4fd09a2321 None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:01:03.658892 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 552/1079] 10.222.0.36 () {56 vars in 1099 bytes} [Tue May 3 14:01:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:01:03.659920 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dc2a9e-7965-41c8-a30c-b4fae3df2896 None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:01:03.747208 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461f8b26-918b-4a37-ad95-7b4fd09a2321 None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:01:03.761614 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dc2a9e-7965-41c8-a30c-b4fae3df2896 None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:01:03.780341 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5333fa2-da82-4ea6-bab8-a59970fa1c9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:01:03.781505 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5333fa2-da82-4ea6-bab8-a59970fa1c9e None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:01:03.781505 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5333fa2-da82-4ea6-bab8-a59970fa1c9e None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:01:03.781799 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5333fa2-da82-4ea6-bab8-a59970fa1c9e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:01:03.791979 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5333fa2-da82-4ea6-bab8-a59970fa1c9e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:01:03.793481 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5333fa2-da82-4ea6-bab8-a59970fa1c9e None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:01:03.794910 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a190e33-ca98-4e92-afb5-1bbc25bcb64e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:01:03.795783 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a190e33-ca98-4e92-afb5-1bbc25bcb64e None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:01:03.796085 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a190e33-ca98-4e92-afb5-1bbc25bcb64e None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:01:03.796340 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a190e33-ca98-4e92-afb5-1bbc25bcb64e None admin] PATH_INFO: `/v3/users/454beff0dbba4ad69f19c87143755d1f` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:01:03.797553 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a190e33-ca98-4e92-afb5-1bbc25bcb64e None admin] RBAC: Authorizing `identity:get_user(user_id=454beff0dbba4ad69f19c87143755d1f)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:01:03.798967 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a190e33-ca98-4e92-afb5-1bbc25bcb64e None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:01:03.800752 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 553/1080] 10.222.0.36 () {56 vars in 1177 bytes} [Tue May 3 14:01:03 2022] GET /identity/v3/users/454beff0dbba4ad69f19c87143755d1f => generated 285 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:01:03.806686 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a190e33-ca98-4e92-afb5-1bbc25bcb64e None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:01:03.811286 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application [None req-b5333fa2-da82-4ea6-bab8-a59970fa1c9e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 14:01:03.811286 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:01:03.811286 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 14:01:03.811286 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 14:01:03.811286 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 14:01:03.811286 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 14:01:03.811286 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 14:01:03.811286 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 14:01:03.811286 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 14:01:03.811286 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 14:01:03.811286 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 14:01:03.811286 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 14:01:03.811286 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 14:01:03.811286 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 14:01:03.811286 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 14:01:03.812267 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 14:01:03.812267 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 14:01:03.812267 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 14:01:03.812267 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 14:01:03.812267 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 14:01:03.812267 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 14:01:03.812267 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.get_or_create( May 03 14:01:03.812267 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 14:01:03.812267 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application with Lock( May 03 14:01:03.812267 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 14:01:03.812267 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._enter() May 03 14:01:03.812267 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 14:01:03.812267 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 14:01:03.812267 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 14:01:03.812267 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.creator() May 03 14:01:03.812267 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 14:01:03.812267 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application created_value = creator( May 03 14:01:03.818807 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 14:01:03.818807 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 14:01:03.818807 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 14:01:03.818807 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application May 03 14:01:03.818807 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 528/1081] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 3 14:01:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 14:01:03.818807 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5333fa2-da82-4ea6-bab8-a59970fa1c9e None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:01:03.905107 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a190e33-ca98-4e92-afb5-1bbc25bcb64e None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:01:03.914794 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5333fa2-da82-4ea6-bab8-a59970fa1c9e None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:01:03.937195 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b94ffc1-47ea-4c9c-ab0e-1fcb145103b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:01:03.938101 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b94ffc1-47ea-4c9c-ab0e-1fcb145103b9 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:01:03.938382 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b94ffc1-47ea-4c9c-ab0e-1fcb145103b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:01:03.938733 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b94ffc1-47ea-4c9c-ab0e-1fcb145103b9 None admin] PATH_INFO: `/v3/projects/fcb3f0754da4449aa4e3612cb2852ae3` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:01:03.939831 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b94ffc1-47ea-4c9c-ab0e-1fcb145103b9 None admin] RBAC: Authorizing `identity:get_project(project_id=fcb3f0754da4449aa4e3612cb2852ae3)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:01:03.941358 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b94ffc1-47ea-4c9c-ab0e-1fcb145103b9 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:01:03.943006 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 554/1082] 10.222.0.36 () {56 vars in 1186 bytes} [Tue May 3 14:01:03 2022] GET /identity/v3/projects/fcb3f0754da4449aa4e3612cb2852ae3 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 14:01:03.947865 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bfda41-cbe5-4210-b2cc-10cc2cac072c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:01:03.948700 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b94ffc1-47ea-4c9c-ab0e-1fcb145103b9 None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:01:03.948813 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bfda41-cbe5-4210-b2cc-10cc2cac072c None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:01:03.949106 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bfda41-cbe5-4210-b2cc-10cc2cac072c None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:01:03.949344 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bfda41-cbe5-4210-b2cc-10cc2cac072c None admin] PATH_INFO: `/v3/domains` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:01:03.950220 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bfda41-cbe5-4210-b2cc-10cc2cac072c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80012) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:01:03.950525 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bfda41-cbe5-4210-b2cc-10cc2cac072c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:01:03.951877 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bfda41-cbe5-4210-b2cc-10cc2cac072c None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:01:03.973598 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 529/1083] 10.222.0.36 () {56 vars in 1109 bytes} [Tue May 3 14:01:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 14:01:04.069786 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b94ffc1-47ea-4c9c-ab0e-1fcb145103b9 None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:01:04.105921 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4744c10-d096-4db1-a386-48851eafceef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:01:04.106952 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4744c10-d096-4db1-a386-48851eafceef None admin] REQUEST_METHOD: `PUT` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:01:04.107230 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4744c10-d096-4db1-a386-48851eafceef None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:01:04.107500 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4744c10-d096-4db1-a386-48851eafceef None admin] PATH_INFO: `/v3/projects/fcb3f0754da4449aa4e3612cb2852ae3/users/454beff0dbba4ad69f19c87143755d1f/roles/36abe9b50fd8479c86c4f8f70fd85aa3` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:01:04.109693 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4744c10-d096-4db1-a386-48851eafceef None admin] RBAC: Authorizing `identity:create_grant(project_id=fcb3f0754da4449aa4e3612cb2852ae3, user_id=454beff0dbba4ad69f19c87143755d1f, role_id=36abe9b50fd8479c86c4f8f70fd85aa3)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:01:04.111144 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4744c10-d096-4db1-a386-48851eafceef None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:01:04.127784 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 555/1084] 10.222.0.36 () {58 vars in 1439 bytes} [Tue May 3 14:01:03 2022] PUT /identity/v3/projects/fcb3f0754da4449aa4e3612cb2852ae3/users/454beff0dbba4ad69f19c87143755d1f/roles/36abe9b50fd8479c86c4f8f70fd85aa3 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 14:01:05.301055 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a16566-0451-4f10-a60c-6146254fa3c9 None None] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:01:05.301638 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a16566-0451-4f10-a60c-6146254fa3c9 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:01:05.301638 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a16566-0451-4f10-a60c-6146254fa3c9 None None] PATH_INFO: `/` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:01:05.302983 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 530/1085] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 3 14:01:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 14:01:05.308222 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cbe2c4-a7c3-4727-a088-83c28265b6d8 None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:01:05.308815 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cbe2c4-a7c3-4727-a088-83c28265b6d8 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:01:05.308906 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cbe2c4-a7c3-4727-a088-83c28265b6d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:01:05.326281 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-34cbe2c4-a7c3-4727-a088-83c28265b6d8 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:01:05.327395 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-34cbe2c4-a7c3-4727-a088-83c28265b6d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:01:05.395367 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 556/1086] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 3 14:01:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 14:01:05.418304 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a16566-0451-4f10-a60c-6146254fa3c9 None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:01:05.520686 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a16566-0451-4f10-a60c-6146254fa3c9 None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:01:05.553315 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a27d73-f2fd-4b35-8130-ceeefcdb298b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:01:05.554116 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a27d73-f2fd-4b35-8130-ceeefcdb298b None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:01:05.554393 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a27d73-f2fd-4b35-8130-ceeefcdb298b None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:01:05.554657 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a27d73-f2fd-4b35-8130-ceeefcdb298b None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:01:05.565314 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a27d73-f2fd-4b35-8130-ceeefcdb298b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 14:01:05.573314 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application [None req-40a27d73-f2fd-4b35-8130-ceeefcdb298b None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 03 14:01:05.573314 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:01:05.573314 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 14:01:05.573314 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 14:01:05.573314 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 14:01:05.573314 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 14:01:05.573314 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 14:01:05.573314 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 14:01:05.573314 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 14:01:05.573314 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 14:01:05.573314 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 14:01:05.573314 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 14:01:05.573314 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 14:01:05.573314 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 14:01:05.573314 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 14:01:05.573314 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 14:01:05.574601 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 14:01:05.574601 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 14:01:05.574601 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 14:01:05.574601 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 14:01:05.574601 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 14:01:05.574601 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 14:01:05.574601 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 14:01:05.574601 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 14:01:05.574601 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 14:01:05.574601 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.get_or_create( May 03 14:01:05.574601 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 14:01:05.574601 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application with Lock( May 03 14:01:05.574601 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 14:01:05.574601 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._enter() May 03 14:01:05.574601 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 14:01:05.574601 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 14:01:05.575488 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 14:01:05.575488 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.creator() May 03 14:01:05.575488 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 14:01:05.575488 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application created_value = creator( May 03 14:01:05.575488 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 14:01:05.575488 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 14:01:05.575488 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 14:01:05.575488 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 14:01:05.575488 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 14:01:05.575488 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 14:01:05.575488 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 03 14:01:05.575488 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application May 03 14:01:05.575488 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 531/1087] 10.222.0.36 () {56 vars in 1120 bytes} [Tue May 3 14:01:05 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 14:01:05.580736 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cbe2c4-a7c3-4727-a088-83c28265b6d8 None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:01:05.678661 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cbe2c4-a7c3-4727-a088-83c28265b6d8 None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:01:05.712195 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d4a060-94b5-4650-89bd-0feaa110f80d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:01:05.712849 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d4a060-94b5-4650-89bd-0feaa110f80d None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:01:05.713127 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d4a060-94b5-4650-89bd-0feaa110f80d None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:01:05.713738 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d4a060-94b5-4650-89bd-0feaa110f80d None admin] PATH_INFO: `/v3/roles` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:01:05.714475 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d4a060-94b5-4650-89bd-0feaa110f80d None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:01:05.714927 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d4a060-94b5-4650-89bd-0feaa110f80d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:01:05.716295 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d4a060-94b5-4650-89bd-0feaa110f80d None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:01:05.724065 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 557/1088] 10.222.0.36 () {56 vars in 1115 bytes} [Tue May 3 14:01:05 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:01:05.729859 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a27d73-f2fd-4b35-8130-ceeefcdb298b None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:01:05.826108 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a27d73-f2fd-4b35-8130-ceeefcdb298b None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:01:05.860030 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd9800e-3531-4224-aff3-ba2a96c6cea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:01:05.860748 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd9800e-3531-4224-aff3-ba2a96c6cea3 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:01:05.861026 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd9800e-3531-4224-aff3-ba2a96c6cea3 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:01:05.861315 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd9800e-3531-4224-aff3-ba2a96c6cea3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:01:05.871336 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd9800e-3531-4224-aff3-ba2a96c6cea3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:01:05.872779 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd9800e-3531-4224-aff3-ba2a96c6cea3 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:01:05.889958 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application [None req-6bd9800e-3531-4224-aff3-ba2a96c6cea3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 14:01:05.889958 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:01:05.889958 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 14:01:05.889958 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 14:01:05.889958 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 14:01:05.889958 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 14:01:05.889958 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 14:01:05.889958 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 14:01:05.889958 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 14:01:05.889958 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 14:01:05.889958 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 14:01:05.889958 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 14:01:05.889958 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 14:01:05.889958 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 14:01:05.889958 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 14:01:05.891041 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 14:01:05.891041 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 14:01:05.891041 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 14:01:05.891041 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 14:01:05.891041 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 14:01:05.891041 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 14:01:05.891041 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.get_or_create( May 03 14:01:05.891041 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 14:01:05.891041 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application with Lock( May 03 14:01:05.891041 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 14:01:05.891041 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._enter() May 03 14:01:05.891041 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 14:01:05.891041 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 14:01:05.891041 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 14:01:05.891041 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.creator() May 03 14:01:05.891041 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 14:01:05.891041 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application created_value = creator( May 03 14:01:05.891983 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 14:01:05.891983 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 14:01:05.891983 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 14:01:05.891983 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application May 03 14:01:05.891983 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 532/1089] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 3 14:01:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 14:01:05.897019 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d4a060-94b5-4650-89bd-0feaa110f80d None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:01:05.996103 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d4a060-94b5-4650-89bd-0feaa110f80d None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:01:06.029075 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6828fb1-425c-4478-984c-e6fc99187189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:01:06.029760 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6828fb1-425c-4478-984c-e6fc99187189 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:01:06.030032 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6828fb1-425c-4478-984c-e6fc99187189 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:01:06.030305 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6828fb1-425c-4478-984c-e6fc99187189 None admin] PATH_INFO: `/v3/domains` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:01:06.031010 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6828fb1-425c-4478-984c-e6fc99187189 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:01:06.031308 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6828fb1-425c-4478-984c-e6fc99187189 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:01:06.032681 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6828fb1-425c-4478-984c-e6fc99187189 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:01:06.046015 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 558/1090] 10.222.0.36 () {56 vars in 1109 bytes} [Tue May 3 14:01:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:01:06.050692 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd9800e-3531-4224-aff3-ba2a96c6cea3 None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:01:06.154859 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd9800e-3531-4224-aff3-ba2a96c6cea3 None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:01:06.190764 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a5358e-0697-4331-a069-27a9da436853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:01:06.191568 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a5358e-0697-4331-a069-27a9da436853 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:01:06.191846 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a5358e-0697-4331-a069-27a9da436853 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:01:06.192116 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a5358e-0697-4331-a069-27a9da436853 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:01:06.199789 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a5358e-0697-4331-a069-27a9da436853 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:01:06.201220 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a5358e-0697-4331-a069-27a9da436853 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:01:06.219822 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application [None req-95a5358e-0697-4331-a069-27a9da436853 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 03 14:01:06.219822 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:01:06.219822 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 14:01:06.219822 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 14:01:06.219822 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 14:01:06.219822 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 14:01:06.219822 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 14:01:06.219822 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 14:01:06.219822 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 14:01:06.219822 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 14:01:06.219822 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 14:01:06.219822 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 14:01:06.219822 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 14:01:06.219822 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 14:01:06.219822 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 14:01:06.219822 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 14:01:06.221149 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 14:01:06.221149 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 14:01:06.221149 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 14:01:06.221149 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 14:01:06.221149 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 14:01:06.221149 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 14:01:06.221149 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 14:01:06.221149 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 14:01:06.221149 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 14:01:06.221149 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.get_or_create( May 03 14:01:06.221149 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 14:01:06.221149 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application with Lock( May 03 14:01:06.221149 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 14:01:06.221149 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._enter() May 03 14:01:06.221149 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 14:01:06.221149 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 14:01:06.221149 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 14:01:06.221149 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.creator() May 03 14:01:06.222265 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 14:01:06.222265 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application created_value = creator( May 03 14:01:06.222265 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 14:01:06.222265 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 14:01:06.222265 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 14:01:06.222265 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 14:01:06.222265 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 14:01:06.222265 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 14:01:06.222265 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 03 14:01:06.222265 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application May 03 14:01:06.222265 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 533/1091] 10.222.0.36 () {56 vars in 1093 bytes} [Tue May 3 14:01:06 2022] GET /identity/v3/users/nova => generated 82 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 14:01:06.226992 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6828fb1-425c-4478-984c-e6fc99187189 None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:01:06.331154 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8d014b-558f-4588-b26c-c65c55dc3a8b None None] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:01:06.331728 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8d014b-558f-4588-b26c-c65c55dc3a8b None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:01:06.331728 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8d014b-558f-4588-b26c-c65c55dc3a8b None None] PATH_INFO: `/` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:01:06.331924 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6828fb1-425c-4478-984c-e6fc99187189 None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:01:06.333060 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 534/1092] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 3 14:01:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 14:01:06.338078 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18074076-881a-48f3-be17-462bd5a9d64a None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:01:06.338668 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18074076-881a-48f3-be17-462bd5a9d64a None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:01:06.338954 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18074076-881a-48f3-be17-462bd5a9d64a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:01:06.356376 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-18074076-881a-48f3-be17-462bd5a9d64a None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:01:06.357570 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-18074076-881a-48f3-be17-462bd5a9d64a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:01:06.365370 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91afa5c-9ac8-447a-830e-c55dcb47bad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:01:06.366046 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91afa5c-9ac8-447a-830e-c55dcb47bad8 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:01:06.366325 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91afa5c-9ac8-447a-830e-c55dcb47bad8 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:01:06.366594 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91afa5c-9ac8-447a-830e-c55dcb47bad8 None admin] PATH_INFO: `/v3/users` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:01:06.367421 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91afa5c-9ac8-447a-830e-c55dcb47bad8 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:01:06.367723 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91afa5c-9ac8-447a-830e-c55dcb47bad8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:01:06.369145 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91afa5c-9ac8-447a-830e-c55dcb47bad8 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:01:06.385548 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 559/1093] 10.222.0.36 () {56 vars in 1133 bytes} [Tue May 3 14:01:06 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 14:01:06.391235 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91afa5c-9ac8-447a-830e-c55dcb47bad8 None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:01:06.422291 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 535/1094] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 3 14:01:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 14:01:06.445186 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18074076-881a-48f3-be17-462bd5a9d64a None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:01:06.486806 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91afa5c-9ac8-447a-830e-c55dcb47bad8 None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:01:06.519447 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66124d47-26fd-460e-a655-0e8b1659984f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:01:06.520092 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66124d47-26fd-460e-a655-0e8b1659984f None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:01:06.520371 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66124d47-26fd-460e-a655-0e8b1659984f None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:01:06.520645 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66124d47-26fd-460e-a655-0e8b1659984f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:01:06.541775 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18074076-881a-48f3-be17-462bd5a9d64a None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:01:06.574824 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5365fe-22f5-4681-b04c-b52c56e2016a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:01:06.575610 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5365fe-22f5-4681-b04c-b52c56e2016a None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:01:06.575884 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5365fe-22f5-4681-b04c-b52c56e2016a None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:01:06.576158 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5365fe-22f5-4681-b04c-b52c56e2016a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:01:06.585051 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66124d47-26fd-460e-a655-0e8b1659984f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:01:06.585770 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5365fe-22f5-4681-b04c-b52c56e2016a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 14:01:06.586533 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66124d47-26fd-460e-a655-0e8b1659984f None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:01:06.593890 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application [None req-9d5365fe-22f5-4681-b04c-b52c56e2016a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 03 14:01:06.593890 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:01:06.593890 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 14:01:06.593890 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 14:01:06.593890 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 14:01:06.593890 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 14:01:06.593890 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 14:01:06.593890 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 14:01:06.593890 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 14:01:06.593890 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 14:01:06.593890 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 14:01:06.593890 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 14:01:06.593890 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 14:01:06.593890 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 14:01:06.593890 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 14:01:06.593890 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 14:01:06.594966 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 14:01:06.594966 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 14:01:06.594966 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 14:01:06.594966 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 14:01:06.594966 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 14:01:06.594966 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 14:01:06.594966 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 14:01:06.594966 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 14:01:06.594966 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 14:01:06.594966 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.get_or_create( May 03 14:01:06.594966 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 14:01:06.594966 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application with Lock( May 03 14:01:06.594966 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 14:01:06.594966 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._enter() May 03 14:01:06.594966 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 14:01:06.594966 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 14:01:06.595857 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 14:01:06.595857 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.creator() May 03 14:01:06.595857 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 14:01:06.595857 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application created_value = creator( May 03 14:01:06.595857 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 14:01:06.595857 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 14:01:06.595857 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 14:01:06.595857 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 14:01:06.595857 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 14:01:06.595857 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 14:01:06.595857 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 03 14:01:06.595857 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application May 03 14:01:06.595857 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 536/1095] 10.222.0.36 () {56 vars in 1096 bytes} [Tue May 3 14:01:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 14:01:06.601133 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5365fe-22f5-4681-b04c-b52c56e2016a None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:01:06.681709 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 560/1096] 10.222.0.36 () {58 vars in 1282 bytes} [Tue May 3 14:01:06 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 03 14:01:06.687536 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66124d47-26fd-460e-a655-0e8b1659984f None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:01:06.693825 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5365fe-22f5-4681-b04c-b52c56e2016a None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:01:06.727491 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1639ab6-f83f-4807-9b2a-ee07f37baa48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:01:06.728138 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1639ab6-f83f-4807-9b2a-ee07f37baa48 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:01:06.728415 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1639ab6-f83f-4807-9b2a-ee07f37baa48 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:01:06.728683 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1639ab6-f83f-4807-9b2a-ee07f37baa48 None admin] PATH_INFO: `/v3/roles` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:01:06.729410 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1639ab6-f83f-4807-9b2a-ee07f37baa48 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80012) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:01:06.729709 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1639ab6-f83f-4807-9b2a-ee07f37baa48 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:01:06.731106 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1639ab6-f83f-4807-9b2a-ee07f37baa48 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:01:06.738855 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 537/1097] 10.222.0.36 () {56 vars in 1099 bytes} [Tue May 3 14:01:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 14:01:06.744523 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1639ab6-f83f-4807-9b2a-ee07f37baa48 None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:01:06.785621 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66124d47-26fd-460e-a655-0e8b1659984f None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:01:06.819398 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263d4bf2-fa7e-48b1-a1ab-a3238d3f1866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:01:06.820219 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263d4bf2-fa7e-48b1-a1ab-a3238d3f1866 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:01:06.820490 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263d4bf2-fa7e-48b1-a1ab-a3238d3f1866 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:01:06.820757 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263d4bf2-fa7e-48b1-a1ab-a3238d3f1866 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:01:06.830285 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263d4bf2-fa7e-48b1-a1ab-a3238d3f1866 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:01:06.831713 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263d4bf2-fa7e-48b1-a1ab-a3238d3f1866 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:01:06.839687 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1639ab6-f83f-4807-9b2a-ee07f37baa48 None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:01:06.849701 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application [None req-263d4bf2-fa7e-48b1-a1ab-a3238d3f1866 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 14:01:06.849701 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:01:06.849701 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 14:01:06.849701 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 14:01:06.849701 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 14:01:06.849701 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 14:01:06.849701 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 14:01:06.849701 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 14:01:06.849701 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 14:01:06.849701 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 14:01:06.849701 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 14:01:06.849701 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 14:01:06.849701 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 14:01:06.849701 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 14:01:06.849701 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 14:01:06.850690 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 14:01:06.850690 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 14:01:06.850690 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 14:01:06.850690 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 14:01:06.850690 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 14:01:06.850690 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 14:01:06.850690 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.get_or_create( May 03 14:01:06.850690 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 14:01:06.850690 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application with Lock( May 03 14:01:06.850690 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 14:01:06.850690 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._enter() May 03 14:01:06.850690 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 14:01:06.850690 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 14:01:06.850690 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 14:01:06.850690 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.creator() May 03 14:01:06.850690 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 14:01:06.850690 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application created_value = creator( May 03 14:01:06.851636 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 14:01:06.851636 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 14:01:06.851636 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 14:01:06.851636 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application May 03 14:01:06.851636 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 561/1098] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 3 14:01:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 14:01:06.856565 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263d4bf2-fa7e-48b1-a1ab-a3238d3f1866 None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:01:06.871327 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773d66a2-11b8-4f58-a230-2d3dc11d5bc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:01:06.872203 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773d66a2-11b8-4f58-a230-2d3dc11d5bc0 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:01:06.872476 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773d66a2-11b8-4f58-a230-2d3dc11d5bc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:01:06.872748 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773d66a2-11b8-4f58-a230-2d3dc11d5bc0 None admin] PATH_INFO: `/v3/users/454beff0dbba4ad69f19c87143755d1f` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:01:06.873939 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773d66a2-11b8-4f58-a230-2d3dc11d5bc0 None admin] RBAC: Authorizing `identity:get_user(user_id=454beff0dbba4ad69f19c87143755d1f)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:01:06.875368 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773d66a2-11b8-4f58-a230-2d3dc11d5bc0 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:01:06.877005 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 538/1099] 10.222.0.36 () {56 vars in 1177 bytes} [Tue May 3 14:01:06 2022] GET /identity/v3/users/454beff0dbba4ad69f19c87143755d1f => generated 285 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 14:01:06.882715 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773d66a2-11b8-4f58-a230-2d3dc11d5bc0 None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:01:06.954236 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263d4bf2-fa7e-48b1-a1ab-a3238d3f1866 None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:01:06.977127 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773d66a2-11b8-4f58-a230-2d3dc11d5bc0 None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:01:06.986998 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c78ea8-0480-4cd1-8534-c3195db1164a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:01:06.987653 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c78ea8-0480-4cd1-8534-c3195db1164a None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:01:06.987969 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c78ea8-0480-4cd1-8534-c3195db1164a None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:01:06.988214 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c78ea8-0480-4cd1-8534-c3195db1164a None admin] PATH_INFO: `/v3/domains` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:01:06.988959 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c78ea8-0480-4cd1-8534-c3195db1164a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:01:06.989301 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c78ea8-0480-4cd1-8534-c3195db1164a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:01:06.990664 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c78ea8-0480-4cd1-8534-c3195db1164a None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:01:07.002031 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 562/1100] 10.222.0.36 () {56 vars in 1109 bytes} [Tue May 3 14:01:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:01:07.007713 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c78ea8-0480-4cd1-8534-c3195db1164a None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:01:07.011245 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d83ff9b-6c33-4582-89be-54a51580c8bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:01:07.011940 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d83ff9b-6c33-4582-89be-54a51580c8bd None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:01:07.012221 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d83ff9b-6c33-4582-89be-54a51580c8bd None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:01:07.012496 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d83ff9b-6c33-4582-89be-54a51580c8bd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:01:07.081825 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d83ff9b-6c33-4582-89be-54a51580c8bd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:01:07.083293 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d83ff9b-6c33-4582-89be-54a51580c8bd None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:01:07.109269 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c78ea8-0480-4cd1-8534-c3195db1164a None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:01:07.141850 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecedc40-c89c-4d6d-9120-5a010cd0484d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:01:07.142640 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecedc40-c89c-4d6d-9120-5a010cd0484d None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:01:07.142918 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecedc40-c89c-4d6d-9120-5a010cd0484d None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:01:07.143189 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecedc40-c89c-4d6d-9120-5a010cd0484d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:01:07.149616 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecedc40-c89c-4d6d-9120-5a010cd0484d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:01:07.151043 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecedc40-c89c-4d6d-9120-5a010cd0484d None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:01:07.164641 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application [None req-cecedc40-c89c-4d6d-9120-5a010cd0484d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 14:01:07.164641 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:01:07.164641 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 14:01:07.164641 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 14:01:07.164641 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 14:01:07.164641 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 14:01:07.164641 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 14:01:07.164641 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 14:01:07.164641 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 14:01:07.164641 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 14:01:07.164641 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 14:01:07.164641 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 14:01:07.164641 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 14:01:07.164641 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 14:01:07.164641 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 14:01:07.165633 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 14:01:07.165633 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 14:01:07.165633 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 14:01:07.165633 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 14:01:07.165633 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 14:01:07.165633 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 14:01:07.165633 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.get_or_create( May 03 14:01:07.165633 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 14:01:07.165633 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application with Lock( May 03 14:01:07.165633 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 14:01:07.165633 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._enter() May 03 14:01:07.165633 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 14:01:07.165633 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 14:01:07.165633 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 14:01:07.165633 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.creator() May 03 14:01:07.165633 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 14:01:07.165633 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application created_value = creator( May 03 14:01:07.166591 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 14:01:07.166591 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 14:01:07.166591 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 14:01:07.166591 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 14:01:07.166591 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 14:01:07.166591 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 14:01:07.166591 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 14:01:07.166591 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application May 03 14:01:07.166591 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 563/1101] 10.222.0.36 () {56 vars in 1111 bytes} [Tue May 3 14:01:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 14:01:07.171977 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecedc40-c89c-4d6d-9120-5a010cd0484d None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:01:07.178840 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 539/1102] 10.222.0.36 () {58 vars in 1282 bytes} [Tue May 3 14:01:06 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 03 14:01:07.184681 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d83ff9b-6c33-4582-89be-54a51580c8bd None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:01:07.269210 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecedc40-c89c-4d6d-9120-5a010cd0484d None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:01:07.277370 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d83ff9b-6c33-4582-89be-54a51580c8bd None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:01:07.304154 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665ca5d3-8a2d-43b5-be81-adc21ba0a352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:01:07.304817 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665ca5d3-8a2d-43b5-be81-adc21ba0a352 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:01:07.305096 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665ca5d3-8a2d-43b5-be81-adc21ba0a352 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:01:07.305394 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665ca5d3-8a2d-43b5-be81-adc21ba0a352 None admin] PATH_INFO: `/v3/projects` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:01:07.306189 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665ca5d3-8a2d-43b5-be81-adc21ba0a352 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:01:07.306562 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665ca5d3-8a2d-43b5-be81-adc21ba0a352 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:01:07.307932 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665ca5d3-8a2d-43b5-be81-adc21ba0a352 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:01:07.309436 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfce0b3f-5394-4ed0-8e54-8b9c8e6504ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:01:07.310275 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfce0b3f-5394-4ed0-8e54-8b9c8e6504ed None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:01:07.310548 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfce0b3f-5394-4ed0-8e54-8b9c8e6504ed None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:01:07.310819 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfce0b3f-5394-4ed0-8e54-8b9c8e6504ed None admin] PATH_INFO: `/v3/projects/fcb3f0754da4449aa4e3612cb2852ae3` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:01:07.311975 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfce0b3f-5394-4ed0-8e54-8b9c8e6504ed None admin] RBAC: Authorizing `identity:get_project(project_id=fcb3f0754da4449aa4e3612cb2852ae3)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:01:07.313404 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfce0b3f-5394-4ed0-8e54-8b9c8e6504ed None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:01:07.315125 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 540/1103] 10.222.0.36 () {56 vars in 1186 bytes} [Tue May 3 14:01:07 2022] GET /identity/v3/projects/fcb3f0754da4449aa4e3612cb2852ae3 => generated 311 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 14:01:07.319571 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 564/1104] 10.222.0.36 () {56 vars in 1148 bytes} [Tue May 3 14:01:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 14:01:07.321269 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfce0b3f-5394-4ed0-8e54-8b9c8e6504ed None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:01:07.325455 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665ca5d3-8a2d-43b5-be81-adc21ba0a352 None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:01:07.413962 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfce0b3f-5394-4ed0-8e54-8b9c8e6504ed None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:01:07.421746 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665ca5d3-8a2d-43b5-be81-adc21ba0a352 None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:01:07.445702 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a387ec2-c3e7-438f-9e24-ff4afe29c168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:01:07.446345 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a387ec2-c3e7-438f-9e24-ff4afe29c168 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:01:07.446616 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a387ec2-c3e7-438f-9e24-ff4afe29c168 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:01:07.446880 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a387ec2-c3e7-438f-9e24-ff4afe29c168 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:01:07.447703 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a387ec2-c3e7-438f-9e24-ff4afe29c168 None admin] RBAC: Adding query filter params (role.id=36abe9b50fd8479c86c4f8f70fd85aa3, scope.project.id=fcb3f0754da4449aa4e3612cb2852ae3, user.id=454beff0dbba4ad69f19c87143755d1f) {{(pid=80012) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:01:07.448001 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a387ec2-c3e7-438f-9e24-ff4afe29c168 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:01:07.449483 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a387ec2-c3e7-438f-9e24-ff4afe29c168 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:01:07.455252 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 541/1105] 10.222.0.36 () {56 vars in 1374 bytes} [Tue May 3 14:01:07 2022] GET /identity/v3/role_assignments?user.id=454beff0dbba4ad69f19c87143755d1f&scope.project.id=fcb3f0754da4449aa4e3612cb2852ae3&role.id=36abe9b50fd8479c86c4f8f70fd85aa3 => generated 608 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 14:01:07.457851 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2bacb4-134d-4ec8-8b42-5de3c42d859c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:01:07.458509 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2bacb4-134d-4ec8-8b42-5de3c42d859c None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:01:07.458789 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2bacb4-134d-4ec8-8b42-5de3c42d859c None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:01:07.459046 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2bacb4-134d-4ec8-8b42-5de3c42d859c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:01:07.459885 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2bacb4-134d-4ec8-8b42-5de3c42d859c None admin] RBAC: Adding query filter params (role.id=83dea282ec144c95979d7e1b50c52a85, scope.project.id=de541be478754087934323bdbe41a579, user.id=63489e658c094a2598a2ac62159d2fda) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:01:07.460193 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2bacb4-134d-4ec8-8b42-5de3c42d859c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:01:07.461680 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2bacb4-134d-4ec8-8b42-5de3c42d859c None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:01:07.468924 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 565/1106] 10.222.0.36 () {56 vars in 1374 bytes} [Tue May 3 14:01:07 2022] GET /identity/v3/role_assignments?user.id=63489e658c094a2598a2ac62159d2fda&scope.project.id=de541be478754087934323bdbe41a579&role.id=83dea282ec144c95979d7e1b50c52a85 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 14:01:09.733370 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db578a74-2ff4-495a-a0a0-070c7f92b3b9 None None] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:01:09.733980 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db578a74-2ff4-495a-a0a0-070c7f92b3b9 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:01:09.733980 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db578a74-2ff4-495a-a0a0-070c7f92b3b9 None None] PATH_INFO: `/` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:01:09.735352 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 542/1107] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 3 14:01:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 14:01:09.741775 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60c730d-bd0d-4588-be05-66e5bc85ecfb None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:01:09.742559 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60c730d-bd0d-4588-be05-66e5bc85ecfb None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:01:09.742702 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60c730d-bd0d-4588-be05-66e5bc85ecfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:01:09.762205 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-d60c730d-bd0d-4588-be05-66e5bc85ecfb None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:01:09.763392 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-d60c730d-bd0d-4588-be05-66e5bc85ecfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:01:09.830959 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 566/1108] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 3 14:01:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 14:01:09.859614 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db578a74-2ff4-495a-a0a0-070c7f92b3b9 None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:01:09.977316 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db578a74-2ff4-495a-a0a0-070c7f92b3b9 None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:01:10.012398 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1f51e9-b9ed-45dd-9731-4e25ac191a5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:01:10.013112 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1f51e9-b9ed-45dd-9731-4e25ac191a5a None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:01:10.013424 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1f51e9-b9ed-45dd-9731-4e25ac191a5a None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:01:10.013699 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1f51e9-b9ed-45dd-9731-4e25ac191a5a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:01:10.015003 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1f51e9-b9ed-45dd-9731-4e25ac191a5a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:01:10.016445 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1f51e9-b9ed-45dd-9731-4e25ac191a5a None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:01:10.018116 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 543/1109] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 3 14:01:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:01:10.024203 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60c730d-bd0d-4588-be05-66e5bc85ecfb None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:01:10.127570 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60c730d-bd0d-4588-be05-66e5bc85ecfb None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:01:10.161225 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7877c28c-865b-4253-bb18-61b72957958b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:01:10.161928 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7877c28c-865b-4253-bb18-61b72957958b None admin] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:01:10.162200 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7877c28c-865b-4253-bb18-61b72957958b None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:01:10.162478 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7877c28c-865b-4253-bb18-61b72957958b None admin] PATH_INFO: `/v3/users` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:01:10.163172 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7877c28c-865b-4253-bb18-61b72957958b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:01:10.164598 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7877c28c-865b-4253-bb18-61b72957958b None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:01:10.187122 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 567/1110] 10.222.0.36 () {60 vars in 1132 bytes} [Tue May 3 14:01:10 2022] POST /identity/v3/users => generated 286 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 14:01:12.422230 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b51160-2ca3-4353-abfa-f3c4e12358a7 None None] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:01:12.422784 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b51160-2ca3-4353-abfa-f3c4e12358a7 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:01:12.422784 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b51160-2ca3-4353-abfa-f3c4e12358a7 None None] PATH_INFO: `/` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:01:12.424075 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 544/1111] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 3 14:01:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 14:01:12.430425 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014c3619-328b-4e47-a0a5-8f17b05dde12 None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:01:12.431108 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014c3619-328b-4e47-a0a5-8f17b05dde12 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:01:12.431280 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014c3619-328b-4e47-a0a5-8f17b05dde12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:01:12.455210 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-014c3619-328b-4e47-a0a5-8f17b05dde12 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:01:12.456377 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-014c3619-328b-4e47-a0a5-8f17b05dde12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:01:12.521907 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 568/1112] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 3 14:01:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 14:01:12.545772 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b51160-2ca3-4353-abfa-f3c4e12358a7 None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:01:12.648171 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b51160-2ca3-4353-abfa-f3c4e12358a7 None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:01:12.688963 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7037d9-1193-4d56-8c1d-7d3fae60526b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:01:12.689815 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7037d9-1193-4d56-8c1d-7d3fae60526b None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:01:12.690070 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7037d9-1193-4d56-8c1d-7d3fae60526b None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:01:12.690365 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7037d9-1193-4d56-8c1d-7d3fae60526b None admin] PATH_INFO: `/v3/roles/bd29d35ea39b4ba293ffbf1ffbf4b940` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:01:12.691940 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7037d9-1193-4d56-8c1d-7d3fae60526b None admin] RBAC: Authorizing `identity:get_role(role_id=bd29d35ea39b4ba293ffbf1ffbf4b940)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:01:12.693322 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7037d9-1193-4d56-8c1d-7d3fae60526b None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:01:12.694715 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 545/1113] 10.222.0.36 () {56 vars in 1177 bytes} [Tue May 3 14:01:12 2022] GET /identity/v3/roles/bd29d35ea39b4ba293ffbf1ffbf4b940 => generated 223 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:01:12.703574 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014c3619-328b-4e47-a0a5-8f17b05dde12 None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:01:12.800407 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014c3619-328b-4e47-a0a5-8f17b05dde12 None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:01:12.839109 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d066261-7cf1-4c85-887d-814c047223bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:01:12.840030 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d066261-7cf1-4c85-887d-814c047223bf None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:01:12.840315 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d066261-7cf1-4c85-887d-814c047223bf None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:01:12.840590 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d066261-7cf1-4c85-887d-814c047223bf None admin] PATH_INFO: `/v3/users/b6084a2046e84c03b1a2498cbcfd55ef` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:01:12.854584 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d066261-7cf1-4c85-887d-814c047223bf None admin] RBAC: Authorizing `identity:get_user(user_id=b6084a2046e84c03b1a2498cbcfd55ef)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:01:12.856070 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d066261-7cf1-4c85-887d-814c047223bf None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:01:12.857771 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 569/1114] 10.222.0.36 () {56 vars in 1177 bytes} [Tue May 3 14:01:12 2022] GET /identity/v3/users/b6084a2046e84c03b1a2498cbcfd55ef => generated 286 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:01:12.866875 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7037d9-1193-4d56-8c1d-7d3fae60526b None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:01:12.962223 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7037d9-1193-4d56-8c1d-7d3fae60526b None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:01:12.996282 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42aa0c8b-fba6-4f0a-8817-cb0248c9561f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:01:12.996905 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42aa0c8b-fba6-4f0a-8817-cb0248c9561f None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:01:12.997176 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42aa0c8b-fba6-4f0a-8817-cb0248c9561f None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:01:12.997485 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42aa0c8b-fba6-4f0a-8817-cb0248c9561f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:01:13.072881 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42aa0c8b-fba6-4f0a-8817-cb0248c9561f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:01:13.074565 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42aa0c8b-fba6-4f0a-8817-cb0248c9561f None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:01:13.186088 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 546/1115] 10.222.0.36 () {58 vars in 1282 bytes} [Tue May 3 14:01:12 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 03 14:01:13.192374 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d066261-7cf1-4c85-887d-814c047223bf None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:01:13.306162 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d066261-7cf1-4c85-887d-814c047223bf None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:01:13.342846 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6583a4d4-bc45-4c3a-accd-2765a6918dda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:01:13.343711 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6583a4d4-bc45-4c3a-accd-2765a6918dda None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:01:13.343989 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6583a4d4-bc45-4c3a-accd-2765a6918dda None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:01:13.344263 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6583a4d4-bc45-4c3a-accd-2765a6918dda None admin] PATH_INFO: `/v3/projects/fcb3f0754da4449aa4e3612cb2852ae3` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:01:13.345525 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6583a4d4-bc45-4c3a-accd-2765a6918dda None admin] RBAC: Authorizing `identity:get_project(project_id=fcb3f0754da4449aa4e3612cb2852ae3)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:01:13.346989 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6583a4d4-bc45-4c3a-accd-2765a6918dda None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:01:13.348685 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 570/1116] 10.222.0.36 () {56 vars in 1186 bytes} [Tue May 3 14:01:13 2022] GET /identity/v3/projects/fcb3f0754da4449aa4e3612cb2852ae3 => generated 311 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:01:13.357497 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42aa0c8b-fba6-4f0a-8817-cb0248c9561f None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:01:13.466873 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42aa0c8b-fba6-4f0a-8817-cb0248c9561f None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:01:13.502921 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c88969-8979-41ed-a265-a6930d233b3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:01:13.503639 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c88969-8979-41ed-a265-a6930d233b3a None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:01:13.503918 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c88969-8979-41ed-a265-a6930d233b3a None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:01:13.504181 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c88969-8979-41ed-a265-a6930d233b3a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:01:13.505025 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c88969-8979-41ed-a265-a6930d233b3a None admin] RBAC: Adding query filter params (role.id=bd29d35ea39b4ba293ffbf1ffbf4b940, scope.project.id=fcb3f0754da4449aa4e3612cb2852ae3, user.id=b6084a2046e84c03b1a2498cbcfd55ef) {{(pid=80012) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:01:13.505332 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c88969-8979-41ed-a265-a6930d233b3a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:01:13.506785 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c88969-8979-41ed-a265-a6930d233b3a None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:01:13.513206 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 547/1117] 10.222.0.36 () {56 vars in 1374 bytes} [Tue May 3 14:01:13 2022] GET /identity/v3/role_assignments?user.id=b6084a2046e84c03b1a2498cbcfd55ef&scope.project.id=fcb3f0754da4449aa4e3612cb2852ae3&role.id=bd29d35ea39b4ba293ffbf1ffbf4b940 => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 14:01:15.698688 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27123e6-c900-4dc2-bc65-a6841162292d None None] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:01:15.699398 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27123e6-c900-4dc2-bc65-a6841162292d None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:01:15.699398 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27123e6-c900-4dc2-bc65-a6841162292d None None] PATH_INFO: `/` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:01:15.701449 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 571/1118] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 3 14:01:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 14:01:15.709596 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed59c982-d670-4f74-9246-1a082cca3524 None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:01:15.710047 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed59c982-d670-4f74-9246-1a082cca3524 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:01:15.710136 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed59c982-d670-4f74-9246-1a082cca3524 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:01:15.728247 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-ed59c982-d670-4f74-9246-1a082cca3524 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:01:15.729445 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-ed59c982-d670-4f74-9246-1a082cca3524 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:01:15.794303 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 548/1119] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 3 14:01:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 03 14:01:15.817620 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27123e6-c900-4dc2-bc65-a6841162292d None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:01:15.927338 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27123e6-c900-4dc2-bc65-a6841162292d None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:01:15.961755 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa355ab-e6c5-4d44-8d3b-5da4bac85c31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:01:15.962521 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa355ab-e6c5-4d44-8d3b-5da4bac85c31 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:01:15.962789 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa355ab-e6c5-4d44-8d3b-5da4bac85c31 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:01:15.963054 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa355ab-e6c5-4d44-8d3b-5da4bac85c31 None admin] PATH_INFO: `/v3/roles/bd29d35ea39b4ba293ffbf1ffbf4b940` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:01:15.965136 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa355ab-e6c5-4d44-8d3b-5da4bac85c31 None admin] RBAC: Authorizing `identity:get_role(role_id=bd29d35ea39b4ba293ffbf1ffbf4b940)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:01:15.966521 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa355ab-e6c5-4d44-8d3b-5da4bac85c31 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:01:15.967900 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 572/1120] 10.222.0.36 () {56 vars in 1177 bytes} [Tue May 3 14:01:15 2022] GET /identity/v3/roles/bd29d35ea39b4ba293ffbf1ffbf4b940 => generated 223 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:01:15.974087 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed59c982-d670-4f74-9246-1a082cca3524 None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:01:16.075942 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed59c982-d670-4f74-9246-1a082cca3524 None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:01:16.114887 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4664a578-64ef-416e-9b37-d696d5614d07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:01:16.115738 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4664a578-64ef-416e-9b37-d696d5614d07 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:01:16.116010 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4664a578-64ef-416e-9b37-d696d5614d07 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:01:16.116279 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4664a578-64ef-416e-9b37-d696d5614d07 None admin] PATH_INFO: `/v3/users/b6084a2046e84c03b1a2498cbcfd55ef` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:01:16.117599 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4664a578-64ef-416e-9b37-d696d5614d07 None admin] RBAC: Authorizing `identity:get_user(user_id=b6084a2046e84c03b1a2498cbcfd55ef)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:01:16.119015 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4664a578-64ef-416e-9b37-d696d5614d07 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:01:16.120673 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 549/1121] 10.222.0.36 () {56 vars in 1177 bytes} [Tue May 3 14:01:15 2022] GET /identity/v3/users/b6084a2046e84c03b1a2498cbcfd55ef => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:01:16.129523 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa355ab-e6c5-4d44-8d3b-5da4bac85c31 None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:01:16.227163 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa355ab-e6c5-4d44-8d3b-5da4bac85c31 None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:01:16.261502 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0580853b-ead6-4bc3-b9e4-f07a0d93ef54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:01:16.262439 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0580853b-ead6-4bc3-b9e4-f07a0d93ef54 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:01:16.262715 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0580853b-ead6-4bc3-b9e4-f07a0d93ef54 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:01:16.262981 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0580853b-ead6-4bc3-b9e4-f07a0d93ef54 None admin] PATH_INFO: `/v3/projects/fcb3f0754da4449aa4e3612cb2852ae3` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:01:16.264272 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0580853b-ead6-4bc3-b9e4-f07a0d93ef54 None admin] RBAC: Authorizing `identity:get_project(project_id=fcb3f0754da4449aa4e3612cb2852ae3)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:01:16.265726 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0580853b-ead6-4bc3-b9e4-f07a0d93ef54 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:01:16.267365 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 573/1122] 10.222.0.36 () {56 vars in 1186 bytes} [Tue May 3 14:01:16 2022] GET /identity/v3/projects/fcb3f0754da4449aa4e3612cb2852ae3 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:01:16.273639 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4664a578-64ef-416e-9b37-d696d5614d07 None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:01:16.379915 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4664a578-64ef-416e-9b37-d696d5614d07 None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:01:16.413221 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd6c454-27c1-4c64-a5fb-17e305675444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:01:16.414136 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd6c454-27c1-4c64-a5fb-17e305675444 None admin] REQUEST_METHOD: `PUT` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:01:16.414414 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd6c454-27c1-4c64-a5fb-17e305675444 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:01:16.414688 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd6c454-27c1-4c64-a5fb-17e305675444 None admin] PATH_INFO: `/v3/projects/fcb3f0754da4449aa4e3612cb2852ae3/users/b6084a2046e84c03b1a2498cbcfd55ef/roles/bd29d35ea39b4ba293ffbf1ffbf4b940` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:01:16.416910 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd6c454-27c1-4c64-a5fb-17e305675444 None admin] RBAC: Authorizing `identity:create_grant(project_id=fcb3f0754da4449aa4e3612cb2852ae3, user_id=b6084a2046e84c03b1a2498cbcfd55ef, role_id=bd29d35ea39b4ba293ffbf1ffbf4b940)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:01:16.418633 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd6c454-27c1-4c64-a5fb-17e305675444 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:01:16.434248 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 550/1123] 10.222.0.36 () {58 vars in 1439 bytes} [Tue May 3 14:01:16 2022] PUT /identity/v3/projects/fcb3f0754da4449aa4e3612cb2852ae3/users/b6084a2046e84c03b1a2498cbcfd55ef/roles/bd29d35ea39b4ba293ffbf1ffbf4b940 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:01:18.647807 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae541fe-2381-4f4a-ad34-85ce7ef9384a None None] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:01:18.648373 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae541fe-2381-4f4a-ad34-85ce7ef9384a None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:01:18.648373 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae541fe-2381-4f4a-ad34-85ce7ef9384a None None] PATH_INFO: `/` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:01:18.649761 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 574/1124] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 3 14:01:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 14:01:18.656045 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d35aa8f-378e-4346-99f8-9629f81e3a17 None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:01:18.656806 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d35aa8f-378e-4346-99f8-9629f81e3a17 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:01:18.656939 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d35aa8f-378e-4346-99f8-9629f81e3a17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:01:18.684164 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-5d35aa8f-378e-4346-99f8-9629f81e3a17 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:01:18.685376 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-5d35aa8f-378e-4346-99f8-9629f81e3a17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:01:18.753207 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 551/1125] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 3 14:01:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 14:01:18.776303 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae541fe-2381-4f4a-ad34-85ce7ef9384a None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:01:18.883679 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae541fe-2381-4f4a-ad34-85ce7ef9384a None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:01:18.918164 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5760c0a5-39ca-4b7b-8451-1c823c495583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:01:18.918992 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5760c0a5-39ca-4b7b-8451-1c823c495583 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:01:18.919265 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5760c0a5-39ca-4b7b-8451-1c823c495583 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:01:18.919534 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5760c0a5-39ca-4b7b-8451-1c823c495583 None admin] PATH_INFO: `/v3/roles/bd29d35ea39b4ba293ffbf1ffbf4b940` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:01:18.921114 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5760c0a5-39ca-4b7b-8451-1c823c495583 None admin] RBAC: Authorizing `identity:get_role(role_id=bd29d35ea39b4ba293ffbf1ffbf4b940)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:01:18.922537 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5760c0a5-39ca-4b7b-8451-1c823c495583 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:01:18.923928 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 575/1126] 10.222.0.36 () {56 vars in 1177 bytes} [Tue May 3 14:01:18 2022] GET /identity/v3/roles/bd29d35ea39b4ba293ffbf1ffbf4b940 => generated 223 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:01:18.930733 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d35aa8f-378e-4346-99f8-9629f81e3a17 None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:01:19.037805 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d35aa8f-378e-4346-99f8-9629f81e3a17 None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:01:19.072483 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421d3e26-36c9-46e3-9ba7-9020a6d175b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:01:19.073389 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421d3e26-36c9-46e3-9ba7-9020a6d175b4 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:01:19.073724 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421d3e26-36c9-46e3-9ba7-9020a6d175b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:01:19.074031 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421d3e26-36c9-46e3-9ba7-9020a6d175b4 None admin] PATH_INFO: `/v3/users/b6084a2046e84c03b1a2498cbcfd55ef` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:01:19.075236 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421d3e26-36c9-46e3-9ba7-9020a6d175b4 None admin] RBAC: Authorizing `identity:get_user(user_id=b6084a2046e84c03b1a2498cbcfd55ef)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:01:19.076659 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421d3e26-36c9-46e3-9ba7-9020a6d175b4 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:01:19.078321 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 552/1127] 10.222.0.36 () {56 vars in 1177 bytes} [Tue May 3 14:01:18 2022] GET /identity/v3/users/b6084a2046e84c03b1a2498cbcfd55ef => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:01:19.084666 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5760c0a5-39ca-4b7b-8451-1c823c495583 None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:01:19.214317 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5760c0a5-39ca-4b7b-8451-1c823c495583 None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:01:19.264520 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9f7967-cc5e-4a38-b248-f637d544c3b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:01:19.265455 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9f7967-cc5e-4a38-b248-f637d544c3b3 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:01:19.265844 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9f7967-cc5e-4a38-b248-f637d544c3b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:01:19.266236 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9f7967-cc5e-4a38-b248-f637d544c3b3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:01:19.354564 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9f7967-cc5e-4a38-b248-f637d544c3b3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:01:19.356071 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9f7967-cc5e-4a38-b248-f637d544c3b3 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:01:19.465904 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 576/1128] 10.222.0.36 () {58 vars in 1282 bytes} [Tue May 3 14:01:19 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 03 14:01:19.472341 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421d3e26-36c9-46e3-9ba7-9020a6d175b4 None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:01:19.594775 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421d3e26-36c9-46e3-9ba7-9020a6d175b4 None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:01:19.632809 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d60c0af-22c1-427a-aad6-a5b81a2a7338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:01:19.633702 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d60c0af-22c1-427a-aad6-a5b81a2a7338 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:01:19.633978 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d60c0af-22c1-427a-aad6-a5b81a2a7338 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:01:19.634252 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d60c0af-22c1-427a-aad6-a5b81a2a7338 None admin] PATH_INFO: `/v3/projects/fcb3f0754da4449aa4e3612cb2852ae3` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:01:19.635555 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d60c0af-22c1-427a-aad6-a5b81a2a7338 None admin] RBAC: Authorizing `identity:get_project(project_id=fcb3f0754da4449aa4e3612cb2852ae3)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:01:19.637392 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d60c0af-22c1-427a-aad6-a5b81a2a7338 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:01:19.639116 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 553/1129] 10.222.0.36 () {56 vars in 1186 bytes} [Tue May 3 14:01:19 2022] GET /identity/v3/projects/fcb3f0754da4449aa4e3612cb2852ae3 => generated 311 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 14:01:19.645821 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9f7967-cc5e-4a38-b248-f637d544c3b3 None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:01:19.760984 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9f7967-cc5e-4a38-b248-f637d544c3b3 None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:01:19.799280 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c112de28-d6a4-4d1b-bf5e-dfe3c8353434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:01:19.799929 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c112de28-d6a4-4d1b-bf5e-dfe3c8353434 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:01:19.800202 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c112de28-d6a4-4d1b-bf5e-dfe3c8353434 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:01:19.800470 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c112de28-d6a4-4d1b-bf5e-dfe3c8353434 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:01:19.801321 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c112de28-d6a4-4d1b-bf5e-dfe3c8353434 None admin] RBAC: Adding query filter params (role.id=bd29d35ea39b4ba293ffbf1ffbf4b940, scope.project.id=fcb3f0754da4449aa4e3612cb2852ae3, user.id=b6084a2046e84c03b1a2498cbcfd55ef) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:01:19.801623 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c112de28-d6a4-4d1b-bf5e-dfe3c8353434 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:01:19.803044 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c112de28-d6a4-4d1b-bf5e-dfe3c8353434 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:01:19.809183 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 577/1130] 10.222.0.36 () {56 vars in 1374 bytes} [Tue May 3 14:01:19 2022] GET /identity/v3/role_assignments?user.id=b6084a2046e84c03b1a2498cbcfd55ef&scope.project.id=fcb3f0754da4449aa4e3612cb2852ae3&role.id=bd29d35ea39b4ba293ffbf1ffbf4b940 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:01:22.098335 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e343ab-5b50-447b-8013-b74322bc3246 None None] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:01:22.098804 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e343ab-5b50-447b-8013-b74322bc3246 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:01:22.098896 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e343ab-5b50-447b-8013-b74322bc3246 None None] PATH_INFO: `/` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:01:22.100260 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 554/1131] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 3 14:01:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 14:01:22.106352 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a157019-78c1-4aa8-971c-74de639c19a6 None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:01:22.107084 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a157019-78c1-4aa8-971c-74de639c19a6 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:01:22.107230 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a157019-78c1-4aa8-971c-74de639c19a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:01:22.135630 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-4a157019-78c1-4aa8-971c-74de639c19a6 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:01:22.137098 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-4a157019-78c1-4aa8-971c-74de639c19a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:01:22.203857 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 578/1132] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 3 14:01:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 14:01:22.238011 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e343ab-5b50-447b-8013-b74322bc3246 None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:01:22.344611 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e343ab-5b50-447b-8013-b74322bc3246 None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:01:22.378370 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780522a1-5435-4a3a-a52c-5bab63ddead9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:01:22.379149 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780522a1-5435-4a3a-a52c-5bab63ddead9 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:01:22.379426 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780522a1-5435-4a3a-a52c-5bab63ddead9 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:01:22.379701 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780522a1-5435-4a3a-a52c-5bab63ddead9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:01:22.380968 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780522a1-5435-4a3a-a52c-5bab63ddead9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:01:22.382429 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780522a1-5435-4a3a-a52c-5bab63ddead9 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:01:22.384021 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 555/1133] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 3 14:01:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:01:22.390588 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a157019-78c1-4aa8-971c-74de639c19a6 None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:01:22.493305 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a157019-78c1-4aa8-971c-74de639c19a6 None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:01:22.527090 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8abaad2-0ed5-43c7-8a94-7f956c5d912c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:01:22.527734 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8abaad2-0ed5-43c7-8a94-7f956c5d912c None admin] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:01:22.528003 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8abaad2-0ed5-43c7-8a94-7f956c5d912c None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:01:22.528274 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8abaad2-0ed5-43c7-8a94-7f956c5d912c None admin] PATH_INFO: `/v3/projects` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:01:22.528965 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8abaad2-0ed5-43c7-8a94-7f956c5d912c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:01:22.530421 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8abaad2-0ed5-43c7-8a94-7f956c5d912c None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:01:22.558795 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 579/1134] 10.222.0.36 () {60 vars in 1141 bytes} [Tue May 3 14:01:22 2022] POST /identity/v3/projects => generated 311 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 14:01:24.801741 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f31c6d-4ad1-40cf-b463-c3d47dfac73e None None] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:01:24.802330 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f31c6d-4ad1-40cf-b463-c3d47dfac73e None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:01:24.802330 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f31c6d-4ad1-40cf-b463-c3d47dfac73e None None] PATH_INFO: `/` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:01:24.803653 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 556/1135] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 3 14:01:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 14:01:24.810294 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8f9cb4-97b2-40f5-892c-2356e6020587 None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:01:24.811048 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8f9cb4-97b2-40f5-892c-2356e6020587 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:01:24.811179 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8f9cb4-97b2-40f5-892c-2356e6020587 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:01:24.838075 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-9f8f9cb4-97b2-40f5-892c-2356e6020587 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:01:24.840258 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-9f8f9cb4-97b2-40f5-892c-2356e6020587 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:01:24.911367 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 580/1136] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 3 14:01:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 14:01:24.944981 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f31c6d-4ad1-40cf-b463-c3d47dfac73e None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:01:25.055959 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f31c6d-4ad1-40cf-b463-c3d47dfac73e None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:01:25.089262 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a60d328-df8d-4268-a4d5-371c18f0f4ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:01:25.090099 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a60d328-df8d-4268-a4d5-371c18f0f4ea None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:01:25.090372 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a60d328-df8d-4268-a4d5-371c18f0f4ea None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:01:25.090641 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a60d328-df8d-4268-a4d5-371c18f0f4ea None admin] PATH_INFO: `/v3/domains/default` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:01:25.091850 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a60d328-df8d-4268-a4d5-371c18f0f4ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:01:25.093272 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a60d328-df8d-4268-a4d5-371c18f0f4ea None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:01:25.094954 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 557/1137] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 3 14:01:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:01:25.100899 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8f9cb4-97b2-40f5-892c-2356e6020587 None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:01:25.202078 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8f9cb4-97b2-40f5-892c-2356e6020587 None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:01:25.235965 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3771b34f-671f-4295-a79c-3de659bda047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:01:25.236615 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3771b34f-671f-4295-a79c-3de659bda047 None admin] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:01:25.236893 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3771b34f-671f-4295-a79c-3de659bda047 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:01:25.237156 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3771b34f-671f-4295-a79c-3de659bda047 None admin] PATH_INFO: `/v3/users` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:01:25.237884 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3771b34f-671f-4295-a79c-3de659bda047 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:01:25.239315 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3771b34f-671f-4295-a79c-3de659bda047 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:01:25.262412 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 581/1138] 10.222.0.36 () {60 vars in 1132 bytes} [Tue May 3 14:01:25 2022] POST /identity/v3/users => generated 286 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 14:01:27.500362 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae82af35-1e7a-4b05-8f23-c45890bf30ea None None] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:01:27.500933 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae82af35-1e7a-4b05-8f23-c45890bf30ea None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:01:27.500933 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae82af35-1e7a-4b05-8f23-c45890bf30ea None None] PATH_INFO: `/` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:01:27.502326 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 558/1139] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 3 14:01:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 14:01:27.508684 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0fe198-cc2b-438c-a5fc-7483236c9a27 None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:01:27.509489 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0fe198-cc2b-438c-a5fc-7483236c9a27 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:01:27.509653 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0fe198-cc2b-438c-a5fc-7483236c9a27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:01:27.529349 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-4c0fe198-cc2b-438c-a5fc-7483236c9a27 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:01:27.530565 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-4c0fe198-cc2b-438c-a5fc-7483236c9a27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:01:27.599533 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 582/1140] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 3 14:01:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 14:01:27.624884 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae82af35-1e7a-4b05-8f23-c45890bf30ea None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:01:27.730007 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae82af35-1e7a-4b05-8f23-c45890bf30ea None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:01:27.763497 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c37ba5e-13fc-4bea-9ff9-ea3531db6eb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:01:27.764202 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c37ba5e-13fc-4bea-9ff9-ea3531db6eb5 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:01:27.764475 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c37ba5e-13fc-4bea-9ff9-ea3531db6eb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:01:27.764742 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c37ba5e-13fc-4bea-9ff9-ea3531db6eb5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:01:27.775157 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c37ba5e-13fc-4bea-9ff9-ea3531db6eb5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 14:01:27.782728 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application [None req-3c37ba5e-13fc-4bea-9ff9-ea3531db6eb5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 03 14:01:27.782728 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:01:27.782728 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 14:01:27.782728 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 14:01:27.782728 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 14:01:27.782728 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 14:01:27.782728 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 14:01:27.782728 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 14:01:27.782728 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 14:01:27.782728 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 14:01:27.782728 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 14:01:27.782728 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 14:01:27.782728 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 14:01:27.782728 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 14:01:27.782728 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 14:01:27.782728 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 14:01:27.783848 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 14:01:27.783848 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 14:01:27.783848 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 14:01:27.783848 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 14:01:27.783848 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 14:01:27.783848 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 14:01:27.783848 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 14:01:27.783848 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 14:01:27.783848 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 14:01:27.783848 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.get_or_create( May 03 14:01:27.783848 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 14:01:27.783848 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application with Lock( May 03 14:01:27.783848 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 14:01:27.783848 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._enter() May 03 14:01:27.783848 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 14:01:27.783848 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 14:01:27.784796 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 14:01:27.784796 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.creator() May 03 14:01:27.784796 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 14:01:27.784796 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application created_value = creator( May 03 14:01:27.784796 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 14:01:27.784796 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 14:01:27.784796 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 14:01:27.784796 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 14:01:27.784796 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 14:01:27.784796 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 14:01:27.784796 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 03 14:01:27.784796 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application May 03 14:01:27.784796 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 559/1141] 10.222.0.36 () {56 vars in 1096 bytes} [Tue May 3 14:01:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 14:01:27.790841 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0fe198-cc2b-438c-a5fc-7483236c9a27 None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:01:27.897211 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0fe198-cc2b-438c-a5fc-7483236c9a27 None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:01:27.930395 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6540a9d-02fc-45b2-885b-b30f27e9bf82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:01:27.931039 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6540a9d-02fc-45b2-885b-b30f27e9bf82 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:01:27.931314 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6540a9d-02fc-45b2-885b-b30f27e9bf82 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:01:27.931584 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6540a9d-02fc-45b2-885b-b30f27e9bf82 None admin] PATH_INFO: `/v3/roles` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:01:27.932313 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6540a9d-02fc-45b2-885b-b30f27e9bf82 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:01:27.932619 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6540a9d-02fc-45b2-885b-b30f27e9bf82 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:01:27.934131 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6540a9d-02fc-45b2-885b-b30f27e9bf82 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:01:27.941917 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 583/1142] 10.222.0.36 () {56 vars in 1099 bytes} [Tue May 3 14:01:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:01:27.950858 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c37ba5e-13fc-4bea-9ff9-ea3531db6eb5 None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:01:28.056014 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c37ba5e-13fc-4bea-9ff9-ea3531db6eb5 None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:01:28.090186 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf5b192-c743-42d2-bd56-859d02faa46b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:01:28.091054 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf5b192-c743-42d2-bd56-859d02faa46b None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:01:28.091334 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf5b192-c743-42d2-bd56-859d02faa46b None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:01:28.091608 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf5b192-c743-42d2-bd56-859d02faa46b None admin] PATH_INFO: `/v3/users/cee17d73f48549d692381e5719210f7b` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:01:28.104975 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf5b192-c743-42d2-bd56-859d02faa46b None admin] RBAC: Authorizing `identity:get_user(user_id=cee17d73f48549d692381e5719210f7b)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:01:28.106644 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf5b192-c743-42d2-bd56-859d02faa46b None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:01:28.108298 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 560/1143] 10.222.0.36 () {56 vars in 1177 bytes} [Tue May 3 14:01:27 2022] GET /identity/v3/users/cee17d73f48549d692381e5719210f7b => generated 286 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:01:28.114931 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6540a9d-02fc-45b2-885b-b30f27e9bf82 None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:01:28.225665 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6540a9d-02fc-45b2-885b-b30f27e9bf82 None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:01:28.263047 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2f1ada-e242-41a8-bfcc-ce7742b58edb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:01:28.263671 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2f1ada-e242-41a8-bfcc-ce7742b58edb None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:01:28.263949 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2f1ada-e242-41a8-bfcc-ce7742b58edb None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:01:28.264219 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2f1ada-e242-41a8-bfcc-ce7742b58edb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:01:28.333153 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2f1ada-e242-41a8-bfcc-ce7742b58edb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:01:28.334562 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2f1ada-e242-41a8-bfcc-ce7742b58edb None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:01:28.432493 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 584/1144] 10.222.0.36 () {58 vars in 1282 bytes} [Tue May 3 14:01:28 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 03 14:01:28.438745 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf5b192-c743-42d2-bd56-859d02faa46b None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:01:28.540703 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf5b192-c743-42d2-bd56-859d02faa46b None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:01:28.574388 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0de6e7-6234-4d95-8b1d-829c3024ffbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:01:28.575232 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0de6e7-6234-4d95-8b1d-829c3024ffbb None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:01:28.575508 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0de6e7-6234-4d95-8b1d-829c3024ffbb None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:01:28.575776 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0de6e7-6234-4d95-8b1d-829c3024ffbb None admin] PATH_INFO: `/v3/projects/df9f9c07fe5843a0b049a0d6e0e860bf` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:01:28.577065 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0de6e7-6234-4d95-8b1d-829c3024ffbb None admin] RBAC: Authorizing `identity:get_project(project_id=df9f9c07fe5843a0b049a0d6e0e860bf)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:01:28.578528 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0de6e7-6234-4d95-8b1d-829c3024ffbb None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:01:28.580210 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 561/1145] 10.222.0.36 () {56 vars in 1186 bytes} [Tue May 3 14:01:28 2022] GET /identity/v3/projects/df9f9c07fe5843a0b049a0d6e0e860bf => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:01:28.587372 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2f1ada-e242-41a8-bfcc-ce7742b58edb None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:01:28.692094 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2f1ada-e242-41a8-bfcc-ce7742b58edb None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:01:28.727633 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6985d05b-ef05-4213-a345-42cc41b7c748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:01:28.728259 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6985d05b-ef05-4213-a345-42cc41b7c748 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:01:28.728538 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6985d05b-ef05-4213-a345-42cc41b7c748 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:01:28.728791 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6985d05b-ef05-4213-a345-42cc41b7c748 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:01:28.729800 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6985d05b-ef05-4213-a345-42cc41b7c748 None admin] RBAC: Adding query filter params (role.id=36abe9b50fd8479c86c4f8f70fd85aa3, scope.project.id=df9f9c07fe5843a0b049a0d6e0e860bf, user.id=cee17d73f48549d692381e5719210f7b) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:01:28.730200 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6985d05b-ef05-4213-a345-42cc41b7c748 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:01:28.731636 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6985d05b-ef05-4213-a345-42cc41b7c748 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:01:28.736994 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 585/1146] 10.222.0.36 () {56 vars in 1374 bytes} [Tue May 3 14:01:28 2022] GET /identity/v3/role_assignments?user.id=cee17d73f48549d692381e5719210f7b&scope.project.id=df9f9c07fe5843a0b049a0d6e0e860bf&role.id=36abe9b50fd8479c86c4f8f70fd85aa3 => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:01:30.925567 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8535e137-b63a-4fad-a567-3a59a4411901 None None] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:01:30.926151 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8535e137-b63a-4fad-a567-3a59a4411901 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:01:30.926151 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8535e137-b63a-4fad-a567-3a59a4411901 None None] PATH_INFO: `/` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:01:30.927499 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 562/1147] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 3 14:01:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 14:01:30.934350 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e33e2b-c0fd-4b2d-86f5-b5ca11bd62df None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:01:30.935091 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e33e2b-c0fd-4b2d-86f5-b5ca11bd62df None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:01:30.935237 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e33e2b-c0fd-4b2d-86f5-b5ca11bd62df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:01:30.954197 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-73e33e2b-c0fd-4b2d-86f5-b5ca11bd62df None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:01:30.955366 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-73e33e2b-c0fd-4b2d-86f5-b5ca11bd62df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:01:31.021862 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 586/1148] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 3 14:01:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 14:01:31.044372 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8535e137-b63a-4fad-a567-3a59a4411901 None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:01:31.153806 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8535e137-b63a-4fad-a567-3a59a4411901 None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:01:31.191141 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cc5a6d-d379-4aa8-8aed-8207738d5c45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:01:31.192147 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cc5a6d-d379-4aa8-8aed-8207738d5c45 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:01:31.192500 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cc5a6d-d379-4aa8-8aed-8207738d5c45 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:01:31.192863 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cc5a6d-d379-4aa8-8aed-8207738d5c45 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:01:31.206237 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cc5a6d-d379-4aa8-8aed-8207738d5c45 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 14:01:31.214173 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application [None req-81cc5a6d-d379-4aa8-8aed-8207738d5c45 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 03 14:01:31.214173 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:01:31.214173 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 14:01:31.214173 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 14:01:31.214173 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 14:01:31.214173 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 14:01:31.214173 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 14:01:31.214173 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 14:01:31.214173 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 14:01:31.214173 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 14:01:31.214173 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 14:01:31.214173 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 14:01:31.214173 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 14:01:31.214173 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 14:01:31.214173 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 14:01:31.214173 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 14:01:31.215374 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 14:01:31.215374 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 14:01:31.215374 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 14:01:31.215374 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 14:01:31.215374 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 14:01:31.215374 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 14:01:31.215374 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 14:01:31.215374 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 14:01:31.215374 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 14:01:31.215374 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.get_or_create( May 03 14:01:31.215374 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 14:01:31.215374 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application with Lock( May 03 14:01:31.215374 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 14:01:31.215374 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._enter() May 03 14:01:31.215374 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 14:01:31.215374 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 14:01:31.216237 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 14:01:31.216237 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.creator() May 03 14:01:31.216237 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 14:01:31.216237 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application created_value = creator( May 03 14:01:31.216237 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 14:01:31.216237 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 14:01:31.216237 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 14:01:31.216237 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 14:01:31.216237 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 14:01:31.216237 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 14:01:31.216237 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 03 14:01:31.216237 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application May 03 14:01:31.216237 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 563/1149] 10.222.0.36 () {56 vars in 1096 bytes} [Tue May 3 14:01:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 14:01:31.221816 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e33e2b-c0fd-4b2d-86f5-b5ca11bd62df None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:01:31.323021 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e33e2b-c0fd-4b2d-86f5-b5ca11bd62df None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:01:31.357519 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d284307b-21a8-4142-bdd7-4e97e7fb05c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:01:31.358171 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d284307b-21a8-4142-bdd7-4e97e7fb05c7 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:01:31.358447 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d284307b-21a8-4142-bdd7-4e97e7fb05c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:01:31.358713 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d284307b-21a8-4142-bdd7-4e97e7fb05c7 None admin] PATH_INFO: `/v3/roles` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:01:31.359447 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d284307b-21a8-4142-bdd7-4e97e7fb05c7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:01:31.359737 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d284307b-21a8-4142-bdd7-4e97e7fb05c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:01:31.361102 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d284307b-21a8-4142-bdd7-4e97e7fb05c7 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:01:31.369041 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 587/1150] 10.222.0.36 () {56 vars in 1099 bytes} [Tue May 3 14:01:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:01:31.375361 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cc5a6d-d379-4aa8-8aed-8207738d5c45 None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:01:31.478600 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cc5a6d-d379-4aa8-8aed-8207738d5c45 None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:01:31.511236 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749c9ea9-b13c-481b-8aa3-c95cf0b3b35b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:01:31.512093 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749c9ea9-b13c-481b-8aa3-c95cf0b3b35b None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:01:31.512379 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749c9ea9-b13c-481b-8aa3-c95cf0b3b35b None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:01:31.512634 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749c9ea9-b13c-481b-8aa3-c95cf0b3b35b None admin] PATH_INFO: `/v3/users/cee17d73f48549d692381e5719210f7b` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:01:31.513871 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749c9ea9-b13c-481b-8aa3-c95cf0b3b35b None admin] RBAC: Authorizing `identity:get_user(user_id=cee17d73f48549d692381e5719210f7b)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:01:31.515309 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749c9ea9-b13c-481b-8aa3-c95cf0b3b35b None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:01:31.516921 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 564/1151] 10.222.0.36 () {56 vars in 1177 bytes} [Tue May 3 14:01:31 2022] GET /identity/v3/users/cee17d73f48549d692381e5719210f7b => generated 286 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:01:31.526004 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d284307b-21a8-4142-bdd7-4e97e7fb05c7 None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:01:31.626532 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d284307b-21a8-4142-bdd7-4e97e7fb05c7 None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:01:31.660017 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1810e66-56e1-4d4d-b481-09b194628935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:01:31.660869 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1810e66-56e1-4d4d-b481-09b194628935 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:01:31.661146 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1810e66-56e1-4d4d-b481-09b194628935 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:01:31.661448 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1810e66-56e1-4d4d-b481-09b194628935 None admin] PATH_INFO: `/v3/projects/df9f9c07fe5843a0b049a0d6e0e860bf` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:01:31.662737 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1810e66-56e1-4d4d-b481-09b194628935 None admin] RBAC: Authorizing `identity:get_project(project_id=df9f9c07fe5843a0b049a0d6e0e860bf)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:01:31.664167 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1810e66-56e1-4d4d-b481-09b194628935 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:01:31.665891 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 588/1152] 10.222.0.36 () {56 vars in 1186 bytes} [Tue May 3 14:01:31 2022] GET /identity/v3/projects/df9f9c07fe5843a0b049a0d6e0e860bf => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 14:01:31.672507 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749c9ea9-b13c-481b-8aa3-c95cf0b3b35b None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:01:31.774224 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749c9ea9-b13c-481b-8aa3-c95cf0b3b35b None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:01:31.809865 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e351c3-84bb-4aec-bf5f-7d15799f9dc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:01:31.810745 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e351c3-84bb-4aec-bf5f-7d15799f9dc2 None admin] REQUEST_METHOD: `PUT` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:01:31.811019 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e351c3-84bb-4aec-bf5f-7d15799f9dc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:01:31.811282 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e351c3-84bb-4aec-bf5f-7d15799f9dc2 None admin] PATH_INFO: `/v3/projects/df9f9c07fe5843a0b049a0d6e0e860bf/users/cee17d73f48549d692381e5719210f7b/roles/36abe9b50fd8479c86c4f8f70fd85aa3` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:01:31.813334 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e351c3-84bb-4aec-bf5f-7d15799f9dc2 None admin] RBAC: Authorizing `identity:create_grant(project_id=df9f9c07fe5843a0b049a0d6e0e860bf, user_id=cee17d73f48549d692381e5719210f7b, role_id=36abe9b50fd8479c86c4f8f70fd85aa3)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:01:31.814741 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e351c3-84bb-4aec-bf5f-7d15799f9dc2 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:01:31.836281 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 565/1153] 10.222.0.36 () {58 vars in 1439 bytes} [Tue May 3 14:01:31 2022] PUT /identity/v3/projects/df9f9c07fe5843a0b049a0d6e0e860bf/users/cee17d73f48549d692381e5719210f7b/roles/36abe9b50fd8479c86c4f8f70fd85aa3 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:01:34.015693 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe2c77e-1bbd-4342-8eff-180587999b02 None None] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:01:34.016581 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe2c77e-1bbd-4342-8eff-180587999b02 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:01:34.016581 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe2c77e-1bbd-4342-8eff-180587999b02 None None] PATH_INFO: `/` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:01:34.018828 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 589/1154] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 3 14:01:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 14:01:34.025042 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaf9600-374f-42ec-9228-56e1fb3e60f5 None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:01:34.025812 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaf9600-374f-42ec-9228-56e1fb3e60f5 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:01:34.025959 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaf9600-374f-42ec-9228-56e1fb3e60f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:01:34.049476 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-feaf9600-374f-42ec-9228-56e1fb3e60f5 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:01:34.050683 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-feaf9600-374f-42ec-9228-56e1fb3e60f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:01:34.116780 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 566/1155] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 3 14:01:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 14:01:34.141368 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe2c77e-1bbd-4342-8eff-180587999b02 None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:01:34.253226 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe2c77e-1bbd-4342-8eff-180587999b02 None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:01:34.287211 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1a9a4c-d751-4e2f-829f-0b3945c69c05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:01:34.287919 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1a9a4c-d751-4e2f-829f-0b3945c69c05 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:01:34.288192 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1a9a4c-d751-4e2f-829f-0b3945c69c05 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:01:34.288458 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1a9a4c-d751-4e2f-829f-0b3945c69c05 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:01:34.299473 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1a9a4c-d751-4e2f-829f-0b3945c69c05 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 14:01:34.306895 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application [None req-1c1a9a4c-d751-4e2f-829f-0b3945c69c05 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 03 14:01:34.306895 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:01:34.306895 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 14:01:34.306895 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 14:01:34.306895 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 14:01:34.306895 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 14:01:34.306895 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 14:01:34.306895 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 14:01:34.306895 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 14:01:34.306895 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 14:01:34.306895 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 14:01:34.306895 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 14:01:34.306895 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 14:01:34.306895 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 14:01:34.306895 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 14:01:34.306895 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 14:01:34.307989 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 14:01:34.307989 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 14:01:34.307989 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 14:01:34.307989 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 14:01:34.307989 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 14:01:34.307989 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 14:01:34.307989 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 14:01:34.307989 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 14:01:34.307989 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 14:01:34.307989 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.get_or_create( May 03 14:01:34.307989 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 14:01:34.307989 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application with Lock( May 03 14:01:34.307989 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 14:01:34.307989 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._enter() May 03 14:01:34.307989 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 14:01:34.307989 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 14:01:34.309368 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 14:01:34.309368 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.creator() May 03 14:01:34.309368 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 14:01:34.309368 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application created_value = creator( May 03 14:01:34.309368 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 14:01:34.309368 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 14:01:34.309368 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 14:01:34.309368 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 14:01:34.309368 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 14:01:34.309368 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 14:01:34.309368 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 03 14:01:34.309368 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application May 03 14:01:34.309368 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 590/1156] 10.222.0.36 () {56 vars in 1096 bytes} [Tue May 3 14:01:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 14:01:34.317945 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaf9600-374f-42ec-9228-56e1fb3e60f5 None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:01:34.415841 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaf9600-374f-42ec-9228-56e1fb3e60f5 None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:01:34.451793 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c06f59d-9474-4a54-80d4-70a6f232967d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:01:34.452454 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c06f59d-9474-4a54-80d4-70a6f232967d None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:01:34.452731 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c06f59d-9474-4a54-80d4-70a6f232967d None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:01:34.453003 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c06f59d-9474-4a54-80d4-70a6f232967d None admin] PATH_INFO: `/v3/roles` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:01:34.453771 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c06f59d-9474-4a54-80d4-70a6f232967d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80012) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:01:34.454076 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c06f59d-9474-4a54-80d4-70a6f232967d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:01:34.455441 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c06f59d-9474-4a54-80d4-70a6f232967d None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:01:34.465183 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 567/1157] 10.222.0.36 () {56 vars in 1099 bytes} [Tue May 3 14:01:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:01:34.471843 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1a9a4c-d751-4e2f-829f-0b3945c69c05 None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:01:34.577945 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1a9a4c-d751-4e2f-829f-0b3945c69c05 None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:01:34.611857 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0716f3-741e-4ec7-946a-ef4f240c8719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:01:34.612710 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0716f3-741e-4ec7-946a-ef4f240c8719 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:01:34.612984 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0716f3-741e-4ec7-946a-ef4f240c8719 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:01:34.613250 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0716f3-741e-4ec7-946a-ef4f240c8719 None admin] PATH_INFO: `/v3/users/cee17d73f48549d692381e5719210f7b` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:01:34.614556 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0716f3-741e-4ec7-946a-ef4f240c8719 None admin] RBAC: Authorizing `identity:get_user(user_id=cee17d73f48549d692381e5719210f7b)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:01:34.616045 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0716f3-741e-4ec7-946a-ef4f240c8719 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:01:34.617648 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 591/1158] 10.222.0.36 () {56 vars in 1177 bytes} [Tue May 3 14:01:34 2022] GET /identity/v3/users/cee17d73f48549d692381e5719210f7b => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:01:34.627352 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c06f59d-9474-4a54-80d4-70a6f232967d None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:01:34.765272 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c06f59d-9474-4a54-80d4-70a6f232967d None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:01:34.803363 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3793f011-338c-4cec-9c0a-117fa71b3b8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:01:34.804000 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3793f011-338c-4cec-9c0a-117fa71b3b8e None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:01:34.804245 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3793f011-338c-4cec-9c0a-117fa71b3b8e None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:01:34.804544 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3793f011-338c-4cec-9c0a-117fa71b3b8e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:01:34.872217 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3793f011-338c-4cec-9c0a-117fa71b3b8e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:01:34.873619 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3793f011-338c-4cec-9c0a-117fa71b3b8e None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:01:34.971710 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 568/1159] 10.222.0.36 () {58 vars in 1282 bytes} [Tue May 3 14:01:34 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 03 14:01:34.980734 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0716f3-741e-4ec7-946a-ef4f240c8719 None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:01:35.089159 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0716f3-741e-4ec7-946a-ef4f240c8719 None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:01:35.127476 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255d3603-c2f6-4ccb-bc15-07b2c838c006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:01:35.128251 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255d3603-c2f6-4ccb-bc15-07b2c838c006 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:01:35.128528 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255d3603-c2f6-4ccb-bc15-07b2c838c006 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:01:35.128795 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255d3603-c2f6-4ccb-bc15-07b2c838c006 None admin] PATH_INFO: `/v3/projects/df9f9c07fe5843a0b049a0d6e0e860bf` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:01:35.130034 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255d3603-c2f6-4ccb-bc15-07b2c838c006 None admin] RBAC: Authorizing `identity:get_project(project_id=df9f9c07fe5843a0b049a0d6e0e860bf)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:01:35.131467 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255d3603-c2f6-4ccb-bc15-07b2c838c006 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:01:35.133161 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 592/1160] 10.222.0.36 () {56 vars in 1186 bytes} [Tue May 3 14:01:34 2022] GET /identity/v3/projects/df9f9c07fe5843a0b049a0d6e0e860bf => generated 311 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:01:35.142036 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3793f011-338c-4cec-9c0a-117fa71b3b8e None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:01:35.248132 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3793f011-338c-4cec-9c0a-117fa71b3b8e None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:01:35.282764 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822d890d-7ac0-44d4-8a18-66b51a661c13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:01:35.283412 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822d890d-7ac0-44d4-8a18-66b51a661c13 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:01:35.283676 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822d890d-7ac0-44d4-8a18-66b51a661c13 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:01:35.283963 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822d890d-7ac0-44d4-8a18-66b51a661c13 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:01:35.284785 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822d890d-7ac0-44d4-8a18-66b51a661c13 None admin] RBAC: Adding query filter params (role.id=36abe9b50fd8479c86c4f8f70fd85aa3, scope.project.id=df9f9c07fe5843a0b049a0d6e0e860bf, user.id=cee17d73f48549d692381e5719210f7b) {{(pid=80012) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:01:35.285090 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822d890d-7ac0-44d4-8a18-66b51a661c13 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:01:35.286564 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822d890d-7ac0-44d4-8a18-66b51a661c13 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:01:35.292289 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 569/1161] 10.222.0.36 () {56 vars in 1374 bytes} [Tue May 3 14:01:35 2022] GET /identity/v3/role_assignments?user.id=cee17d73f48549d692381e5719210f7b&scope.project.id=df9f9c07fe5843a0b049a0d6e0e860bf&role.id=36abe9b50fd8479c86c4f8f70fd85aa3 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:01:37.515177 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9107e30-46c0-48fe-b212-de301441a80f None None] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:01:37.516099 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9107e30-46c0-48fe-b212-de301441a80f None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:01:37.516099 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9107e30-46c0-48fe-b212-de301441a80f None None] PATH_INFO: `/` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:01:37.518271 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 593/1162] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 3 14:01:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 14:01:37.524435 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189a2a14-dc06-4957-891e-d1b9a2b8001b None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:01:37.524891 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189a2a14-dc06-4957-891e-d1b9a2b8001b None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:01:37.524990 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189a2a14-dc06-4957-891e-d1b9a2b8001b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:01:37.543892 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-189a2a14-dc06-4957-891e-d1b9a2b8001b None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:01:37.545063 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-189a2a14-dc06-4957-891e-d1b9a2b8001b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:01:37.619400 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 570/1163] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 3 14:01:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 14:01:37.641752 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9107e30-46c0-48fe-b212-de301441a80f None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:01:37.741643 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9107e30-46c0-48fe-b212-de301441a80f None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:01:37.776018 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c337d280-fd02-497e-8674-eeeec2863561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:01:37.776606 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c337d280-fd02-497e-8674-eeeec2863561 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:01:37.776883 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c337d280-fd02-497e-8674-eeeec2863561 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:01:37.777155 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c337d280-fd02-497e-8674-eeeec2863561 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:01:37.843147 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c337d280-fd02-497e-8674-eeeec2863561 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:01:37.844573 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c337d280-fd02-497e-8674-eeeec2863561 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:01:37.938935 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 594/1164] 10.222.0.36 () {58 vars in 1282 bytes} [Tue May 3 14:01:37 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 03 14:01:37.945479 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189a2a14-dc06-4957-891e-d1b9a2b8001b None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:01:38.048796 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189a2a14-dc06-4957-891e-d1b9a2b8001b None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:01:38.083312 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1758fd1-14c8-43f4-b7e0-7a858eb8565f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:01:38.084115 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1758fd1-14c8-43f4-b7e0-7a858eb8565f None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:01:38.084390 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1758fd1-14c8-43f4-b7e0-7a858eb8565f None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:01:38.084659 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1758fd1-14c8-43f4-b7e0-7a858eb8565f None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:01:38.091631 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1758fd1-14c8-43f4-b7e0-7a858eb8565f None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:01:38.093056 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1758fd1-14c8-43f4-b7e0-7a858eb8565f None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:01:38.106884 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application [None req-a1758fd1-14c8-43f4-b7e0-7a858eb8565f None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. May 03 14:01:38.106884 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:01:38.106884 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain May 03 14:01:38.106884 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) May 03 14:01:38.106884 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 14:01:38.106884 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 14:01:38.106884 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 14:01:38.106884 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 14:01:38.106884 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. May 03 14:01:38.106884 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application May 03 14:01:38.106884 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 03 14:01:38.106884 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application May 03 14:01:38.106884 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:01:38.106884 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 14:01:38.106884 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 14:01:38.106884 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 14:01:38.106884 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 14:01:38.108113 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 14:01:38.108113 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 14:01:38.108113 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 14:01:38.108113 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 14:01:38.108113 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 14:01:38.108113 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 14:01:38.108113 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 14:01:38.108113 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 14:01:38.108113 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 14:01:38.108113 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 14:01:38.108113 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 14:01:38.108113 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 14:01:38.108113 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 14:01:38.108113 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 14:01:38.108113 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 14:01:38.108113 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.get_or_create( May 03 14:01:38.110052 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 14:01:38.110052 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application with Lock( May 03 14:01:38.110052 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 14:01:38.110052 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._enter() May 03 14:01:38.110052 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 14:01:38.110052 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 14:01:38.110052 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 14:01:38.110052 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.creator() May 03 14:01:38.110052 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 14:01:38.110052 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application created_value = creator( May 03 14:01:38.110052 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain May 03 14:01:38.110052 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 14:01:38.110052 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. May 03 14:01:38.110052 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application May 03 14:01:38.110052 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 571/1165] 10.222.0.36 () {56 vars in 1117 bytes} [Tue May 3 14:01:37 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 14:01:38.117551 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c337d280-fd02-497e-8674-eeeec2863561 None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:01:38.219008 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c337d280-fd02-497e-8674-eeeec2863561 None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:01:38.253899 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3326060-aa81-45f6-a3ac-8f3690b28b11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:01:38.254534 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3326060-aa81-45f6-a3ac-8f3690b28b11 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:01:38.254806 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3326060-aa81-45f6-a3ac-8f3690b28b11 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:01:38.255078 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3326060-aa81-45f6-a3ac-8f3690b28b11 None admin] PATH_INFO: `/v3/domains` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:01:38.255789 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3326060-aa81-45f6-a3ac-8f3690b28b11 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:01:38.256086 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3326060-aa81-45f6-a3ac-8f3690b28b11 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:01:38.257489 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3326060-aa81-45f6-a3ac-8f3690b28b11 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:01:38.264570 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 595/1166] 10.222.0.36 () {56 vars in 1115 bytes} [Tue May 3 14:01:38 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:01:40.459074 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87919d88-7f1b-4c8b-95a9-44be26a29146 None None] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:01:40.459901 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87919d88-7f1b-4c8b-95a9-44be26a29146 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:01:40.459901 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87919d88-7f1b-4c8b-95a9-44be26a29146 None None] PATH_INFO: `/` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:01:40.462095 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 572/1167] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 3 14:01:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 14:01:40.467872 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baa5133-a3db-4649-83d9-b36bfa064b67 None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:01:40.468308 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baa5133-a3db-4649-83d9-b36bfa064b67 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:01:40.468401 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baa5133-a3db-4649-83d9-b36bfa064b67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:01:40.486087 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-0baa5133-a3db-4649-83d9-b36bfa064b67 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:01:40.487243 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-0baa5133-a3db-4649-83d9-b36bfa064b67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:01:40.553197 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 596/1168] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 3 14:01:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 14:01:40.575628 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87919d88-7f1b-4c8b-95a9-44be26a29146 None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:01:40.678625 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87919d88-7f1b-4c8b-95a9-44be26a29146 None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:01:40.712506 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2a5ef7-27b0-4352-a9b1-01d6945ad1d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:01:40.713084 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2a5ef7-27b0-4352-a9b1-01d6945ad1d2 None admin] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:01:40.713781 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2a5ef7-27b0-4352-a9b1-01d6945ad1d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:01:40.714194 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2a5ef7-27b0-4352-a9b1-01d6945ad1d2 None admin] PATH_INFO: `/v3/domains` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:01:40.715088 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2a5ef7-27b0-4352-a9b1-01d6945ad1d2 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:01:40.716447 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2a5ef7-27b0-4352-a9b1-01d6945ad1d2 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:01:40.736385 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 573/1169] 10.222.0.36 () {60 vars in 1138 bytes} [Tue May 3 14:01:40 2022] POST /identity/v3/domains => generated 267 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 14:01:42.972009 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3595d686-4787-4875-8c46-d27d4a1df560 None None] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:01:42.972603 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3595d686-4787-4875-8c46-d27d4a1df560 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:01:42.972603 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3595d686-4787-4875-8c46-d27d4a1df560 None None] PATH_INFO: `/` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:01:42.973950 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 597/1170] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 3 14:01:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 14:01:42.980494 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fc2c41-80bc-4193-b9cc-d6baf721c2e2 None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:01:42.981201 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fc2c41-80bc-4193-b9cc-d6baf721c2e2 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:01:42.981428 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fc2c41-80bc-4193-b9cc-d6baf721c2e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:01:43.004126 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-96fc2c41-80bc-4193-b9cc-d6baf721c2e2 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:01:43.005344 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-96fc2c41-80bc-4193-b9cc-d6baf721c2e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:01:43.075877 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 574/1171] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 3 14:01:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 14:01:43.100644 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3595d686-4787-4875-8c46-d27d4a1df560 None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:01:43.207970 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3595d686-4787-4875-8c46-d27d4a1df560 None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:01:43.241944 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1cf6bf-25d8-4618-991f-54eef2c6fe08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:01:43.242753 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1cf6bf-25d8-4618-991f-54eef2c6fe08 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:01:43.243032 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1cf6bf-25d8-4618-991f-54eef2c6fe08 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:01:43.243288 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1cf6bf-25d8-4618-991f-54eef2c6fe08 None admin] PATH_INFO: `/v3/domains/ddf58012953742dfb46d030c090da212` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:01:43.253626 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1cf6bf-25d8-4618-991f-54eef2c6fe08 None admin] RBAC: Authorizing `identity:get_domain(domain_id=ddf58012953742dfb46d030c090da212)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:01:43.255079 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1cf6bf-25d8-4618-991f-54eef2c6fe08 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:01:43.256744 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 598/1172] 10.222.0.36 () {56 vars in 1183 bytes} [Tue May 3 14:01:43 2022] GET /identity/v3/domains/ddf58012953742dfb46d030c090da212 => generated 267 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:01:43.266313 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fc2c41-80bc-4193-b9cc-d6baf721c2e2 None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:01:43.379605 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fc2c41-80bc-4193-b9cc-d6baf721c2e2 None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:01:43.413472 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa9cccd-8950-4e05-867b-afdf0b4a3dc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:01:43.414160 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa9cccd-8950-4e05-867b-afdf0b4a3dc6 None admin] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:01:43.414436 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa9cccd-8950-4e05-867b-afdf0b4a3dc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:01:43.414718 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa9cccd-8950-4e05-867b-afdf0b4a3dc6 None admin] PATH_INFO: `/v3/projects` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:01:43.415433 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa9cccd-8950-4e05-867b-afdf0b4a3dc6 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:01:43.416974 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa9cccd-8950-4e05-867b-afdf0b4a3dc6 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:01:43.446924 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 575/1173] 10.222.0.36 () {60 vars in 1141 bytes} [Tue May 3 14:01:43 2022] POST /identity/v3/projects => generated 361 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 14:01:45.718718 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf4102b-af2c-45b1-88e2-ad1eb83f3990 None None] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:01:45.719614 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf4102b-af2c-45b1-88e2-ad1eb83f3990 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:01:45.719614 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf4102b-af2c-45b1-88e2-ad1eb83f3990 None None] PATH_INFO: `/` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:01:45.721834 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 599/1174] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 3 14:01:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 14:01:45.730392 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5d36d3-4452-4b26-8e20-fb20b81d94f0 None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:01:45.730844 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5d36d3-4452-4b26-8e20-fb20b81d94f0 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:01:45.731323 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5d36d3-4452-4b26-8e20-fb20b81d94f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:01:45.754945 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-3f5d36d3-4452-4b26-8e20-fb20b81d94f0 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:01:45.756140 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-3f5d36d3-4452-4b26-8e20-fb20b81d94f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:01:45.836393 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 576/1175] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 3 14:01:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 14:01:45.862050 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf4102b-af2c-45b1-88e2-ad1eb83f3990 None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:01:45.964800 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf4102b-af2c-45b1-88e2-ad1eb83f3990 None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:01:45.997718 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a4bd34-30ce-4b2c-8adb-ee5e9ea57026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:01:45.998571 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a4bd34-30ce-4b2c-8adb-ee5e9ea57026 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:01:45.998849 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a4bd34-30ce-4b2c-8adb-ee5e9ea57026 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:01:45.999145 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a4bd34-30ce-4b2c-8adb-ee5e9ea57026 None admin] PATH_INFO: `/v3/domains/ddf58012953742dfb46d030c090da212` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:01:46.000351 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a4bd34-30ce-4b2c-8adb-ee5e9ea57026 None admin] RBAC: Authorizing `identity:get_domain(domain_id=ddf58012953742dfb46d030c090da212)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:01:46.001828 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a4bd34-30ce-4b2c-8adb-ee5e9ea57026 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:01:46.003428 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 600/1176] 10.222.0.36 () {56 vars in 1183 bytes} [Tue May 3 14:01:45 2022] GET /identity/v3/domains/ddf58012953742dfb46d030c090da212 => generated 267 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:01:46.009445 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5d36d3-4452-4b26-8e20-fb20b81d94f0 None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:01:46.108749 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5d36d3-4452-4b26-8e20-fb20b81d94f0 None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:01:46.142569 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf8ca68-9367-44b7-ad84-98dfcda0288f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:01:46.143225 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf8ca68-9367-44b7-ad84-98dfcda0288f None admin] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:01:46.143500 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf8ca68-9367-44b7-ad84-98dfcda0288f None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:01:46.143775 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf8ca68-9367-44b7-ad84-98dfcda0288f None admin] PATH_INFO: `/v3/users` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:01:46.144471 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf8ca68-9367-44b7-ad84-98dfcda0288f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:01:46.145923 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf8ca68-9367-44b7-ad84-98dfcda0288f None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:01:46.172451 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 577/1177] 10.222.0.36 () {60 vars in 1132 bytes} [Tue May 3 14:01:46 2022] POST /identity/v3/users => generated 311 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 14:01:48.430089 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34d080f-5946-4a07-a935-635896465f31 None None] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:01:48.430610 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34d080f-5946-4a07-a935-635896465f31 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:01:48.430610 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34d080f-5946-4a07-a935-635896465f31 None None] PATH_INFO: `/` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:01:48.432656 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 601/1178] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 3 14:01:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 14:01:48.441273 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4fdb5f-7c01-4cfe-9903-ca7b9b51c32f None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:01:48.441708 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4fdb5f-7c01-4cfe-9903-ca7b9b51c32f None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:01:48.441915 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4fdb5f-7c01-4cfe-9903-ca7b9b51c32f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:01:48.461364 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-2e4fdb5f-7c01-4cfe-9903-ca7b9b51c32f None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:01:48.462538 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-2e4fdb5f-7c01-4cfe-9903-ca7b9b51c32f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:01:48.532878 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 578/1179] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 3 14:01:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 14:01:48.556447 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34d080f-5946-4a07-a935-635896465f31 None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:01:48.667911 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34d080f-5946-4a07-a935-635896465f31 None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:01:48.708141 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02470149-0197-464f-a7d5-454bda66c1d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:01:48.708865 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02470149-0197-464f-a7d5-454bda66c1d5 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:01:48.709137 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02470149-0197-464f-a7d5-454bda66c1d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:01:48.709436 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02470149-0197-464f-a7d5-454bda66c1d5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:01:48.720791 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02470149-0197-464f-a7d5-454bda66c1d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 14:01:48.728597 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application [None req-02470149-0197-464f-a7d5-454bda66c1d5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 03 14:01:48.728597 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:01:48.728597 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 14:01:48.728597 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 14:01:48.728597 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 14:01:48.728597 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 14:01:48.728597 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 14:01:48.728597 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 14:01:48.728597 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 14:01:48.728597 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 14:01:48.728597 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 14:01:48.728597 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 14:01:48.728597 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 14:01:48.728597 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 14:01:48.728597 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 14:01:48.728597 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 14:01:48.729681 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 14:01:48.729681 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 14:01:48.729681 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 14:01:48.729681 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 14:01:48.729681 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 14:01:48.729681 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 14:01:48.729681 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 14:01:48.729681 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 14:01:48.729681 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 14:01:48.729681 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.get_or_create( May 03 14:01:48.729681 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 14:01:48.729681 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application with Lock( May 03 14:01:48.729681 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 14:01:48.729681 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._enter() May 03 14:01:48.729681 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 14:01:48.729681 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 14:01:48.730884 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 14:01:48.730884 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.creator() May 03 14:01:48.730884 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 14:01:48.730884 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application created_value = creator( May 03 14:01:48.730884 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 14:01:48.730884 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 14:01:48.730884 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 14:01:48.730884 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 14:01:48.730884 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 14:01:48.730884 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 14:01:48.730884 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 03 14:01:48.730884 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application May 03 14:01:48.730884 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 602/1180] 10.222.0.36 () {56 vars in 1096 bytes} [Tue May 3 14:01:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 14:01:48.736272 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4fdb5f-7c01-4cfe-9903-ca7b9b51c32f None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:01:48.849650 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4fdb5f-7c01-4cfe-9903-ca7b9b51c32f None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:01:48.885900 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408004dc-fb2a-4208-890a-d652442091c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:01:48.886631 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408004dc-fb2a-4208-890a-d652442091c6 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:01:48.886913 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408004dc-fb2a-4208-890a-d652442091c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:01:48.887186 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408004dc-fb2a-4208-890a-d652442091c6 None admin] PATH_INFO: `/v3/roles` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:01:48.887934 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408004dc-fb2a-4208-890a-d652442091c6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80012) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:01:48.888243 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408004dc-fb2a-4208-890a-d652442091c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:01:48.889640 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408004dc-fb2a-4208-890a-d652442091c6 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:01:48.897639 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 579/1181] 10.222.0.36 () {56 vars in 1099 bytes} [Tue May 3 14:01:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:01:48.905528 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02470149-0197-464f-a7d5-454bda66c1d5 None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:01:49.012865 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02470149-0197-464f-a7d5-454bda66c1d5 None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:01:49.046704 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c0b47b-89e4-4553-94ee-06d2b3ca2811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:01:49.047569 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c0b47b-89e4-4553-94ee-06d2b3ca2811 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:01:49.047842 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c0b47b-89e4-4553-94ee-06d2b3ca2811 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:01:49.048107 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c0b47b-89e4-4553-94ee-06d2b3ca2811 None admin] PATH_INFO: `/v3/users/2c3dc10462a146b5afd7faaaf5f05701` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:01:49.062639 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c0b47b-89e4-4553-94ee-06d2b3ca2811 None admin] RBAC: Authorizing `identity:get_user(user_id=2c3dc10462a146b5afd7faaaf5f05701)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:01:49.064090 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c0b47b-89e4-4553-94ee-06d2b3ca2811 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:01:49.065777 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 603/1182] 10.222.0.36 () {56 vars in 1177 bytes} [Tue May 3 14:01:48 2022] GET /identity/v3/users/2c3dc10462a146b5afd7faaaf5f05701 => generated 311 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:01:49.072393 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408004dc-fb2a-4208-890a-d652442091c6 None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:01:49.170703 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408004dc-fb2a-4208-890a-d652442091c6 None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:01:49.208438 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580bf11b-8deb-4cdd-83a1-a54c62aed731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:01:49.209083 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580bf11b-8deb-4cdd-83a1-a54c62aed731 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:01:49.209404 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580bf11b-8deb-4cdd-83a1-a54c62aed731 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:01:49.209681 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580bf11b-8deb-4cdd-83a1-a54c62aed731 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:01:49.277881 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580bf11b-8deb-4cdd-83a1-a54c62aed731 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:01:49.279256 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580bf11b-8deb-4cdd-83a1-a54c62aed731 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:01:49.387301 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 580/1183] 10.222.0.36 () {58 vars in 1282 bytes} [Tue May 3 14:01:49 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 03 14:01:49.396705 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c0b47b-89e4-4553-94ee-06d2b3ca2811 None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:01:49.499815 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c0b47b-89e4-4553-94ee-06d2b3ca2811 None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:01:49.534012 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8d07d2-7660-4369-951e-14a349754c8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:01:49.534804 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8d07d2-7660-4369-951e-14a349754c8f None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:01:49.535078 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8d07d2-7660-4369-951e-14a349754c8f None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:01:49.535350 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8d07d2-7660-4369-951e-14a349754c8f None admin] PATH_INFO: `/v3/projects/55914748d7f74a6ab56e5ddb48973d3e` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:01:49.536649 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8d07d2-7660-4369-951e-14a349754c8f None admin] RBAC: Authorizing `identity:get_project(project_id=55914748d7f74a6ab56e5ddb48973d3e)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:01:49.538119 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8d07d2-7660-4369-951e-14a349754c8f None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:01:49.539813 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 604/1184] 10.222.0.36 () {56 vars in 1186 bytes} [Tue May 3 14:01:49 2022] GET /identity/v3/projects/55914748d7f74a6ab56e5ddb48973d3e => generated 361 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:01:49.546272 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580bf11b-8deb-4cdd-83a1-a54c62aed731 None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:01:49.669475 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580bf11b-8deb-4cdd-83a1-a54c62aed731 None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:01:49.704851 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4391923e-ac48-4a15-8d17-03c178aaa7de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:01:49.705525 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4391923e-ac48-4a15-8d17-03c178aaa7de None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:01:49.705802 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4391923e-ac48-4a15-8d17-03c178aaa7de None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:01:49.706079 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4391923e-ac48-4a15-8d17-03c178aaa7de None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:01:49.706915 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4391923e-ac48-4a15-8d17-03c178aaa7de None admin] RBAC: Adding query filter params (role.id=36abe9b50fd8479c86c4f8f70fd85aa3, scope.project.id=55914748d7f74a6ab56e5ddb48973d3e, user.id=2c3dc10462a146b5afd7faaaf5f05701) {{(pid=80012) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:01:49.707226 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4391923e-ac48-4a15-8d17-03c178aaa7de None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:01:49.708666 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4391923e-ac48-4a15-8d17-03c178aaa7de None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:01:49.714563 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 581/1185] 10.222.0.36 () {56 vars in 1374 bytes} [Tue May 3 14:01:49 2022] GET /identity/v3/role_assignments?user.id=2c3dc10462a146b5afd7faaaf5f05701&scope.project.id=55914748d7f74a6ab56e5ddb48973d3e&role.id=36abe9b50fd8479c86c4f8f70fd85aa3 => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:01:51.912191 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d9875b-04c9-40f4-b2c1-50077bdac06a None None] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:01:51.912770 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d9875b-04c9-40f4-b2c1-50077bdac06a None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:01:51.912770 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d9875b-04c9-40f4-b2c1-50077bdac06a None None] PATH_INFO: `/` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:01:51.915077 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 605/1186] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 3 14:01:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 14:01:51.924034 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af7215c-b762-4c9d-9541-e98441b39964 None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:01:51.924433 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af7215c-b762-4c9d-9541-e98441b39964 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:01:51.924670 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af7215c-b762-4c9d-9541-e98441b39964 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:01:51.944420 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-8af7215c-b762-4c9d-9541-e98441b39964 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:01:51.945654 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-8af7215c-b762-4c9d-9541-e98441b39964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:01:52.015115 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 582/1187] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 3 14:01:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 14:01:52.038200 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d9875b-04c9-40f4-b2c1-50077bdac06a None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:01:52.157388 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d9875b-04c9-40f4-b2c1-50077bdac06a None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:01:52.191474 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1008aa5c-7391-4bb3-8198-7f57b88c3413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:01:52.192196 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1008aa5c-7391-4bb3-8198-7f57b88c3413 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:01:52.192467 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1008aa5c-7391-4bb3-8198-7f57b88c3413 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:01:52.192734 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1008aa5c-7391-4bb3-8198-7f57b88c3413 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:01:52.203333 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1008aa5c-7391-4bb3-8198-7f57b88c3413 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 14:01:52.210816 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application [None req-1008aa5c-7391-4bb3-8198-7f57b88c3413 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 03 14:01:52.210816 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:01:52.210816 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 14:01:52.210816 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 14:01:52.210816 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 14:01:52.210816 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 14:01:52.210816 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 14:01:52.210816 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 14:01:52.210816 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 14:01:52.210816 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 14:01:52.210816 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 14:01:52.210816 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 14:01:52.210816 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 14:01:52.210816 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 14:01:52.210816 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 14:01:52.210816 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 14:01:52.211900 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 14:01:52.211900 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 14:01:52.211900 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 14:01:52.211900 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 14:01:52.211900 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 14:01:52.211900 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 14:01:52.211900 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 14:01:52.211900 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 14:01:52.211900 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 14:01:52.211900 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.get_or_create( May 03 14:01:52.211900 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 14:01:52.211900 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application with Lock( May 03 14:01:52.211900 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 14:01:52.211900 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._enter() May 03 14:01:52.211900 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 14:01:52.211900 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 14:01:52.212935 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 14:01:52.212935 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.creator() May 03 14:01:52.212935 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 14:01:52.212935 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application created_value = creator( May 03 14:01:52.212935 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 14:01:52.212935 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 14:01:52.212935 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 14:01:52.212935 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 14:01:52.212935 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 14:01:52.212935 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 14:01:52.212935 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 03 14:01:52.212935 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application May 03 14:01:52.212935 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 606/1188] 10.222.0.36 () {56 vars in 1096 bytes} [Tue May 3 14:01:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 14:01:52.219216 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af7215c-b762-4c9d-9541-e98441b39964 None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:01:52.321302 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af7215c-b762-4c9d-9541-e98441b39964 None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:01:52.355678 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf82e4e-8d76-4e98-8ead-111406f1c580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:01:52.356331 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf82e4e-8d76-4e98-8ead-111406f1c580 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:01:52.356610 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf82e4e-8d76-4e98-8ead-111406f1c580 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:01:52.356881 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf82e4e-8d76-4e98-8ead-111406f1c580 None admin] PATH_INFO: `/v3/roles` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:01:52.357662 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf82e4e-8d76-4e98-8ead-111406f1c580 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80012) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:01:52.357968 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf82e4e-8d76-4e98-8ead-111406f1c580 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:01:52.359336 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf82e4e-8d76-4e98-8ead-111406f1c580 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:01:52.367311 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 583/1189] 10.222.0.36 () {56 vars in 1099 bytes} [Tue May 3 14:01:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:01:52.374099 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1008aa5c-7391-4bb3-8198-7f57b88c3413 None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:01:52.474230 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1008aa5c-7391-4bb3-8198-7f57b88c3413 None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:01:52.507756 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec182be-7570-4b37-861f-e1b28d11de09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:01:52.508610 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec182be-7570-4b37-861f-e1b28d11de09 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:01:52.508882 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec182be-7570-4b37-861f-e1b28d11de09 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:01:52.509149 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec182be-7570-4b37-861f-e1b28d11de09 None admin] PATH_INFO: `/v3/users/2c3dc10462a146b5afd7faaaf5f05701` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:01:52.510506 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec182be-7570-4b37-861f-e1b28d11de09 None admin] RBAC: Authorizing `identity:get_user(user_id=2c3dc10462a146b5afd7faaaf5f05701)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:01:52.511962 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec182be-7570-4b37-861f-e1b28d11de09 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:01:52.513603 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 607/1190] 10.222.0.36 () {56 vars in 1177 bytes} [Tue May 3 14:01:52 2022] GET /identity/v3/users/2c3dc10462a146b5afd7faaaf5f05701 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:01:52.520123 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf82e4e-8d76-4e98-8ead-111406f1c580 None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:01:52.626120 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf82e4e-8d76-4e98-8ead-111406f1c580 None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:01:52.661122 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4719e57-4ecb-4461-8ae9-de51995c98f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:01:52.662010 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4719e57-4ecb-4461-8ae9-de51995c98f2 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:01:52.662284 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4719e57-4ecb-4461-8ae9-de51995c98f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:01:52.662555 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4719e57-4ecb-4461-8ae9-de51995c98f2 None admin] PATH_INFO: `/v3/projects/55914748d7f74a6ab56e5ddb48973d3e` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:01:52.663800 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4719e57-4ecb-4461-8ae9-de51995c98f2 None admin] RBAC: Authorizing `identity:get_project(project_id=55914748d7f74a6ab56e5ddb48973d3e)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:01:52.665217 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4719e57-4ecb-4461-8ae9-de51995c98f2 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:01:52.666957 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 584/1191] 10.222.0.36 () {56 vars in 1186 bytes} [Tue May 3 14:01:52 2022] GET /identity/v3/projects/55914748d7f74a6ab56e5ddb48973d3e => generated 361 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:01:52.673051 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec182be-7570-4b37-861f-e1b28d11de09 None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:01:52.770465 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec182be-7570-4b37-861f-e1b28d11de09 None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:01:52.806503 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724fb45d-db21-4692-893d-a090b0c44626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:01:52.807385 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724fb45d-db21-4692-893d-a090b0c44626 None admin] REQUEST_METHOD: `PUT` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:01:52.807821 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724fb45d-db21-4692-893d-a090b0c44626 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:01:52.808093 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724fb45d-db21-4692-893d-a090b0c44626 None admin] PATH_INFO: `/v3/projects/55914748d7f74a6ab56e5ddb48973d3e/users/2c3dc10462a146b5afd7faaaf5f05701/roles/36abe9b50fd8479c86c4f8f70fd85aa3` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:01:52.810375 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724fb45d-db21-4692-893d-a090b0c44626 None admin] RBAC: Authorizing `identity:create_grant(project_id=55914748d7f74a6ab56e5ddb48973d3e, user_id=2c3dc10462a146b5afd7faaaf5f05701, role_id=36abe9b50fd8479c86c4f8f70fd85aa3)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:01:52.811812 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724fb45d-db21-4692-893d-a090b0c44626 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:01:52.827089 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 608/1192] 10.222.0.36 () {58 vars in 1439 bytes} [Tue May 3 14:01:52 2022] PUT /identity/v3/projects/55914748d7f74a6ab56e5ddb48973d3e/users/2c3dc10462a146b5afd7faaaf5f05701/roles/36abe9b50fd8479c86c4f8f70fd85aa3 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:01:55.020456 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b129014-c4f1-4e49-bec0-b2b124fabdad None None] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:01:55.021367 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b129014-c4f1-4e49-bec0-b2b124fabdad None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:01:55.021367 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b129014-c4f1-4e49-bec0-b2b124fabdad None None] PATH_INFO: `/` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:01:55.023551 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 585/1193] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 3 14:01:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 14:01:55.031752 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fdcc4d-e398-49a1-93cc-2cc680c4b6e5 None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:01:55.032200 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fdcc4d-e398-49a1-93cc-2cc680c4b6e5 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:01:55.032309 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fdcc4d-e398-49a1-93cc-2cc680c4b6e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:01:55.050084 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-a5fdcc4d-e398-49a1-93cc-2cc680c4b6e5 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:01:55.051248 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-a5fdcc4d-e398-49a1-93cc-2cc680c4b6e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:01:55.126529 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 609/1194] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 3 14:01:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 03 14:01:55.153895 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b129014-c4f1-4e49-bec0-b2b124fabdad None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:01:55.263007 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b129014-c4f1-4e49-bec0-b2b124fabdad None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:01:55.297259 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cb0cba-583f-4eef-b035-fa0540b0bf93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:01:55.298001 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cb0cba-583f-4eef-b035-fa0540b0bf93 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:01:55.298279 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cb0cba-583f-4eef-b035-fa0540b0bf93 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:01:55.298546 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cb0cba-583f-4eef-b035-fa0540b0bf93 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:01:55.309639 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cb0cba-583f-4eef-b035-fa0540b0bf93 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 14:01:55.317336 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application [None req-f0cb0cba-583f-4eef-b035-fa0540b0bf93 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 03 14:01:55.317336 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:01:55.317336 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 14:01:55.317336 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 14:01:55.317336 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 14:01:55.317336 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 14:01:55.317336 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 14:01:55.317336 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 14:01:55.317336 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 14:01:55.317336 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 14:01:55.317336 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 14:01:55.317336 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 14:01:55.317336 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 14:01:55.317336 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 14:01:55.317336 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 14:01:55.317336 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 14:01:55.318522 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 14:01:55.318522 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 14:01:55.318522 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 14:01:55.318522 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 14:01:55.318522 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 14:01:55.318522 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 14:01:55.318522 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 14:01:55.318522 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 14:01:55.318522 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 14:01:55.318522 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.get_or_create( May 03 14:01:55.318522 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 14:01:55.318522 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application with Lock( May 03 14:01:55.318522 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 14:01:55.318522 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._enter() May 03 14:01:55.318522 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 14:01:55.318522 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 14:01:55.319572 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 14:01:55.319572 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.creator() May 03 14:01:55.319572 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 14:01:55.319572 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application created_value = creator( May 03 14:01:55.319572 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 14:01:55.319572 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 14:01:55.319572 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 14:01:55.319572 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 14:01:55.319572 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 14:01:55.319572 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 14:01:55.319572 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 03 14:01:55.319572 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application May 03 14:01:55.321513 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 586/1195] 10.222.0.36 () {56 vars in 1096 bytes} [Tue May 3 14:01:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 14:01:55.325644 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fdcc4d-e398-49a1-93cc-2cc680c4b6e5 None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:01:55.421558 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fdcc4d-e398-49a1-93cc-2cc680c4b6e5 None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:01:55.455978 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8889cc9-9617-4234-88bc-7d21ddd9e8f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:01:55.456623 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8889cc9-9617-4234-88bc-7d21ddd9e8f8 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:01:55.456904 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8889cc9-9617-4234-88bc-7d21ddd9e8f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:01:55.457168 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8889cc9-9617-4234-88bc-7d21ddd9e8f8 None admin] PATH_INFO: `/v3/roles` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:01:55.457931 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8889cc9-9617-4234-88bc-7d21ddd9e8f8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:01:55.458236 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8889cc9-9617-4234-88bc-7d21ddd9e8f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:01:55.459604 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8889cc9-9617-4234-88bc-7d21ddd9e8f8 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:01:55.468033 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 610/1196] 10.222.0.36 () {56 vars in 1099 bytes} [Tue May 3 14:01:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:01:55.477440 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cb0cba-583f-4eef-b035-fa0540b0bf93 None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:01:55.590479 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cb0cba-583f-4eef-b035-fa0540b0bf93 None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:01:55.625128 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a1dd20-847d-4d6b-aaaa-aec11e4e2e01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:01:55.626004 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a1dd20-847d-4d6b-aaaa-aec11e4e2e01 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:01:55.626288 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a1dd20-847d-4d6b-aaaa-aec11e4e2e01 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:01:55.626554 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a1dd20-847d-4d6b-aaaa-aec11e4e2e01 None admin] PATH_INFO: `/v3/users/2c3dc10462a146b5afd7faaaf5f05701` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:01:55.627871 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a1dd20-847d-4d6b-aaaa-aec11e4e2e01 None admin] RBAC: Authorizing `identity:get_user(user_id=2c3dc10462a146b5afd7faaaf5f05701)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:01:55.629316 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a1dd20-847d-4d6b-aaaa-aec11e4e2e01 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:01:55.630956 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 587/1197] 10.222.0.36 () {56 vars in 1177 bytes} [Tue May 3 14:01:55 2022] GET /identity/v3/users/2c3dc10462a146b5afd7faaaf5f05701 => generated 311 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:01:55.637542 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8889cc9-9617-4234-88bc-7d21ddd9e8f8 None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:01:55.739855 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8889cc9-9617-4234-88bc-7d21ddd9e8f8 None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:01:55.773536 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd67149-c0fd-4483-a69f-31749868ff38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:01:55.774165 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd67149-c0fd-4483-a69f-31749868ff38 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:01:55.774445 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd67149-c0fd-4483-a69f-31749868ff38 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:01:55.774720 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd67149-c0fd-4483-a69f-31749868ff38 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:01:55.840348 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd67149-c0fd-4483-a69f-31749868ff38 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:01:55.841884 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd67149-c0fd-4483-a69f-31749868ff38 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:01:55.937099 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 611/1198] 10.222.0.36 () {58 vars in 1282 bytes} [Tue May 3 14:01:55 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 03 14:01:55.946524 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a1dd20-847d-4d6b-aaaa-aec11e4e2e01 None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:01:56.045801 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a1dd20-847d-4d6b-aaaa-aec11e4e2e01 None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:01:56.086510 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a117093-0a28-47f4-82b8-590b6f56172b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:01:56.087367 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a117093-0a28-47f4-82b8-590b6f56172b None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:01:56.087641 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a117093-0a28-47f4-82b8-590b6f56172b None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:01:56.087910 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a117093-0a28-47f4-82b8-590b6f56172b None admin] PATH_INFO: `/v3/projects/55914748d7f74a6ab56e5ddb48973d3e` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:01:56.089731 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a117093-0a28-47f4-82b8-590b6f56172b None admin] RBAC: Authorizing `identity:get_project(project_id=55914748d7f74a6ab56e5ddb48973d3e)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:01:56.091192 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a117093-0a28-47f4-82b8-590b6f56172b None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:01:56.092955 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 588/1199] 10.222.0.36 () {56 vars in 1186 bytes} [Tue May 3 14:01:55 2022] GET /identity/v3/projects/55914748d7f74a6ab56e5ddb48973d3e => generated 361 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:01:56.099200 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd67149-c0fd-4483-a69f-31749868ff38 None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:01:56.199167 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd67149-c0fd-4483-a69f-31749868ff38 None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:01:56.233457 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49f5dd5-867d-46e4-a87b-be2a09165f75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:01:56.234095 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49f5dd5-867d-46e4-a87b-be2a09165f75 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:01:56.234372 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49f5dd5-867d-46e4-a87b-be2a09165f75 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:01:56.234637 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49f5dd5-867d-46e4-a87b-be2a09165f75 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:01:56.235453 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49f5dd5-867d-46e4-a87b-be2a09165f75 None admin] RBAC: Adding query filter params (role.id=36abe9b50fd8479c86c4f8f70fd85aa3, scope.project.id=55914748d7f74a6ab56e5ddb48973d3e, user.id=2c3dc10462a146b5afd7faaaf5f05701) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:01:56.235758 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49f5dd5-867d-46e4-a87b-be2a09165f75 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:01:56.237167 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49f5dd5-867d-46e4-a87b-be2a09165f75 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:01:56.243070 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 612/1200] 10.222.0.36 () {56 vars in 1374 bytes} [Tue May 3 14:01:56 2022] GET /identity/v3/role_assignments?user.id=2c3dc10462a146b5afd7faaaf5f05701&scope.project.id=55914748d7f74a6ab56e5ddb48973d3e&role.id=36abe9b50fd8479c86c4f8f70fd85aa3 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:02:56.672908 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec955af9-8d81-49a8-9d4c-79ba96d1e9e6 None None] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:02:56.673733 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec955af9-8d81-49a8-9d4c-79ba96d1e9e6 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:02:56.673733 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec955af9-8d81-49a8-9d4c-79ba96d1e9e6 None None] PATH_INFO: `/` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:02:56.674873 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 589/1201] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 3 14:02:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 14:02:56.681259 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bddc1fa-e699-43f6-89ae-0a45438f8563 None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:02:56.681935 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bddc1fa-e699-43f6-89ae-0a45438f8563 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:02:56.681935 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bddc1fa-e699-43f6-89ae-0a45438f8563 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:02:56.704864 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-5bddc1fa-e699-43f6-89ae-0a45438f8563 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:02:56.706153 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-5bddc1fa-e699-43f6-89ae-0a45438f8563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:02:56.794966 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 613/1202] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 3 14:02:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 14:02:56.821539 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec955af9-8d81-49a8-9d4c-79ba96d1e9e6 None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:02:56.948872 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec955af9-8d81-49a8-9d4c-79ba96d1e9e6 None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:02:56.988848 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64426c37-d24c-4137-b6c6-4c6d8693ecdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:02:56.989868 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64426c37-d24c-4137-b6c6-4c6d8693ecdf None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:02:56.990008 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64426c37-d24c-4137-b6c6-4c6d8693ecdf None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:02:56.990259 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64426c37-d24c-4137-b6c6-4c6d8693ecdf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:02:57.001782 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64426c37-d24c-4137-b6c6-4c6d8693ecdf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:02:57.003611 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64426c37-d24c-4137-b6c6-4c6d8693ecdf None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:02:57.022525 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application [None req-64426c37-d24c-4137-b6c6-4c6d8693ecdf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 14:02:57.022525 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:02:57.022525 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 14:02:57.022525 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 14:02:57.022525 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 14:02:57.022525 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 14:02:57.022525 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 14:02:57.022525 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 14:02:57.022525 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 14:02:57.022525 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 14:02:57.022525 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 14:02:57.022525 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 14:02:57.022525 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 14:02:57.022525 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 14:02:57.022525 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 14:02:57.023816 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 14:02:57.023816 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 14:02:57.023816 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 14:02:57.023816 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 14:02:57.023816 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 14:02:57.023816 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 14:02:57.023816 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.get_or_create( May 03 14:02:57.023816 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 14:02:57.023816 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application with Lock( May 03 14:02:57.023816 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 14:02:57.023816 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._enter() May 03 14:02:57.023816 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 14:02:57.023816 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 14:02:57.023816 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 14:02:57.023816 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.creator() May 03 14:02:57.023816 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 14:02:57.023816 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application created_value = creator( May 03 14:02:57.025028 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 14:02:57.025028 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 14:02:57.025028 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 14:02:57.025028 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application May 03 14:02:57.026909 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 590/1203] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 3 14:02:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 14:02:57.032692 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bddc1fa-e699-43f6-89ae-0a45438f8563 None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:02:57.150063 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bddc1fa-e699-43f6-89ae-0a45438f8563 None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:02:57.192276 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5341123e-aa39-41cf-849b-a44eb4f8fecc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:02:57.193051 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5341123e-aa39-41cf-849b-a44eb4f8fecc None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:02:57.193385 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5341123e-aa39-41cf-849b-a44eb4f8fecc None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:02:57.193697 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5341123e-aa39-41cf-849b-a44eb4f8fecc None admin] PATH_INFO: `/v3/domains` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:02:57.194558 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5341123e-aa39-41cf-849b-a44eb4f8fecc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:02:57.194941 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5341123e-aa39-41cf-849b-a44eb4f8fecc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:02:57.196923 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5341123e-aa39-41cf-849b-a44eb4f8fecc None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:02:57.217398 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 614/1204] 10.222.0.36 () {56 vars in 1109 bytes} [Tue May 3 14:02:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:02:57.219566 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64426c37-d24c-4137-b6c6-4c6d8693ecdf None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:02:57.328879 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64426c37-d24c-4137-b6c6-4c6d8693ecdf None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:02:57.370784 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae023e4-dc2d-41ea-8285-ebdd1eb9bcc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:02:57.371465 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae023e4-dc2d-41ea-8285-ebdd1eb9bcc6 None admin] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:02:57.371792 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae023e4-dc2d-41ea-8285-ebdd1eb9bcc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:02:57.372072 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae023e4-dc2d-41ea-8285-ebdd1eb9bcc6 None admin] PATH_INFO: `/v3/users` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:02:57.372795 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae023e4-dc2d-41ea-8285-ebdd1eb9bcc6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:02:57.374285 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae023e4-dc2d-41ea-8285-ebdd1eb9bcc6 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:02:57.395754 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 591/1205] 10.222.0.36 () {60 vars in 1132 bytes} [Tue May 3 14:02:57 2022] POST /identity/v3/users => generated 251 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 14:03:00.018830 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d394075f-1fad-4d13-a835-e0b59b2899cd None None] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:03:00.019378 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d394075f-1fad-4d13-a835-e0b59b2899cd None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:03:00.019516 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d394075f-1fad-4d13-a835-e0b59b2899cd None None] PATH_INFO: `/` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:03:00.021563 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 615/1206] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 3 14:03:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 14:03:00.027065 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b825d1-e341-430a-9ecb-1dd38f3105c5 None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:03:00.027529 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b825d1-e341-430a-9ecb-1dd38f3105c5 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:03:00.027695 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b825d1-e341-430a-9ecb-1dd38f3105c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:03:00.050295 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-a8b825d1-e341-430a-9ecb-1dd38f3105c5 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:03:00.051505 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-a8b825d1-e341-430a-9ecb-1dd38f3105c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:03:00.124513 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 592/1207] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 3 14:03:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 14:03:00.150854 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d394075f-1fad-4d13-a835-e0b59b2899cd None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:03:00.266480 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d394075f-1fad-4d13-a835-e0b59b2899cd None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:03:00.300214 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41e17c6-cde8-49e5-95b0-12f7dd6866c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:03:00.300907 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41e17c6-cde8-49e5-95b0-12f7dd6866c4 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:03:00.301187 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41e17c6-cde8-49e5-95b0-12f7dd6866c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:03:00.301478 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41e17c6-cde8-49e5-95b0-12f7dd6866c4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:03:00.312815 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41e17c6-cde8-49e5-95b0-12f7dd6866c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 14:03:00.320673 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application [None req-b41e17c6-cde8-49e5-95b0-12f7dd6866c4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 03 14:03:00.320673 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:03:00.320673 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 14:03:00.320673 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 14:03:00.320673 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 14:03:00.320673 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 14:03:00.320673 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 14:03:00.320673 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 14:03:00.320673 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 14:03:00.320673 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 14:03:00.320673 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 14:03:00.320673 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 14:03:00.320673 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 14:03:00.320673 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 14:03:00.320673 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 14:03:00.320673 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 14:03:00.322085 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 14:03:00.322085 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 14:03:00.322085 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 14:03:00.322085 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 14:03:00.322085 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 14:03:00.322085 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 14:03:00.322085 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 14:03:00.322085 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 14:03:00.322085 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 14:03:00.322085 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.get_or_create( May 03 14:03:00.322085 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 14:03:00.322085 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application with Lock( May 03 14:03:00.322085 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 14:03:00.322085 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._enter() May 03 14:03:00.322085 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 14:03:00.322085 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 14:03:00.322978 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 14:03:00.322978 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.creator() May 03 14:03:00.322978 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 14:03:00.322978 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application created_value = creator( May 03 14:03:00.322978 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 14:03:00.322978 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 14:03:00.322978 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 14:03:00.322978 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 14:03:00.322978 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 14:03:00.322978 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 14:03:00.322978 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 03 14:03:00.322978 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application May 03 14:03:00.322978 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 616/1208] 10.222.0.36 () {56 vars in 1102 bytes} [Tue May 3 14:03:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 14:03:00.328232 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b825d1-e341-430a-9ecb-1dd38f3105c5 None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:03:00.442904 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b825d1-e341-430a-9ecb-1dd38f3105c5 None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:03:00.481069 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7f93d9-abf8-4315-bf1e-adabdfeab9c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:03:00.481823 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7f93d9-abf8-4315-bf1e-adabdfeab9c7 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:03:00.482054 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7f93d9-abf8-4315-bf1e-adabdfeab9c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:03:00.482323 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7f93d9-abf8-4315-bf1e-adabdfeab9c7 None admin] PATH_INFO: `/v3/roles` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:03:00.483068 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7f93d9-abf8-4315-bf1e-adabdfeab9c7 None admin] RBAC: Adding query filter params (name=service) {{(pid=80012) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:03:00.483370 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7f93d9-abf8-4315-bf1e-adabdfeab9c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:03:00.484744 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7f93d9-abf8-4315-bf1e-adabdfeab9c7 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:03:00.493920 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 593/1209] 10.222.0.36 () {56 vars in 1103 bytes} [Tue May 3 14:03:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:03:00.499858 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41e17c6-cde8-49e5-95b0-12f7dd6866c4 None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:03:00.627309 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41e17c6-cde8-49e5-95b0-12f7dd6866c4 None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:03:00.668705 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162964af-0f3d-4ce2-8b1e-61d83df9f73e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:03:00.669915 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162964af-0f3d-4ce2-8b1e-61d83df9f73e None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:03:00.670421 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162964af-0f3d-4ce2-8b1e-61d83df9f73e None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:03:00.670681 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162964af-0f3d-4ce2-8b1e-61d83df9f73e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:03:00.683343 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162964af-0f3d-4ce2-8b1e-61d83df9f73e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:03:00.684832 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162964af-0f3d-4ce2-8b1e-61d83df9f73e None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:03:00.705601 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application [None req-162964af-0f3d-4ce2-8b1e-61d83df9f73e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 14:03:00.705601 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:03:00.705601 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 14:03:00.705601 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 14:03:00.705601 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 14:03:00.705601 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 14:03:00.705601 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 14:03:00.705601 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 14:03:00.705601 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 14:03:00.705601 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 14:03:00.705601 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 14:03:00.705601 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 14:03:00.705601 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 14:03:00.705601 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 14:03:00.705601 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 14:03:00.706786 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 14:03:00.706786 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 14:03:00.706786 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 14:03:00.706786 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 14:03:00.706786 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 14:03:00.706786 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 14:03:00.706786 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.get_or_create( May 03 14:03:00.706786 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 14:03:00.706786 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application with Lock( May 03 14:03:00.706786 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 14:03:00.706786 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._enter() May 03 14:03:00.706786 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 14:03:00.706786 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 14:03:00.706786 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 14:03:00.706786 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.creator() May 03 14:03:00.706786 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 14:03:00.706786 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application created_value = creator( May 03 14:03:00.707898 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 14:03:00.707898 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 14:03:00.707898 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 14:03:00.707898 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application May 03 14:03:00.707898 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 617/1210] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 3 14:03:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 14:03:00.713524 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7f93d9-abf8-4315-bf1e-adabdfeab9c7 None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:03:00.826561 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7f93d9-abf8-4315-bf1e-adabdfeab9c7 None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:03:00.869338 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453f2f41-3624-4a42-b29c-1e0c162f4ac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:03:00.869338 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453f2f41-3624-4a42-b29c-1e0c162f4ac1 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:03:00.869338 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453f2f41-3624-4a42-b29c-1e0c162f4ac1 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:03:00.869338 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453f2f41-3624-4a42-b29c-1e0c162f4ac1 None admin] PATH_INFO: `/v3/domains` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:03:00.869822 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453f2f41-3624-4a42-b29c-1e0c162f4ac1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80012) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:03:00.869822 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453f2f41-3624-4a42-b29c-1e0c162f4ac1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:03:00.870506 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453f2f41-3624-4a42-b29c-1e0c162f4ac1 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:03:00.885413 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 594/1211] 10.222.0.36 () {56 vars in 1109 bytes} [Tue May 3 14:03:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:03:00.888322 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162964af-0f3d-4ce2-8b1e-61d83df9f73e None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:03:00.994727 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162964af-0f3d-4ce2-8b1e-61d83df9f73e None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:03:01.032168 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae04c09-3309-4a5b-810d-2a6eab5b0805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:03:01.032963 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae04c09-3309-4a5b-810d-2a6eab5b0805 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:03:01.033272 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae04c09-3309-4a5b-810d-2a6eab5b0805 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:03:01.033544 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae04c09-3309-4a5b-810d-2a6eab5b0805 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:03:01.041420 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae04c09-3309-4a5b-810d-2a6eab5b0805 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:03:01.042881 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae04c09-3309-4a5b-810d-2a6eab5b0805 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:03:01.061631 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application [None req-3ae04c09-3309-4a5b-810d-2a6eab5b0805 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 03 14:03:01.061631 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:03:01.061631 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 14:03:01.061631 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 14:03:01.061631 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 14:03:01.061631 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 14:03:01.061631 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 14:03:01.061631 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 14:03:01.061631 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 14:03:01.061631 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 14:03:01.061631 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 14:03:01.061631 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 14:03:01.061631 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 14:03:01.061631 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 14:03:01.061631 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 14:03:01.061631 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 14:03:01.062750 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 14:03:01.062750 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 14:03:01.062750 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 14:03:01.062750 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 14:03:01.062750 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 14:03:01.062750 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 14:03:01.062750 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 14:03:01.062750 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 14:03:01.062750 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 14:03:01.062750 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.get_or_create( May 03 14:03:01.062750 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 14:03:01.062750 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application with Lock( May 03 14:03:01.062750 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 14:03:01.062750 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._enter() May 03 14:03:01.062750 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 14:03:01.062750 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 14:03:01.062750 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 14:03:01.062750 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.creator() May 03 14:03:01.071298 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 14:03:01.071298 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application created_value = creator( May 03 14:03:01.071298 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 14:03:01.071298 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 14:03:01.071298 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 14:03:01.071298 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 14:03:01.071298 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 14:03:01.071298 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 14:03:01.071298 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 03 14:03:01.071298 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application May 03 14:03:01.071298 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 618/1212] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 3 14:03:00 2022] GET /identity/v3/users/placement => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 14:03:01.072480 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453f2f41-3624-4a42-b29c-1e0c162f4ac1 None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:03:01.183741 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453f2f41-3624-4a42-b29c-1e0c162f4ac1 None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:03:01.221031 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03808d0a-ffa5-479c-af6d-ed58a5c1a9be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:03:01.221770 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03808d0a-ffa5-479c-af6d-ed58a5c1a9be None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:03:01.222215 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03808d0a-ffa5-479c-af6d-ed58a5c1a9be None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:03:01.222624 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03808d0a-ffa5-479c-af6d-ed58a5c1a9be None admin] PATH_INFO: `/v3/users` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:03:01.223615 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03808d0a-ffa5-479c-af6d-ed58a5c1a9be None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80012) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:03:01.223976 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03808d0a-ffa5-479c-af6d-ed58a5c1a9be None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:03:01.225739 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03808d0a-ffa5-479c-af6d-ed58a5c1a9be None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:03:01.244878 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 595/1213] 10.222.0.36 () {56 vars in 1143 bytes} [Tue May 3 14:03:01 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 14:03:01.250722 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae04c09-3309-4a5b-810d-2a6eab5b0805 None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:03:01.358474 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae04c09-3309-4a5b-810d-2a6eab5b0805 None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:03:01.395541 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68994d5c-dfeb-45cb-a855-89bcb5da450f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:03:01.396564 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68994d5c-dfeb-45cb-a855-89bcb5da450f None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:03:01.396564 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68994d5c-dfeb-45cb-a855-89bcb5da450f None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:03:01.396827 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68994d5c-dfeb-45cb-a855-89bcb5da450f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:03:01.472262 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68994d5c-dfeb-45cb-a855-89bcb5da450f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:03:01.473976 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68994d5c-dfeb-45cb-a855-89bcb5da450f None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:03:01.580496 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 619/1214] 10.222.0.36 () {58 vars in 1282 bytes} [Tue May 3 14:03:01 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 03 14:03:01.586775 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03808d0a-ffa5-479c-af6d-ed58a5c1a9be None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:03:01.696057 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03808d0a-ffa5-479c-af6d-ed58a5c1a9be None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:03:01.733044 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f990974-3918-4efc-95a4-dec88d651436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:03:01.733916 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f990974-3918-4efc-95a4-dec88d651436 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:03:01.734193 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f990974-3918-4efc-95a4-dec88d651436 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:03:01.734460 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f990974-3918-4efc-95a4-dec88d651436 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:03:01.749050 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f990974-3918-4efc-95a4-dec88d651436 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:03:01.750634 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f990974-3918-4efc-95a4-dec88d651436 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:03:01.770849 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application [None req-3f990974-3918-4efc-95a4-dec88d651436 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 14:03:01.770849 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:03:01.770849 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 14:03:01.770849 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 14:03:01.770849 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 14:03:01.770849 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 14:03:01.770849 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 14:03:01.770849 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 14:03:01.770849 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 14:03:01.770849 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 14:03:01.770849 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 14:03:01.770849 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 14:03:01.770849 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 14:03:01.770849 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 14:03:01.770849 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 14:03:01.771839 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 14:03:01.771839 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 14:03:01.771839 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 14:03:01.771839 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 14:03:01.771839 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 14:03:01.771839 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 14:03:01.771839 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.get_or_create( May 03 14:03:01.771839 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 14:03:01.771839 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application with Lock( May 03 14:03:01.771839 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 14:03:01.771839 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._enter() May 03 14:03:01.771839 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 14:03:01.771839 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 14:03:01.771839 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 14:03:01.771839 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.creator() May 03 14:03:01.771839 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 14:03:01.771839 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application created_value = creator( May 03 14:03:01.772806 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 14:03:01.772806 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 14:03:01.772806 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 14:03:01.772806 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application May 03 14:03:01.772806 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 596/1215] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 3 14:03:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 14:03:01.780129 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68994d5c-dfeb-45cb-a855-89bcb5da450f None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:03:01.887948 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68994d5c-dfeb-45cb-a855-89bcb5da450f None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:03:01.931250 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f10e59-2c28-46b6-a58d-0fde7c283993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:03:01.931995 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f10e59-2c28-46b6-a58d-0fde7c283993 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:03:01.932278 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f10e59-2c28-46b6-a58d-0fde7c283993 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:03:01.932554 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f10e59-2c28-46b6-a58d-0fde7c283993 None admin] PATH_INFO: `/v3/domains` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:03:01.933368 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f10e59-2c28-46b6-a58d-0fde7c283993 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:03:01.933675 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f10e59-2c28-46b6-a58d-0fde7c283993 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:03:01.935140 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f10e59-2c28-46b6-a58d-0fde7c283993 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:03:01.949011 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 620/1216] 10.222.0.36 () {56 vars in 1109 bytes} [Tue May 3 14:03:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:03:01.954973 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f990974-3918-4efc-95a4-dec88d651436 None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:03:02.067491 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f990974-3918-4efc-95a4-dec88d651436 None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:03:02.104311 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdb9426-2b28-4b6d-9190-dd1c2bd77cfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:03:02.106006 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdb9426-2b28-4b6d-9190-dd1c2bd77cfe None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:03:02.106551 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdb9426-2b28-4b6d-9190-dd1c2bd77cfe None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:03:02.107127 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdb9426-2b28-4b6d-9190-dd1c2bd77cfe None admin] PATH_INFO: `/v3/projects/service` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:03:02.114747 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdb9426-2b28-4b6d-9190-dd1c2bd77cfe None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:03:02.116672 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdb9426-2b28-4b6d-9190-dd1c2bd77cfe None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:03:02.131504 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application [None req-2bdb9426-2b28-4b6d-9190-dd1c2bd77cfe None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 14:03:02.131504 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:03:02.131504 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 14:03:02.131504 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 14:03:02.131504 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 14:03:02.131504 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 14:03:02.131504 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 14:03:02.131504 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 14:03:02.131504 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 14:03:02.131504 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 14:03:02.131504 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 14:03:02.131504 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 14:03:02.131504 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 14:03:02.131504 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 14:03:02.131504 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 14:03:02.132506 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 14:03:02.132506 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 14:03:02.132506 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 14:03:02.132506 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 14:03:02.132506 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 14:03:02.132506 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 14:03:02.132506 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.get_or_create( May 03 14:03:02.132506 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 14:03:02.132506 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application with Lock( May 03 14:03:02.132506 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 14:03:02.132506 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._enter() May 03 14:03:02.132506 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 14:03:02.132506 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 14:03:02.132506 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 14:03:02.132506 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.creator() May 03 14:03:02.132506 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 14:03:02.132506 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application created_value = creator( May 03 14:03:02.133897 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 14:03:02.133897 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 14:03:02.133897 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 14:03:02.133897 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 14:03:02.133897 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 14:03:02.133897 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 14:03:02.133897 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 14:03:02.133897 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application May 03 14:03:02.140568 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 597/1217] 10.222.0.36 () {56 vars in 1111 bytes} [Tue May 3 14:03:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 14:03:02.142124 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f10e59-2c28-46b6-a58d-0fde7c283993 None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:03:02.251215 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f10e59-2c28-46b6-a58d-0fde7c283993 None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:03:02.290964 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1439d2b-3cab-4b2e-b1aa-9c96750535c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:03:02.291683 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1439d2b-3cab-4b2e-b1aa-9c96750535c2 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:03:02.291997 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1439d2b-3cab-4b2e-b1aa-9c96750535c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:03:02.292386 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1439d2b-3cab-4b2e-b1aa-9c96750535c2 None admin] PATH_INFO: `/v3/projects` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:03:02.293270 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1439d2b-3cab-4b2e-b1aa-9c96750535c2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:03:02.293643 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1439d2b-3cab-4b2e-b1aa-9c96750535c2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:03:02.295388 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1439d2b-3cab-4b2e-b1aa-9c96750535c2 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:03:02.309355 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 621/1218] 10.222.0.36 () {56 vars in 1148 bytes} [Tue May 3 14:03:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:03:02.315749 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdb9426-2b28-4b6d-9190-dd1c2bd77cfe None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:03:02.423364 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdb9426-2b28-4b6d-9190-dd1c2bd77cfe None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:03:02.458535 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529c9a0d-34ad-4f8f-b7d1-d9a4d2801a92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:03:02.459183 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529c9a0d-34ad-4f8f-b7d1-d9a4d2801a92 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:03:02.459460 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529c9a0d-34ad-4f8f-b7d1-d9a4d2801a92 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:03:02.459733 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529c9a0d-34ad-4f8f-b7d1-d9a4d2801a92 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:03:02.460551 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529c9a0d-34ad-4f8f-b7d1-d9a4d2801a92 None admin] RBAC: Adding query filter params (role.id=b3902525744e454694820e2ea3b2e563, scope.project.id=de541be478754087934323bdbe41a579, user.id=164c7f36acf644e9bf93f158e876e9e3) {{(pid=80012) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:03:02.460858 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529c9a0d-34ad-4f8f-b7d1-d9a4d2801a92 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:03:02.462479 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529c9a0d-34ad-4f8f-b7d1-d9a4d2801a92 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:03:02.468574 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 598/1219] 10.222.0.36 () {56 vars in 1374 bytes} [Tue May 3 14:03:02 2022] GET /identity/v3/role_assignments?user.id=164c7f36acf644e9bf93f158e876e9e3&scope.project.id=de541be478754087934323bdbe41a579&role.id=b3902525744e454694820e2ea3b2e563 => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:03:04.794546 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8435b41a-1713-4907-892c-a1225ea098f1 None None] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:03:04.795136 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8435b41a-1713-4907-892c-a1225ea098f1 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:03:04.795136 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8435b41a-1713-4907-892c-a1225ea098f1 None None] PATH_INFO: `/` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:03:04.796462 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 622/1220] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 3 14:03:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 14:03:04.802520 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9f8d38-e52e-4afd-a63b-9989a60960cf None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:03:04.803013 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9f8d38-e52e-4afd-a63b-9989a60960cf None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:03:04.803108 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9f8d38-e52e-4afd-a63b-9989a60960cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:03:04.826544 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-8a9f8d38-e52e-4afd-a63b-9989a60960cf None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:03:04.828694 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-8a9f8d38-e52e-4afd-a63b-9989a60960cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:03:04.910305 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 599/1221] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 3 14:03:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 14:03:04.933371 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8435b41a-1713-4907-892c-a1225ea098f1 None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:03:05.039681 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8435b41a-1713-4907-892c-a1225ea098f1 None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:03:05.074626 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b8d368-f3a5-46b0-abe8-f5debedb9ac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:03:05.075611 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b8d368-f3a5-46b0-abe8-f5debedb9ac3 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:03:05.075989 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b8d368-f3a5-46b0-abe8-f5debedb9ac3 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:03:05.076345 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b8d368-f3a5-46b0-abe8-f5debedb9ac3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:03:05.088840 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b8d368-f3a5-46b0-abe8-f5debedb9ac3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 14:03:05.098542 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application [None req-e9b8d368-f3a5-46b0-abe8-f5debedb9ac3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 03 14:03:05.098542 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:03:05.098542 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 14:03:05.098542 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 14:03:05.098542 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 14:03:05.098542 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 14:03:05.098542 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 14:03:05.098542 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 14:03:05.098542 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 14:03:05.098542 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 14:03:05.098542 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 14:03:05.098542 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 14:03:05.098542 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 14:03:05.098542 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 14:03:05.098542 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 14:03:05.098542 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 14:03:05.099822 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 14:03:05.099822 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 14:03:05.099822 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 14:03:05.099822 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 14:03:05.099822 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 14:03:05.099822 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 14:03:05.099822 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 14:03:05.099822 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 14:03:05.099822 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 14:03:05.099822 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.get_or_create( May 03 14:03:05.099822 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 14:03:05.099822 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application with Lock( May 03 14:03:05.099822 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 14:03:05.099822 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._enter() May 03 14:03:05.099822 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 14:03:05.099822 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 14:03:05.100779 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 14:03:05.100779 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.creator() May 03 14:03:05.100779 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 14:03:05.100779 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application created_value = creator( May 03 14:03:05.100779 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 14:03:05.100779 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 14:03:05.100779 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 14:03:05.100779 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 14:03:05.100779 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 14:03:05.100779 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 14:03:05.100779 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 03 14:03:05.100779 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application May 03 14:03:05.100779 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 623/1222] 10.222.0.36 () {56 vars in 1102 bytes} [Tue May 3 14:03:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 14:03:05.107655 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9f8d38-e52e-4afd-a63b-9989a60960cf None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:03:05.208172 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9f8d38-e52e-4afd-a63b-9989a60960cf None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:03:05.245327 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f963811-e13c-489f-b68a-38dc7ae06366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:03:05.245998 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f963811-e13c-489f-b68a-38dc7ae06366 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:03:05.246311 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f963811-e13c-489f-b68a-38dc7ae06366 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:03:05.246555 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f963811-e13c-489f-b68a-38dc7ae06366 None admin] PATH_INFO: `/v3/roles` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:03:05.247296 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f963811-e13c-489f-b68a-38dc7ae06366 None admin] RBAC: Adding query filter params (name=service) {{(pid=80012) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:03:05.247668 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f963811-e13c-489f-b68a-38dc7ae06366 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:03:05.249032 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f963811-e13c-489f-b68a-38dc7ae06366 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:03:05.256859 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 600/1223] 10.222.0.36 () {56 vars in 1103 bytes} [Tue May 3 14:03:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 14:03:05.263567 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b8d368-f3a5-46b0-abe8-f5debedb9ac3 None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:03:05.375092 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b8d368-f3a5-46b0-abe8-f5debedb9ac3 None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:03:05.416289 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e71fc7-4be6-4061-bada-d68bf1157a4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:03:05.417095 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e71fc7-4be6-4061-bada-d68bf1157a4b None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:03:05.417416 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e71fc7-4be6-4061-bada-d68bf1157a4b None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:03:05.417689 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e71fc7-4be6-4061-bada-d68bf1157a4b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:03:05.429353 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e71fc7-4be6-4061-bada-d68bf1157a4b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:03:05.431176 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e71fc7-4be6-4061-bada-d68bf1157a4b None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:03:05.451621 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application [None req-b7e71fc7-4be6-4061-bada-d68bf1157a4b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 14:03:05.451621 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:03:05.451621 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 14:03:05.451621 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 14:03:05.451621 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 14:03:05.451621 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 14:03:05.451621 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 14:03:05.451621 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 14:03:05.451621 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 14:03:05.451621 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 14:03:05.451621 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 14:03:05.451621 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 14:03:05.451621 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 14:03:05.451621 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 14:03:05.451621 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 14:03:05.452777 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 14:03:05.452777 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 14:03:05.452777 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 14:03:05.452777 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 14:03:05.452777 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 14:03:05.452777 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 14:03:05.452777 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.get_or_create( May 03 14:03:05.452777 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 14:03:05.452777 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application with Lock( May 03 14:03:05.452777 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 14:03:05.452777 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._enter() May 03 14:03:05.452777 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 14:03:05.452777 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 14:03:05.452777 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 14:03:05.452777 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.creator() May 03 14:03:05.452777 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 14:03:05.452777 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application created_value = creator( May 03 14:03:05.454119 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 14:03:05.454119 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 14:03:05.454119 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 14:03:05.454119 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application May 03 14:03:05.454119 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 624/1224] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 3 14:03:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 14:03:05.459739 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f963811-e13c-489f-b68a-38dc7ae06366 None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:03:05.573848 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f963811-e13c-489f-b68a-38dc7ae06366 None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:03:05.607824 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0a066d-d625-4c2a-8def-872deda58019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:03:05.608493 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0a066d-d625-4c2a-8def-872deda58019 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:03:05.608777 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0a066d-d625-4c2a-8def-872deda58019 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:03:05.609053 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0a066d-d625-4c2a-8def-872deda58019 None admin] PATH_INFO: `/v3/domains` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:03:05.609805 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0a066d-d625-4c2a-8def-872deda58019 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80012) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:03:05.610112 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0a066d-d625-4c2a-8def-872deda58019 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:03:05.611524 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0a066d-d625-4c2a-8def-872deda58019 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:03:05.624590 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 601/1225] 10.222.0.36 () {56 vars in 1109 bytes} [Tue May 3 14:03:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:03:05.630492 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e71fc7-4be6-4061-bada-d68bf1157a4b None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:03:05.741799 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e71fc7-4be6-4061-bada-d68bf1157a4b None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:03:05.776287 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89369294-707b-488d-93b1-e31877610d03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:03:05.777605 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89369294-707b-488d-93b1-e31877610d03 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:03:05.778014 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89369294-707b-488d-93b1-e31877610d03 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:03:05.778320 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89369294-707b-488d-93b1-e31877610d03 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:03:05.790537 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89369294-707b-488d-93b1-e31877610d03 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:03:05.792806 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89369294-707b-488d-93b1-e31877610d03 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:03:05.808921 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application [None req-89369294-707b-488d-93b1-e31877610d03 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 03 14:03:05.808921 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:03:05.808921 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 14:03:05.808921 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 14:03:05.808921 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 14:03:05.808921 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 14:03:05.808921 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 14:03:05.808921 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 14:03:05.808921 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 14:03:05.808921 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 14:03:05.808921 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 14:03:05.808921 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 14:03:05.808921 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 14:03:05.808921 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 14:03:05.808921 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 14:03:05.808921 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 14:03:05.810592 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 14:03:05.810592 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 14:03:05.810592 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 14:03:05.810592 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 14:03:05.810592 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 14:03:05.810592 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 14:03:05.810592 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 14:03:05.810592 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 14:03:05.810592 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 14:03:05.810592 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.get_or_create( May 03 14:03:05.810592 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 14:03:05.810592 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application with Lock( May 03 14:03:05.810592 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 14:03:05.810592 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._enter() May 03 14:03:05.810592 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 14:03:05.810592 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 14:03:05.810592 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 14:03:05.810592 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.creator() May 03 14:03:05.811804 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 14:03:05.811804 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application created_value = creator( May 03 14:03:05.811804 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 14:03:05.811804 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 14:03:05.811804 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 14:03:05.811804 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 14:03:05.811804 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 14:03:05.811804 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 14:03:05.811804 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 03 14:03:05.811804 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application May 03 14:03:05.811804 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 625/1226] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 3 14:03:05 2022] GET /identity/v3/users/placement => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 14:03:05.816030 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0a066d-d625-4c2a-8def-872deda58019 None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:03:05.918347 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0a066d-d625-4c2a-8def-872deda58019 None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:03:05.955750 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a89c2c-bc97-4ba3-ac25-5e4591a00f72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:03:05.956809 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a89c2c-bc97-4ba3-ac25-5e4591a00f72 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:03:05.957237 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a89c2c-bc97-4ba3-ac25-5e4591a00f72 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:03:05.957600 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a89c2c-bc97-4ba3-ac25-5e4591a00f72 None admin] PATH_INFO: `/v3/users` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:03:05.958527 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a89c2c-bc97-4ba3-ac25-5e4591a00f72 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80012) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:03:05.959052 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a89c2c-bc97-4ba3-ac25-5e4591a00f72 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:03:05.960710 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a89c2c-bc97-4ba3-ac25-5e4591a00f72 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:03:05.980179 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 602/1227] 10.222.0.36 () {56 vars in 1143 bytes} [Tue May 3 14:03:05 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:03:05.986099 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89369294-707b-488d-93b1-e31877610d03 None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:03:06.087253 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89369294-707b-488d-93b1-e31877610d03 None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:03:06.121458 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126b89e2-28bf-4ff9-b25e-5d53e2153a6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:03:06.122252 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126b89e2-28bf-4ff9-b25e-5d53e2153a6b None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:03:06.122598 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126b89e2-28bf-4ff9-b25e-5d53e2153a6b None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:03:06.122897 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126b89e2-28bf-4ff9-b25e-5d53e2153a6b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:03:06.134097 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126b89e2-28bf-4ff9-b25e-5d53e2153a6b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:03:06.135584 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126b89e2-28bf-4ff9-b25e-5d53e2153a6b None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:03:06.152658 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application [None req-126b89e2-28bf-4ff9-b25e-5d53e2153a6b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 14:03:06.152658 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:03:06.152658 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 14:03:06.152658 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 14:03:06.152658 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 14:03:06.152658 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 14:03:06.152658 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 14:03:06.152658 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 14:03:06.152658 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 14:03:06.152658 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 14:03:06.152658 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 14:03:06.152658 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 14:03:06.152658 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 14:03:06.152658 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 14:03:06.152658 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 14:03:06.153751 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 14:03:06.153751 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 14:03:06.153751 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 14:03:06.153751 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 14:03:06.153751 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 14:03:06.153751 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 14:03:06.153751 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.get_or_create( May 03 14:03:06.153751 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 14:03:06.153751 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application with Lock( May 03 14:03:06.153751 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 14:03:06.153751 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._enter() May 03 14:03:06.153751 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 14:03:06.153751 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 14:03:06.153751 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 14:03:06.153751 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.creator() May 03 14:03:06.153751 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 14:03:06.153751 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application created_value = creator( May 03 14:03:06.154861 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 14:03:06.154861 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 14:03:06.154861 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 14:03:06.154861 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application May 03 14:03:06.154861 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 626/1228] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 3 14:03:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 14:03:06.159855 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a89c2c-bc97-4ba3-ac25-5e4591a00f72 None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:03:06.266780 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a89c2c-bc97-4ba3-ac25-5e4591a00f72 None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:03:06.304380 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998e9f6d-d4df-41b0-ae8e-847060691c70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:03:06.305555 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998e9f6d-d4df-41b0-ae8e-847060691c70 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:03:06.305930 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998e9f6d-d4df-41b0-ae8e-847060691c70 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:03:06.306206 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998e9f6d-d4df-41b0-ae8e-847060691c70 None admin] PATH_INFO: `/v3/domains` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:03:06.307204 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998e9f6d-d4df-41b0-ae8e-847060691c70 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80012) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:03:06.307492 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998e9f6d-d4df-41b0-ae8e-847060691c70 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:03:06.308909 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998e9f6d-d4df-41b0-ae8e-847060691c70 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:03:06.320312 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 603/1229] 10.222.0.36 () {56 vars in 1109 bytes} [Tue May 3 14:03:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:03:06.326031 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126b89e2-28bf-4ff9-b25e-5d53e2153a6b None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:03:06.425035 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126b89e2-28bf-4ff9-b25e-5d53e2153a6b None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:03:06.458830 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855afe81-1ebf-41f6-bb52-767163aba940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:03:06.459628 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855afe81-1ebf-41f6-bb52-767163aba940 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:03:06.459901 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855afe81-1ebf-41f6-bb52-767163aba940 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:03:06.460168 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855afe81-1ebf-41f6-bb52-767163aba940 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:03:06.467316 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855afe81-1ebf-41f6-bb52-767163aba940 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:03:06.468744 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855afe81-1ebf-41f6-bb52-767163aba940 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:03:06.483337 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application [None req-855afe81-1ebf-41f6-bb52-767163aba940 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 14:03:06.483337 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:03:06.483337 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 14:03:06.483337 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 14:03:06.483337 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 14:03:06.483337 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 14:03:06.483337 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 14:03:06.483337 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 14:03:06.483337 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 14:03:06.483337 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 14:03:06.483337 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 14:03:06.483337 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 14:03:06.483337 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 14:03:06.483337 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 14:03:06.483337 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 14:03:06.484363 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 14:03:06.484363 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 14:03:06.484363 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 14:03:06.484363 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 14:03:06.484363 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 14:03:06.484363 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 14:03:06.484363 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.get_or_create( May 03 14:03:06.484363 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 14:03:06.484363 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application with Lock( May 03 14:03:06.484363 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 14:03:06.484363 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._enter() May 03 14:03:06.484363 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 14:03:06.484363 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 14:03:06.484363 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 14:03:06.484363 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.creator() May 03 14:03:06.484363 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 14:03:06.484363 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application created_value = creator( May 03 14:03:06.485357 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 14:03:06.485357 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 14:03:06.485357 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 14:03:06.485357 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 14:03:06.485357 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 14:03:06.485357 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 14:03:06.485357 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 14:03:06.485357 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application May 03 14:03:06.485357 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 627/1230] 10.222.0.36 () {56 vars in 1111 bytes} [Tue May 3 14:03:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 14:03:06.490753 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998e9f6d-d4df-41b0-ae8e-847060691c70 None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:03:06.593758 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998e9f6d-d4df-41b0-ae8e-847060691c70 None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:03:06.626443 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b8a5e2-dc1a-4860-a76c-de576299ffc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:03:06.627128 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b8a5e2-dc1a-4860-a76c-de576299ffc0 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:03:06.627424 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b8a5e2-dc1a-4860-a76c-de576299ffc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:03:06.627684 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b8a5e2-dc1a-4860-a76c-de576299ffc0 None admin] PATH_INFO: `/v3/projects` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:03:06.628470 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b8a5e2-dc1a-4860-a76c-de576299ffc0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80012) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:03:06.628776 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b8a5e2-dc1a-4860-a76c-de576299ffc0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:03:06.630225 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b8a5e2-dc1a-4860-a76c-de576299ffc0 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:03:06.642310 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 604/1231] 10.222.0.36 () {56 vars in 1148 bytes} [Tue May 3 14:03:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:03:06.648808 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855afe81-1ebf-41f6-bb52-767163aba940 None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:03:06.754586 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855afe81-1ebf-41f6-bb52-767163aba940 None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:03:06.789129 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4365ccaa-6f04-4035-9fc2-3728c6c6c578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:03:06.790028 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4365ccaa-6f04-4035-9fc2-3728c6c6c578 None admin] REQUEST_METHOD: `PUT` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:03:06.790308 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4365ccaa-6f04-4035-9fc2-3728c6c6c578 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:03:06.790678 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4365ccaa-6f04-4035-9fc2-3728c6c6c578 None admin] PATH_INFO: `/v3/projects/de541be478754087934323bdbe41a579/users/164c7f36acf644e9bf93f158e876e9e3/roles/b3902525744e454694820e2ea3b2e563` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:03:06.806977 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4365ccaa-6f04-4035-9fc2-3728c6c6c578 None admin] RBAC: Authorizing `identity:create_grant(project_id=de541be478754087934323bdbe41a579, user_id=164c7f36acf644e9bf93f158e876e9e3, role_id=b3902525744e454694820e2ea3b2e563)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:03:06.808398 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4365ccaa-6f04-4035-9fc2-3728c6c6c578 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:03:06.821574 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 628/1232] 10.222.0.36 () {58 vars in 1439 bytes} [Tue May 3 14:03:06 2022] PUT /identity/v3/projects/de541be478754087934323bdbe41a579/users/164c7f36acf644e9bf93f158e876e9e3/roles/b3902525744e454694820e2ea3b2e563 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:03:09.028228 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d258aa6-8926-4222-9067-fee572619574 None None] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:03:09.028827 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d258aa6-8926-4222-9067-fee572619574 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:03:09.028827 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d258aa6-8926-4222-9067-fee572619574 None None] PATH_INFO: `/` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:03:09.030193 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 605/1233] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 3 14:03:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 14:03:09.035454 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35f5314-062d-486a-a84d-8ae18dfd5aeb None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:03:09.035900 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35f5314-062d-486a-a84d-8ae18dfd5aeb None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:03:09.036077 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35f5314-062d-486a-a84d-8ae18dfd5aeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:03:09.053404 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-a35f5314-062d-486a-a84d-8ae18dfd5aeb None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:03:09.054724 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-a35f5314-062d-486a-a84d-8ae18dfd5aeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:03:09.128816 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 629/1234] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 3 14:03:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 14:03:09.156747 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d258aa6-8926-4222-9067-fee572619574 None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:03:09.276448 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d258aa6-8926-4222-9067-fee572619574 None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:03:09.315481 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ef5e73-778e-4b59-a358-16f836312fd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:03:09.316212 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ef5e73-778e-4b59-a358-16f836312fd8 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:03:09.316525 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ef5e73-778e-4b59-a358-16f836312fd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:03:09.316798 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ef5e73-778e-4b59-a358-16f836312fd8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:03:09.327513 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ef5e73-778e-4b59-a358-16f836312fd8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 14:03:09.335296 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application [None req-62ef5e73-778e-4b59-a358-16f836312fd8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 03 14:03:09.335296 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:03:09.335296 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 14:03:09.335296 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 14:03:09.335296 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 14:03:09.335296 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 14:03:09.335296 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 14:03:09.335296 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 14:03:09.335296 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 14:03:09.335296 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 14:03:09.335296 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 14:03:09.335296 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 14:03:09.335296 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 14:03:09.335296 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 14:03:09.335296 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 14:03:09.335296 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 14:03:09.336552 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 14:03:09.336552 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 14:03:09.336552 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 14:03:09.336552 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 14:03:09.336552 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 14:03:09.336552 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 14:03:09.336552 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 14:03:09.336552 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 14:03:09.336552 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 14:03:09.336552 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.get_or_create( May 03 14:03:09.336552 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 14:03:09.336552 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application with Lock( May 03 14:03:09.336552 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 14:03:09.336552 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._enter() May 03 14:03:09.336552 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 14:03:09.336552 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 14:03:09.338181 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 14:03:09.338181 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.creator() May 03 14:03:09.338181 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 14:03:09.338181 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application created_value = creator( May 03 14:03:09.338181 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 14:03:09.338181 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 14:03:09.338181 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 14:03:09.338181 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 14:03:09.338181 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 14:03:09.338181 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 14:03:09.338181 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 03 14:03:09.338181 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application May 03 14:03:09.338181 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 606/1235] 10.222.0.36 () {56 vars in 1102 bytes} [Tue May 3 14:03:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 14:03:09.343066 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35f5314-062d-486a-a84d-8ae18dfd5aeb None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:03:09.449313 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35f5314-062d-486a-a84d-8ae18dfd5aeb None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:03:09.483081 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29b268e-f69d-4dd2-a539-e3bbce2685d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:03:09.483702 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29b268e-f69d-4dd2-a539-e3bbce2685d4 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:03:09.483980 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29b268e-f69d-4dd2-a539-e3bbce2685d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:03:09.484258 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29b268e-f69d-4dd2-a539-e3bbce2685d4 None admin] PATH_INFO: `/v3/roles` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:03:09.484994 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29b268e-f69d-4dd2-a539-e3bbce2685d4 None admin] RBAC: Adding query filter params (name=service) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:03:09.485333 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29b268e-f69d-4dd2-a539-e3bbce2685d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:03:09.486716 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29b268e-f69d-4dd2-a539-e3bbce2685d4 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:03:09.494974 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 630/1236] 10.222.0.36 () {56 vars in 1103 bytes} [Tue May 3 14:03:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:03:09.501128 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ef5e73-778e-4b59-a358-16f836312fd8 None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:03:09.604689 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ef5e73-778e-4b59-a358-16f836312fd8 None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:03:09.638247 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b71ff7-aa22-4635-9806-6b2c230f0f94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:03:09.639039 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b71ff7-aa22-4635-9806-6b2c230f0f94 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:03:09.639314 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b71ff7-aa22-4635-9806-6b2c230f0f94 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:03:09.639624 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b71ff7-aa22-4635-9806-6b2c230f0f94 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:03:09.650244 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b71ff7-aa22-4635-9806-6b2c230f0f94 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:03:09.651864 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b71ff7-aa22-4635-9806-6b2c230f0f94 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:03:09.670662 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application [None req-b7b71ff7-aa22-4635-9806-6b2c230f0f94 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 14:03:09.670662 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:03:09.670662 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 14:03:09.670662 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 14:03:09.670662 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 14:03:09.670662 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 14:03:09.670662 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 14:03:09.670662 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 14:03:09.670662 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 14:03:09.670662 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 14:03:09.670662 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 14:03:09.670662 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 14:03:09.670662 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 14:03:09.670662 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 14:03:09.670662 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 14:03:09.671690 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 14:03:09.671690 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 14:03:09.671690 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 14:03:09.671690 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 14:03:09.671690 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 14:03:09.671690 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 14:03:09.671690 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.get_or_create( May 03 14:03:09.671690 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 14:03:09.671690 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application with Lock( May 03 14:03:09.671690 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 14:03:09.671690 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._enter() May 03 14:03:09.671690 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 14:03:09.671690 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 14:03:09.671690 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 14:03:09.671690 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.creator() May 03 14:03:09.671690 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 14:03:09.671690 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application created_value = creator( May 03 14:03:09.672615 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 14:03:09.672615 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 14:03:09.672615 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 14:03:09.672615 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application May 03 14:03:09.672615 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 607/1237] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 3 14:03:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 14:03:09.678009 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29b268e-f69d-4dd2-a539-e3bbce2685d4 None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:03:09.782810 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29b268e-f69d-4dd2-a539-e3bbce2685d4 None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:03:09.816552 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2301c4a9-6e44-4a60-bb28-29ef228eb279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:03:09.817211 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2301c4a9-6e44-4a60-bb28-29ef228eb279 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:03:09.817513 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2301c4a9-6e44-4a60-bb28-29ef228eb279 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:03:09.817814 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2301c4a9-6e44-4a60-bb28-29ef228eb279 None admin] PATH_INFO: `/v3/domains` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:03:09.818812 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2301c4a9-6e44-4a60-bb28-29ef228eb279 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:03:09.819115 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2301c4a9-6e44-4a60-bb28-29ef228eb279 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:03:09.821533 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2301c4a9-6e44-4a60-bb28-29ef228eb279 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:03:09.833970 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 631/1238] 10.222.0.36 () {56 vars in 1109 bytes} [Tue May 3 14:03:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:03:09.840781 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b71ff7-aa22-4635-9806-6b2c230f0f94 None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:03:09.938589 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b71ff7-aa22-4635-9806-6b2c230f0f94 None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:03:09.976713 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ce3b3d-d03e-4081-9874-e7ad48f33473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:03:09.977568 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ce3b3d-d03e-4081-9874-e7ad48f33473 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:03:09.977849 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ce3b3d-d03e-4081-9874-e7ad48f33473 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:03:09.978119 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ce3b3d-d03e-4081-9874-e7ad48f33473 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:03:09.986971 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ce3b3d-d03e-4081-9874-e7ad48f33473 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:03:09.988420 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ce3b3d-d03e-4081-9874-e7ad48f33473 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:03:10.003985 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application [None req-b2ce3b3d-d03e-4081-9874-e7ad48f33473 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 03 14:03:10.003985 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:03:10.003985 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 14:03:10.003985 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 14:03:10.003985 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 14:03:10.003985 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 14:03:10.003985 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 14:03:10.003985 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 14:03:10.003985 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 14:03:10.003985 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 14:03:10.003985 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 14:03:10.003985 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 14:03:10.003985 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 14:03:10.003985 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 14:03:10.003985 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 14:03:10.003985 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 14:03:10.005084 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 14:03:10.005084 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 14:03:10.005084 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 14:03:10.005084 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 14:03:10.005084 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 14:03:10.005084 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 14:03:10.005084 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 14:03:10.005084 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 14:03:10.005084 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 14:03:10.005084 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.get_or_create( May 03 14:03:10.005084 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 14:03:10.005084 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application with Lock( May 03 14:03:10.005084 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 14:03:10.005084 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._enter() May 03 14:03:10.005084 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 14:03:10.005084 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 14:03:10.005084 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 14:03:10.005084 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.creator() May 03 14:03:10.006192 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 14:03:10.006192 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application created_value = creator( May 03 14:03:10.006192 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 14:03:10.006192 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 14:03:10.006192 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 14:03:10.006192 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 14:03:10.006192 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 14:03:10.006192 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 14:03:10.006192 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 03 14:03:10.006192 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application May 03 14:03:10.006192 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 608/1239] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 3 14:03:09 2022] GET /identity/v3/users/placement => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 14:03:10.011572 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2301c4a9-6e44-4a60-bb28-29ef228eb279 None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:03:10.120611 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2301c4a9-6e44-4a60-bb28-29ef228eb279 None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:03:10.159034 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c61b5b4-9ac2-4b99-85df-ba44f6ea7a0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:03:10.159703 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c61b5b4-9ac2-4b99-85df-ba44f6ea7a0a None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:03:10.159984 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c61b5b4-9ac2-4b99-85df-ba44f6ea7a0a None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:03:10.160258 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c61b5b4-9ac2-4b99-85df-ba44f6ea7a0a None admin] PATH_INFO: `/v3/users` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:03:10.161096 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c61b5b4-9ac2-4b99-85df-ba44f6ea7a0a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:03:10.161435 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c61b5b4-9ac2-4b99-85df-ba44f6ea7a0a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:03:10.162887 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c61b5b4-9ac2-4b99-85df-ba44f6ea7a0a None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:03:10.180333 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 632/1240] 10.222.0.36 () {56 vars in 1143 bytes} [Tue May 3 14:03:10 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:03:10.186339 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ce3b3d-d03e-4081-9874-e7ad48f33473 None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:03:10.303644 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ce3b3d-d03e-4081-9874-e7ad48f33473 None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:03:10.341829 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e6bc57-d3fe-4156-ad6c-34baab162285 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:03:10.342521 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e6bc57-d3fe-4156-ad6c-34baab162285 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:03:10.342806 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e6bc57-d3fe-4156-ad6c-34baab162285 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:03:10.343116 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e6bc57-d3fe-4156-ad6c-34baab162285 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:03:10.413012 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e6bc57-d3fe-4156-ad6c-34baab162285 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:03:10.415249 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e6bc57-d3fe-4156-ad6c-34baab162285 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:03:10.525519 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 609/1241] 10.222.0.36 () {58 vars in 1282 bytes} [Tue May 3 14:03:10 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 03 14:03:10.526872 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c61b5b4-9ac2-4b99-85df-ba44f6ea7a0a None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:03:10.632629 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c61b5b4-9ac2-4b99-85df-ba44f6ea7a0a None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:03:10.674898 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d123bc-2485-488b-ba99-0ae5b8599347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:03:10.675942 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d123bc-2485-488b-ba99-0ae5b8599347 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:03:10.676333 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d123bc-2485-488b-ba99-0ae5b8599347 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:03:10.676716 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d123bc-2485-488b-ba99-0ae5b8599347 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:03:10.689217 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d123bc-2485-488b-ba99-0ae5b8599347 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:03:10.690930 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d123bc-2485-488b-ba99-0ae5b8599347 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:03:10.712358 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application [None req-f9d123bc-2485-488b-ba99-0ae5b8599347 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 14:03:10.712358 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:03:10.712358 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 14:03:10.712358 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 14:03:10.712358 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 14:03:10.712358 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 14:03:10.712358 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 14:03:10.712358 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 14:03:10.712358 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 14:03:10.712358 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 14:03:10.712358 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 14:03:10.712358 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 14:03:10.712358 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 14:03:10.712358 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 14:03:10.712358 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 14:03:10.714098 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 14:03:10.714098 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 14:03:10.714098 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 14:03:10.714098 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 14:03:10.714098 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 14:03:10.714098 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 14:03:10.714098 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.get_or_create( May 03 14:03:10.714098 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 14:03:10.714098 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application with Lock( May 03 14:03:10.714098 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 14:03:10.714098 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._enter() May 03 14:03:10.714098 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 14:03:10.714098 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 14:03:10.714098 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 14:03:10.714098 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.creator() May 03 14:03:10.714098 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 14:03:10.714098 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application created_value = creator( May 03 14:03:10.715130 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 14:03:10.715130 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 14:03:10.715130 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 14:03:10.715130 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application May 03 14:03:10.715130 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 633/1242] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 3 14:03:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 14:03:10.720179 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e6bc57-d3fe-4156-ad6c-34baab162285 None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:03:10.832066 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e6bc57-d3fe-4156-ad6c-34baab162285 None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:03:10.869729 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7d80ca-0aa9-4447-8886-a1b40527dc78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:03:10.870395 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7d80ca-0aa9-4447-8886-a1b40527dc78 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:03:10.870679 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7d80ca-0aa9-4447-8886-a1b40527dc78 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:03:10.870957 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7d80ca-0aa9-4447-8886-a1b40527dc78 None admin] PATH_INFO: `/v3/domains` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:03:10.871756 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7d80ca-0aa9-4447-8886-a1b40527dc78 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80012) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:03:10.872128 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7d80ca-0aa9-4447-8886-a1b40527dc78 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:03:10.873703 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7d80ca-0aa9-4447-8886-a1b40527dc78 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:03:10.888196 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 610/1243] 10.222.0.36 () {56 vars in 1109 bytes} [Tue May 3 14:03:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:03:10.895475 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d123bc-2485-488b-ba99-0ae5b8599347 None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:03:11.000322 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d123bc-2485-488b-ba99-0ae5b8599347 None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:03:11.034817 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9fc14e-d161-450d-ab89-b5ea773717f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:03:11.035659 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9fc14e-d161-450d-ab89-b5ea773717f4 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:03:11.035932 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9fc14e-d161-450d-ab89-b5ea773717f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:03:11.036201 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9fc14e-d161-450d-ab89-b5ea773717f4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:03:11.043926 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9fc14e-d161-450d-ab89-b5ea773717f4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:03:11.045422 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9fc14e-d161-450d-ab89-b5ea773717f4 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:03:11.060790 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application [None req-ed9fc14e-d161-450d-ab89-b5ea773717f4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 14:03:11.060790 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:03:11.060790 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 14:03:11.060790 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 14:03:11.060790 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 14:03:11.060790 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 14:03:11.060790 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 14:03:11.060790 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 14:03:11.060790 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 14:03:11.060790 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 14:03:11.060790 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 14:03:11.060790 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 14:03:11.060790 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 14:03:11.060790 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 14:03:11.060790 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 14:03:11.061828 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 14:03:11.061828 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 14:03:11.061828 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 14:03:11.061828 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 14:03:11.061828 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 14:03:11.061828 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 14:03:11.061828 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.get_or_create( May 03 14:03:11.061828 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 14:03:11.061828 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application with Lock( May 03 14:03:11.061828 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 14:03:11.061828 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._enter() May 03 14:03:11.061828 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 14:03:11.061828 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 14:03:11.061828 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 14:03:11.061828 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.creator() May 03 14:03:11.061828 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 14:03:11.061828 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application created_value = creator( May 03 14:03:11.067990 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 14:03:11.067990 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 14:03:11.067990 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 14:03:11.067990 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 14:03:11.067990 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 14:03:11.067990 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 14:03:11.067990 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 14:03:11.067990 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application May 03 14:03:11.067990 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 634/1244] 10.222.0.36 () {56 vars in 1111 bytes} [Tue May 3 14:03:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 14:03:11.069083 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7d80ca-0aa9-4447-8886-a1b40527dc78 None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:03:11.171755 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7d80ca-0aa9-4447-8886-a1b40527dc78 None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:03:11.207083 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b45e0b-cd32-4733-b68f-427b7e7752f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:03:11.207804 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b45e0b-cd32-4733-b68f-427b7e7752f5 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:03:11.208018 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b45e0b-cd32-4733-b68f-427b7e7752f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:03:11.208289 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b45e0b-cd32-4733-b68f-427b7e7752f5 None admin] PATH_INFO: `/v3/projects` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:03:11.209085 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b45e0b-cd32-4733-b68f-427b7e7752f5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80012) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:03:11.209426 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b45e0b-cd32-4733-b68f-427b7e7752f5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:03:11.210992 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b45e0b-cd32-4733-b68f-427b7e7752f5 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:03:11.229279 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 611/1245] 10.222.0.36 () {56 vars in 1148 bytes} [Tue May 3 14:03:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:03:11.230623 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9fc14e-d161-450d-ab89-b5ea773717f4 None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:03:11.333645 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9fc14e-d161-450d-ab89-b5ea773717f4 None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:03:11.370320 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9042e1b5-9215-4a93-af38-fd03e07d52d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:03:11.370975 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9042e1b5-9215-4a93-af38-fd03e07d52d2 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:03:11.371262 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9042e1b5-9215-4a93-af38-fd03e07d52d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:03:11.371528 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9042e1b5-9215-4a93-af38-fd03e07d52d2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:03:11.372355 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9042e1b5-9215-4a93-af38-fd03e07d52d2 None admin] RBAC: Adding query filter params (role.id=b3902525744e454694820e2ea3b2e563, scope.project.id=de541be478754087934323bdbe41a579, user.id=164c7f36acf644e9bf93f158e876e9e3) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:03:11.372660 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9042e1b5-9215-4a93-af38-fd03e07d52d2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:03:11.374118 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9042e1b5-9215-4a93-af38-fd03e07d52d2 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:03:11.380525 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 635/1246] 10.222.0.36 () {56 vars in 1374 bytes} [Tue May 3 14:03:11 2022] GET /identity/v3/role_assignments?user.id=164c7f36acf644e9bf93f158e876e9e3&scope.project.id=de541be478754087934323bdbe41a579&role.id=b3902525744e454694820e2ea3b2e563 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:03:13.705269 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90dee53-65b3-45ec-b68e-d2b947cab5d6 None None] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:03:13.705937 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90dee53-65b3-45ec-b68e-d2b947cab5d6 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:03:13.705937 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90dee53-65b3-45ec-b68e-d2b947cab5d6 None None] PATH_INFO: `/` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:03:13.707220 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 612/1247] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 3 14:03:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 14:03:13.714970 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c58b03-6e03-4400-b115-9e8f84a7aa43 None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:03:13.715584 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c58b03-6e03-4400-b115-9e8f84a7aa43 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:03:13.715918 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c58b03-6e03-4400-b115-9e8f84a7aa43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:03:13.739449 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-28c58b03-6e03-4400-b115-9e8f84a7aa43 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:03:13.740716 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-28c58b03-6e03-4400-b115-9e8f84a7aa43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:03:13.810983 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 636/1248] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 3 14:03:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 14:03:13.838765 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90dee53-65b3-45ec-b68e-d2b947cab5d6 None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:03:13.956873 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90dee53-65b3-45ec-b68e-d2b947cab5d6 None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:03:13.994061 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b58f1d-cccf-44b0-bbbc-11cae6b7e472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:03:13.995115 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b58f1d-cccf-44b0-bbbc-11cae6b7e472 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:03:13.995424 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b58f1d-cccf-44b0-bbbc-11cae6b7e472 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:03:13.995687 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b58f1d-cccf-44b0-bbbc-11cae6b7e472 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:03:14.008054 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b58f1d-cccf-44b0-bbbc-11cae6b7e472 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 14:03:14.016880 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application [None req-b8b58f1d-cccf-44b0-bbbc-11cae6b7e472 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 03 14:03:14.016880 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:03:14.016880 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 14:03:14.016880 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 14:03:14.016880 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 14:03:14.016880 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 14:03:14.016880 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 14:03:14.016880 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 14:03:14.016880 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 14:03:14.016880 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 14:03:14.016880 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 14:03:14.016880 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 14:03:14.016880 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 14:03:14.016880 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 14:03:14.016880 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 14:03:14.016880 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 14:03:14.018104 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 14:03:14.018104 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 14:03:14.018104 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 14:03:14.018104 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 14:03:14.018104 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 14:03:14.018104 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 14:03:14.018104 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 14:03:14.018104 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 14:03:14.018104 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 14:03:14.018104 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.get_or_create( May 03 14:03:14.018104 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 14:03:14.018104 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application with Lock( May 03 14:03:14.018104 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 14:03:14.018104 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._enter() May 03 14:03:14.018104 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 14:03:14.018104 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 14:03:14.022691 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 14:03:14.022691 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.creator() May 03 14:03:14.022691 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 14:03:14.022691 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application created_value = creator( May 03 14:03:14.022691 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 14:03:14.022691 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 14:03:14.022691 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 14:03:14.022691 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 14:03:14.022691 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 14:03:14.022691 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 14:03:14.022691 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 03 14:03:14.022691 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application May 03 14:03:14.022691 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 613/1249] 10.222.0.36 () {56 vars in 1096 bytes} [Tue May 3 14:03:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 14:03:14.025093 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c58b03-6e03-4400-b115-9e8f84a7aa43 None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:03:14.133263 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c58b03-6e03-4400-b115-9e8f84a7aa43 None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:03:14.170771 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f556771b-1ffc-40f7-9355-70bdf2b123f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:03:14.171585 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f556771b-1ffc-40f7-9355-70bdf2b123f7 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:03:14.171890 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f556771b-1ffc-40f7-9355-70bdf2b123f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:03:14.172128 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f556771b-1ffc-40f7-9355-70bdf2b123f7 None admin] PATH_INFO: `/v3/roles` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:03:14.173020 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f556771b-1ffc-40f7-9355-70bdf2b123f7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:03:14.173348 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f556771b-1ffc-40f7-9355-70bdf2b123f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:03:14.174713 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f556771b-1ffc-40f7-9355-70bdf2b123f7 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:03:14.187513 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 637/1250] 10.222.0.36 () {56 vars in 1099 bytes} [Tue May 3 14:03:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:03:14.189108 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b58f1d-cccf-44b0-bbbc-11cae6b7e472 None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:03:14.300690 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b58f1d-cccf-44b0-bbbc-11cae6b7e472 None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:03:14.334386 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a143fdd-5e13-4d63-8ce1-26adb81bf79d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:03:14.335216 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a143fdd-5e13-4d63-8ce1-26adb81bf79d None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:03:14.335503 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a143fdd-5e13-4d63-8ce1-26adb81bf79d None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:03:14.335899 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a143fdd-5e13-4d63-8ce1-26adb81bf79d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:03:14.346408 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a143fdd-5e13-4d63-8ce1-26adb81bf79d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:03:14.347848 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a143fdd-5e13-4d63-8ce1-26adb81bf79d None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:03:14.364383 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application [None req-6a143fdd-5e13-4d63-8ce1-26adb81bf79d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 14:03:14.364383 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:03:14.364383 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 14:03:14.364383 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 14:03:14.364383 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 14:03:14.364383 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 14:03:14.364383 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 14:03:14.364383 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 14:03:14.364383 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 14:03:14.364383 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 14:03:14.364383 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 14:03:14.364383 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 14:03:14.364383 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 14:03:14.364383 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 14:03:14.364383 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 14:03:14.365533 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 14:03:14.365533 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 14:03:14.365533 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 14:03:14.365533 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 14:03:14.365533 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 14:03:14.365533 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 14:03:14.365533 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.get_or_create( May 03 14:03:14.365533 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 14:03:14.365533 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application with Lock( May 03 14:03:14.365533 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 14:03:14.365533 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._enter() May 03 14:03:14.365533 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 14:03:14.365533 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 14:03:14.365533 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 14:03:14.365533 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.creator() May 03 14:03:14.365533 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 14:03:14.365533 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application created_value = creator( May 03 14:03:14.366736 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 14:03:14.366736 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 14:03:14.366736 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 14:03:14.366736 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application May 03 14:03:14.366736 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 614/1251] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 3 14:03:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 14:03:14.371711 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f556771b-1ffc-40f7-9355-70bdf2b123f7 None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:03:14.482502 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f556771b-1ffc-40f7-9355-70bdf2b123f7 None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:03:14.521991 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea47400-7b05-4cf9-be79-e00c012ecb07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:03:14.522659 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea47400-7b05-4cf9-be79-e00c012ecb07 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:03:14.523040 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea47400-7b05-4cf9-be79-e00c012ecb07 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:03:14.523508 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea47400-7b05-4cf9-be79-e00c012ecb07 None admin] PATH_INFO: `/v3/domains` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:03:14.524248 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea47400-7b05-4cf9-be79-e00c012ecb07 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:03:14.524566 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea47400-7b05-4cf9-be79-e00c012ecb07 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:03:14.526285 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea47400-7b05-4cf9-be79-e00c012ecb07 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:03:14.540744 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 638/1252] 10.222.0.36 () {56 vars in 1109 bytes} [Tue May 3 14:03:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:03:14.546388 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a143fdd-5e13-4d63-8ce1-26adb81bf79d None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:03:14.656352 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a143fdd-5e13-4d63-8ce1-26adb81bf79d None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:03:14.700020 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182e65a7-2c83-4df3-9781-9d8434fc0120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:03:14.700944 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182e65a7-2c83-4df3-9781-9d8434fc0120 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:03:14.701225 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182e65a7-2c83-4df3-9781-9d8434fc0120 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:03:14.701660 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182e65a7-2c83-4df3-9781-9d8434fc0120 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:03:14.711035 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182e65a7-2c83-4df3-9781-9d8434fc0120 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:03:14.713271 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182e65a7-2c83-4df3-9781-9d8434fc0120 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:03:14.732274 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application [None req-182e65a7-2c83-4df3-9781-9d8434fc0120 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 03 14:03:14.732274 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:03:14.732274 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 14:03:14.732274 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 14:03:14.732274 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 14:03:14.732274 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 14:03:14.732274 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 14:03:14.732274 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 14:03:14.732274 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 14:03:14.732274 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 14:03:14.732274 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 14:03:14.732274 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 14:03:14.732274 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 14:03:14.732274 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 14:03:14.732274 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 14:03:14.732274 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 14:03:14.733486 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 14:03:14.733486 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 14:03:14.733486 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 14:03:14.733486 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 14:03:14.733486 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 14:03:14.733486 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 14:03:14.733486 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 14:03:14.733486 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 14:03:14.733486 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 14:03:14.733486 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.get_or_create( May 03 14:03:14.733486 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 14:03:14.733486 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application with Lock( May 03 14:03:14.733486 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 14:03:14.733486 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._enter() May 03 14:03:14.733486 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 14:03:14.733486 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 14:03:14.733486 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 14:03:14.733486 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.creator() May 03 14:03:14.734541 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 14:03:14.734541 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application created_value = creator( May 03 14:03:14.734541 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 14:03:14.734541 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 14:03:14.734541 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 14:03:14.734541 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 14:03:14.734541 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 14:03:14.734541 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 14:03:14.734541 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 03 14:03:14.734541 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application May 03 14:03:14.734541 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 615/1253] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 3 14:03:14 2022] GET /identity/v3/users/placement => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 14:03:14.739961 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea47400-7b05-4cf9-be79-e00c012ecb07 None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:03:14.844232 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea47400-7b05-4cf9-be79-e00c012ecb07 None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:03:14.880868 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3dc009-b9b5-4965-9d23-86253942493d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:03:14.881562 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3dc009-b9b5-4965-9d23-86253942493d None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:03:14.881842 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3dc009-b9b5-4965-9d23-86253942493d None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:03:14.882127 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3dc009-b9b5-4965-9d23-86253942493d None admin] PATH_INFO: `/v3/users` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:03:14.883305 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3dc009-b9b5-4965-9d23-86253942493d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:03:14.883635 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3dc009-b9b5-4965-9d23-86253942493d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:03:14.885223 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3dc009-b9b5-4965-9d23-86253942493d None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:03:14.902962 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 639/1254] 10.222.0.36 () {56 vars in 1143 bytes} [Tue May 3 14:03:14 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:03:14.908836 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182e65a7-2c83-4df3-9781-9d8434fc0120 None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:03:15.009214 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182e65a7-2c83-4df3-9781-9d8434fc0120 None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:03:15.044492 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4647055a-e217-42e5-b36e-932424c3e474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:03:15.045374 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4647055a-e217-42e5-b36e-932424c3e474 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:03:15.045675 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4647055a-e217-42e5-b36e-932424c3e474 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:03:15.045959 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4647055a-e217-42e5-b36e-932424c3e474 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:03:15.117925 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4647055a-e217-42e5-b36e-932424c3e474 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:03:15.119506 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4647055a-e217-42e5-b36e-932424c3e474 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:03:15.217371 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 616/1255] 10.222.0.36 () {58 vars in 1282 bytes} [Tue May 3 14:03:14 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 03 14:03:15.223157 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3dc009-b9b5-4965-9d23-86253942493d None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:03:15.321715 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3dc009-b9b5-4965-9d23-86253942493d None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:03:15.356389 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b960157-4321-4da7-b58d-180e9dc5d727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:03:15.357213 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b960157-4321-4da7-b58d-180e9dc5d727 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:03:15.357575 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b960157-4321-4da7-b58d-180e9dc5d727 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:03:15.357852 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b960157-4321-4da7-b58d-180e9dc5d727 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:03:15.368676 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b960157-4321-4da7-b58d-180e9dc5d727 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:03:15.370152 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b960157-4321-4da7-b58d-180e9dc5d727 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:03:15.389368 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application [None req-2b960157-4321-4da7-b58d-180e9dc5d727 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 14:03:15.389368 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:03:15.389368 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 14:03:15.389368 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 14:03:15.389368 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 14:03:15.389368 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 14:03:15.389368 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 14:03:15.389368 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 14:03:15.389368 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 14:03:15.389368 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 14:03:15.389368 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 14:03:15.389368 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 14:03:15.389368 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 14:03:15.389368 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 14:03:15.389368 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 14:03:15.390444 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 14:03:15.390444 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 14:03:15.390444 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 14:03:15.390444 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 14:03:15.390444 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 14:03:15.390444 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 14:03:15.390444 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.get_or_create( May 03 14:03:15.390444 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 14:03:15.390444 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application with Lock( May 03 14:03:15.390444 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 14:03:15.390444 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._enter() May 03 14:03:15.390444 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 14:03:15.390444 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 14:03:15.390444 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 14:03:15.390444 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.creator() May 03 14:03:15.390444 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 14:03:15.390444 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application created_value = creator( May 03 14:03:15.391370 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 14:03:15.391370 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 14:03:15.391370 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 14:03:15.391370 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application May 03 14:03:15.395216 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 640/1256] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 3 14:03:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 14:03:15.396508 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4647055a-e217-42e5-b36e-932424c3e474 None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:03:15.506234 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4647055a-e217-42e5-b36e-932424c3e474 None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:03:15.542723 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3beeed00-6fb8-4e3e-921b-965397fa8296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:03:15.543393 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beeed00-6fb8-4e3e-921b-965397fa8296 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:03:15.543667 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beeed00-6fb8-4e3e-921b-965397fa8296 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:03:15.543938 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beeed00-6fb8-4e3e-921b-965397fa8296 None admin] PATH_INFO: `/v3/domains` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:03:15.544662 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3beeed00-6fb8-4e3e-921b-965397fa8296 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80012) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:03:15.544960 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3beeed00-6fb8-4e3e-921b-965397fa8296 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:03:15.546386 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3beeed00-6fb8-4e3e-921b-965397fa8296 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:03:15.559008 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 617/1257] 10.222.0.36 () {56 vars in 1109 bytes} [Tue May 3 14:03:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:03:15.564876 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b960157-4321-4da7-b58d-180e9dc5d727 None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:03:15.673221 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b960157-4321-4da7-b58d-180e9dc5d727 None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:03:15.712095 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90eab6a9-7f53-4d35-ab5f-b1651ecd82ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:03:15.713439 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90eab6a9-7f53-4d35-ab5f-b1651ecd82ee None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:03:15.713808 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90eab6a9-7f53-4d35-ab5f-b1651ecd82ee None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:03:15.714152 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90eab6a9-7f53-4d35-ab5f-b1651ecd82ee None admin] PATH_INFO: `/v3/projects/service` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:03:15.722782 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90eab6a9-7f53-4d35-ab5f-b1651ecd82ee None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:03:15.724237 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90eab6a9-7f53-4d35-ab5f-b1651ecd82ee None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:03:15.738734 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application [None req-90eab6a9-7f53-4d35-ab5f-b1651ecd82ee None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 14:03:15.738734 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:03:15.738734 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 14:03:15.738734 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 14:03:15.738734 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 14:03:15.738734 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 14:03:15.738734 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 14:03:15.738734 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 14:03:15.738734 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 14:03:15.738734 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 14:03:15.738734 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 14:03:15.738734 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 14:03:15.738734 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 14:03:15.738734 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 14:03:15.738734 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 14:03:15.739848 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 14:03:15.739848 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 14:03:15.739848 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 14:03:15.739848 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 14:03:15.739848 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 14:03:15.739848 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 14:03:15.739848 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.get_or_create( May 03 14:03:15.739848 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 14:03:15.739848 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application with Lock( May 03 14:03:15.739848 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 14:03:15.739848 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._enter() May 03 14:03:15.739848 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 14:03:15.739848 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 14:03:15.739848 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 14:03:15.739848 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.creator() May 03 14:03:15.739848 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 14:03:15.739848 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application created_value = creator( May 03 14:03:15.741364 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 14:03:15.741364 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 14:03:15.741364 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 14:03:15.741364 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 14:03:15.741364 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 14:03:15.741364 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 14:03:15.741364 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 14:03:15.741364 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application May 03 14:03:15.745508 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 641/1258] 10.222.0.36 () {56 vars in 1111 bytes} [Tue May 3 14:03:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 14:03:15.746727 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3beeed00-6fb8-4e3e-921b-965397fa8296 None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:03:15.855614 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3beeed00-6fb8-4e3e-921b-965397fa8296 None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:03:15.893955 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359481ce-9503-45e4-b4cc-6df8e6d068d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:03:15.894654 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359481ce-9503-45e4-b4cc-6df8e6d068d0 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:03:15.894936 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359481ce-9503-45e4-b4cc-6df8e6d068d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:03:15.895208 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359481ce-9503-45e4-b4cc-6df8e6d068d0 None admin] PATH_INFO: `/v3/projects` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:03:15.895962 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359481ce-9503-45e4-b4cc-6df8e6d068d0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80012) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:03:15.896295 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359481ce-9503-45e4-b4cc-6df8e6d068d0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:03:15.897732 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359481ce-9503-45e4-b4cc-6df8e6d068d0 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:03:15.910324 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 618/1259] 10.222.0.36 () {56 vars in 1148 bytes} [Tue May 3 14:03:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:03:15.916543 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90eab6a9-7f53-4d35-ab5f-b1651ecd82ee None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:03:16.016043 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90eab6a9-7f53-4d35-ab5f-b1651ecd82ee None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:03:16.049326 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f981fdb1-e884-4978-9325-5910d09e99b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:03:16.050008 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f981fdb1-e884-4978-9325-5910d09e99b6 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:03:16.050288 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f981fdb1-e884-4978-9325-5910d09e99b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:03:16.050544 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f981fdb1-e884-4978-9325-5910d09e99b6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:03:16.051379 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f981fdb1-e884-4978-9325-5910d09e99b6 None admin] RBAC: Adding query filter params (role.id=36abe9b50fd8479c86c4f8f70fd85aa3, scope.project.id=de541be478754087934323bdbe41a579, user.id=164c7f36acf644e9bf93f158e876e9e3) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:03:16.051718 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f981fdb1-e884-4978-9325-5910d09e99b6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:03:16.053124 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f981fdb1-e884-4978-9325-5910d09e99b6 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:03:16.059329 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 642/1260] 10.222.0.36 () {56 vars in 1374 bytes} [Tue May 3 14:03:15 2022] GET /identity/v3/role_assignments?user.id=164c7f36acf644e9bf93f158e876e9e3&scope.project.id=de541be478754087934323bdbe41a579&role.id=36abe9b50fd8479c86c4f8f70fd85aa3 => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 14:03:18.228409 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622fe63b-645e-415c-b9e7-afbebe19aea6 None None] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:03:18.229001 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622fe63b-645e-415c-b9e7-afbebe19aea6 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:03:18.229001 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622fe63b-645e-415c-b9e7-afbebe19aea6 None None] PATH_INFO: `/` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:03:18.230365 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 619/1261] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 3 14:03:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 14:03:18.236642 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18aa34cb-7647-4d8c-bb8d-9f230f9e6287 None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:03:18.237420 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18aa34cb-7647-4d8c-bb8d-9f230f9e6287 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:03:18.237734 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18aa34cb-7647-4d8c-bb8d-9f230f9e6287 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:03:18.256649 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-18aa34cb-7647-4d8c-bb8d-9f230f9e6287 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:03:18.257950 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-18aa34cb-7647-4d8c-bb8d-9f230f9e6287 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:03:18.323845 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 643/1262] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 3 14:03:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 14:03:18.357846 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622fe63b-645e-415c-b9e7-afbebe19aea6 None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:03:18.463288 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622fe63b-645e-415c-b9e7-afbebe19aea6 None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:03:18.496824 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b231029d-e029-42cc-981a-63885f100263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:03:18.497628 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b231029d-e029-42cc-981a-63885f100263 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:03:18.497909 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b231029d-e029-42cc-981a-63885f100263 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:03:18.498181 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b231029d-e029-42cc-981a-63885f100263 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:03:18.508607 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b231029d-e029-42cc-981a-63885f100263 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 14:03:18.516206 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application [None req-b231029d-e029-42cc-981a-63885f100263 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 03 14:03:18.516206 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:03:18.516206 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 14:03:18.516206 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 14:03:18.516206 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 14:03:18.516206 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 14:03:18.516206 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 14:03:18.516206 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 14:03:18.516206 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 14:03:18.516206 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 14:03:18.516206 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 14:03:18.516206 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 14:03:18.516206 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 14:03:18.516206 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 14:03:18.516206 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 14:03:18.516206 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 14:03:18.517332 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 14:03:18.517332 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 14:03:18.517332 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 14:03:18.517332 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 14:03:18.517332 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 14:03:18.517332 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 14:03:18.517332 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 14:03:18.517332 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 14:03:18.517332 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 14:03:18.517332 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.get_or_create( May 03 14:03:18.517332 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 14:03:18.517332 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application with Lock( May 03 14:03:18.517332 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 14:03:18.517332 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._enter() May 03 14:03:18.517332 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 14:03:18.517332 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 14:03:18.518314 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 14:03:18.518314 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.creator() May 03 14:03:18.518314 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 14:03:18.518314 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application created_value = creator( May 03 14:03:18.518314 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 14:03:18.518314 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 14:03:18.518314 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 14:03:18.518314 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 14:03:18.518314 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 14:03:18.518314 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 14:03:18.518314 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 03 14:03:18.518314 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application May 03 14:03:18.518314 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 620/1263] 10.222.0.36 () {56 vars in 1096 bytes} [Tue May 3 14:03:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 14:03:18.524745 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18aa34cb-7647-4d8c-bb8d-9f230f9e6287 None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:03:18.628101 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18aa34cb-7647-4d8c-bb8d-9f230f9e6287 None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:03:18.663527 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a7b48b-6a94-4ad5-85be-97bed5de87cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:03:18.664227 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a7b48b-6a94-4ad5-85be-97bed5de87cf None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:03:18.664504 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a7b48b-6a94-4ad5-85be-97bed5de87cf None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:03:18.664769 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a7b48b-6a94-4ad5-85be-97bed5de87cf None admin] PATH_INFO: `/v3/roles` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:03:18.665521 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a7b48b-6a94-4ad5-85be-97bed5de87cf None admin] RBAC: Adding query filter params (name=admin) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:03:18.665867 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a7b48b-6a94-4ad5-85be-97bed5de87cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:03:18.667293 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a7b48b-6a94-4ad5-85be-97bed5de87cf None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:03:18.676049 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 644/1264] 10.222.0.36 () {56 vars in 1099 bytes} [Tue May 3 14:03:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:03:18.682099 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b231029d-e029-42cc-981a-63885f100263 None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:03:18.798389 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b231029d-e029-42cc-981a-63885f100263 None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:03:18.834848 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a090a80a-9e1a-423a-aba5-084a8f7e88cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:03:18.835643 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a090a80a-9e1a-423a-aba5-084a8f7e88cf None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:03:18.835961 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a090a80a-9e1a-423a-aba5-084a8f7e88cf None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:03:18.836228 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a090a80a-9e1a-423a-aba5-084a8f7e88cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:03:18.846918 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a090a80a-9e1a-423a-aba5-084a8f7e88cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:03:18.848356 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a090a80a-9e1a-423a-aba5-084a8f7e88cf None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:03:18.865245 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application [None req-a090a80a-9e1a-423a-aba5-084a8f7e88cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 14:03:18.865245 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:03:18.865245 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 14:03:18.865245 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 14:03:18.865245 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 14:03:18.865245 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 14:03:18.865245 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 14:03:18.865245 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 14:03:18.865245 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 14:03:18.865245 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 14:03:18.865245 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 14:03:18.865245 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 14:03:18.865245 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 14:03:18.865245 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 14:03:18.865245 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 14:03:18.866296 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 14:03:18.866296 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 14:03:18.866296 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 14:03:18.866296 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 14:03:18.866296 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 14:03:18.866296 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 14:03:18.866296 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.get_or_create( May 03 14:03:18.866296 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 14:03:18.866296 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application with Lock( May 03 14:03:18.866296 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 14:03:18.866296 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._enter() May 03 14:03:18.866296 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 14:03:18.866296 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 14:03:18.866296 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 14:03:18.866296 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.creator() May 03 14:03:18.866296 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 14:03:18.866296 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application created_value = creator( May 03 14:03:18.867549 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 14:03:18.867549 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 14:03:18.867549 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 14:03:18.867549 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application May 03 14:03:18.867549 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 621/1265] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 3 14:03:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 14:03:18.872788 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a7b48b-6a94-4ad5-85be-97bed5de87cf None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:03:18.975685 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a7b48b-6a94-4ad5-85be-97bed5de87cf None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:03:19.011417 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c990bc2-ba12-461a-9afc-d446bf0b9fbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:03:19.012072 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c990bc2-ba12-461a-9afc-d446bf0b9fbc None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:03:19.012345 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c990bc2-ba12-461a-9afc-d446bf0b9fbc None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:03:19.012582 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c990bc2-ba12-461a-9afc-d446bf0b9fbc None admin] PATH_INFO: `/v3/domains` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:03:19.013332 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c990bc2-ba12-461a-9afc-d446bf0b9fbc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:03:19.013639 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c990bc2-ba12-461a-9afc-d446bf0b9fbc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:03:19.015031 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c990bc2-ba12-461a-9afc-d446bf0b9fbc None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:03:19.031030 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 645/1266] 10.222.0.36 () {56 vars in 1109 bytes} [Tue May 3 14:03:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:03:19.039812 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a090a80a-9e1a-423a-aba5-084a8f7e88cf None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:03:19.144264 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a090a80a-9e1a-423a-aba5-084a8f7e88cf None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:03:19.178782 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f403c5bd-50a8-4661-8985-073fa50ea36f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:03:19.179604 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f403c5bd-50a8-4661-8985-073fa50ea36f None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:03:19.179859 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f403c5bd-50a8-4661-8985-073fa50ea36f None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:03:19.180147 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f403c5bd-50a8-4661-8985-073fa50ea36f None admin] PATH_INFO: `/v3/users/placement` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:03:19.188236 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f403c5bd-50a8-4661-8985-073fa50ea36f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:03:19.189843 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f403c5bd-50a8-4661-8985-073fa50ea36f None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:03:19.204322 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application [None req-f403c5bd-50a8-4661-8985-073fa50ea36f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 03 14:03:19.204322 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:03:19.204322 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 14:03:19.204322 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 14:03:19.204322 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 14:03:19.204322 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 14:03:19.204322 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 14:03:19.204322 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 14:03:19.204322 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 14:03:19.204322 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 14:03:19.204322 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 14:03:19.204322 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 14:03:19.204322 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 14:03:19.204322 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 14:03:19.204322 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 14:03:19.204322 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 14:03:19.205416 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 14:03:19.205416 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 14:03:19.205416 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 14:03:19.205416 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 14:03:19.205416 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 14:03:19.205416 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 14:03:19.205416 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 14:03:19.205416 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 14:03:19.205416 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 14:03:19.205416 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.get_or_create( May 03 14:03:19.205416 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 14:03:19.205416 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application with Lock( May 03 14:03:19.205416 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 14:03:19.205416 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._enter() May 03 14:03:19.205416 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 14:03:19.205416 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 14:03:19.205416 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 14:03:19.205416 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.creator() May 03 14:03:19.206625 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 14:03:19.206625 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application created_value = creator( May 03 14:03:19.206625 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 14:03:19.206625 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 14:03:19.206625 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 14:03:19.206625 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 14:03:19.206625 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 14:03:19.206625 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 14:03:19.206625 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 03 14:03:19.206625 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application May 03 14:03:19.206625 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 622/1267] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 3 14:03:19 2022] GET /identity/v3/users/placement => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 14:03:19.211560 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c990bc2-ba12-461a-9afc-d446bf0b9fbc None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:03:19.313697 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c990bc2-ba12-461a-9afc-d446bf0b9fbc None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:03:19.348975 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8e2493-897a-4666-8efb-d6bd5230abcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:03:19.349668 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8e2493-897a-4666-8efb-d6bd5230abcd None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:03:19.349951 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8e2493-897a-4666-8efb-d6bd5230abcd None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:03:19.350214 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8e2493-897a-4666-8efb-d6bd5230abcd None admin] PATH_INFO: `/v3/users` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:03:19.351043 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8e2493-897a-4666-8efb-d6bd5230abcd None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:03:19.351407 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8e2493-897a-4666-8efb-d6bd5230abcd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:03:19.352840 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8e2493-897a-4666-8efb-d6bd5230abcd None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:03:19.369671 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 646/1268] 10.222.0.36 () {56 vars in 1143 bytes} [Tue May 3 14:03:19 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:03:19.375657 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f403c5bd-50a8-4661-8985-073fa50ea36f None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:03:19.495973 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f403c5bd-50a8-4661-8985-073fa50ea36f None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:03:19.529072 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0107b02f-a762-43b5-9665-421f4370a67d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:03:19.529884 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0107b02f-a762-43b5-9665-421f4370a67d None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:03:19.530165 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0107b02f-a762-43b5-9665-421f4370a67d None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:03:19.530436 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0107b02f-a762-43b5-9665-421f4370a67d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:03:19.540950 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0107b02f-a762-43b5-9665-421f4370a67d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:03:19.542410 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0107b02f-a762-43b5-9665-421f4370a67d None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:03:19.559571 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application [None req-0107b02f-a762-43b5-9665-421f4370a67d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 14:03:19.559571 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:03:19.559571 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 14:03:19.559571 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 14:03:19.559571 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 14:03:19.559571 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 14:03:19.559571 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 14:03:19.559571 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 14:03:19.559571 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 14:03:19.559571 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 14:03:19.559571 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 14:03:19.559571 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 14:03:19.559571 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 14:03:19.559571 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 14:03:19.559571 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 14:03:19.560521 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 14:03:19.560521 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 14:03:19.560521 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 14:03:19.560521 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 14:03:19.560521 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 14:03:19.560521 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 14:03:19.560521 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.get_or_create( May 03 14:03:19.560521 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 14:03:19.560521 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application with Lock( May 03 14:03:19.560521 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 14:03:19.560521 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._enter() May 03 14:03:19.560521 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 14:03:19.560521 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 14:03:19.560521 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 14:03:19.560521 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.creator() May 03 14:03:19.560521 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 14:03:19.560521 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application created_value = creator( May 03 14:03:19.561638 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 14:03:19.561638 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 14:03:19.561638 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 14:03:19.561638 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application May 03 14:03:19.561638 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 623/1269] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 3 14:03:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 14:03:19.567587 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8e2493-897a-4666-8efb-d6bd5230abcd None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:03:19.678036 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8e2493-897a-4666-8efb-d6bd5230abcd None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:03:19.714457 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ca78b1-d1a5-4839-b9b8-83c0b0e79cff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:03:19.715110 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ca78b1-d1a5-4839-b9b8-83c0b0e79cff None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:03:19.715385 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ca78b1-d1a5-4839-b9b8-83c0b0e79cff None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:03:19.715655 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ca78b1-d1a5-4839-b9b8-83c0b0e79cff None admin] PATH_INFO: `/v3/domains` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:03:19.716370 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ca78b1-d1a5-4839-b9b8-83c0b0e79cff None admin] RBAC: Adding query filter params (name=Default) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:03:19.716672 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ca78b1-d1a5-4839-b9b8-83c0b0e79cff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:03:19.718069 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ca78b1-d1a5-4839-b9b8-83c0b0e79cff None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:03:19.729041 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 647/1270] 10.222.0.36 () {56 vars in 1109 bytes} [Tue May 3 14:03:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:03:19.734912 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0107b02f-a762-43b5-9665-421f4370a67d None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:03:19.841889 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0107b02f-a762-43b5-9665-421f4370a67d None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:03:19.875680 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5277f91-f2af-4054-a1ff-9e6d33c0f2f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:03:19.876461 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5277f91-f2af-4054-a1ff-9e6d33c0f2f8 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:03:19.876738 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5277f91-f2af-4054-a1ff-9e6d33c0f2f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:03:19.877006 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5277f91-f2af-4054-a1ff-9e6d33c0f2f8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:03:19.883748 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5277f91-f2af-4054-a1ff-9e6d33c0f2f8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:03:19.885174 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5277f91-f2af-4054-a1ff-9e6d33c0f2f8 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:03:19.905699 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application [None req-d5277f91-f2af-4054-a1ff-9e6d33c0f2f8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 14:03:19.905699 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:03:19.905699 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 14:03:19.905699 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 14:03:19.905699 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 14:03:19.905699 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 14:03:19.905699 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 14:03:19.905699 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 14:03:19.905699 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 14:03:19.905699 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 14:03:19.905699 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 14:03:19.905699 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 14:03:19.905699 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 14:03:19.905699 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 14:03:19.905699 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 14:03:19.907486 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 14:03:19.907486 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 14:03:19.907486 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 14:03:19.907486 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 14:03:19.907486 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 14:03:19.907486 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 14:03:19.907486 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.get_or_create( May 03 14:03:19.907486 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 14:03:19.907486 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application with Lock( May 03 14:03:19.907486 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 14:03:19.907486 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._enter() May 03 14:03:19.907486 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 14:03:19.907486 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 14:03:19.907486 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 14:03:19.907486 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.creator() May 03 14:03:19.907486 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 14:03:19.907486 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application created_value = creator( May 03 14:03:19.908983 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 14:03:19.908983 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 14:03:19.908983 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 14:03:19.908983 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 14:03:19.908983 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 14:03:19.908983 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 14:03:19.908983 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 14:03:19.908983 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application May 03 14:03:19.908983 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 624/1271] 10.222.0.36 () {56 vars in 1111 bytes} [Tue May 3 14:03:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 14:03:19.916716 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ca78b1-d1a5-4839-b9b8-83c0b0e79cff None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:03:20.038434 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ca78b1-d1a5-4839-b9b8-83c0b0e79cff None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:03:20.075321 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c46d7a-8f2e-43b4-a7fc-9c43d30c9704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:03:20.075990 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c46d7a-8f2e-43b4-a7fc-9c43d30c9704 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:03:20.076267 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c46d7a-8f2e-43b4-a7fc-9c43d30c9704 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:03:20.076528 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c46d7a-8f2e-43b4-a7fc-9c43d30c9704 None admin] PATH_INFO: `/v3/projects` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:03:20.077323 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c46d7a-8f2e-43b4-a7fc-9c43d30c9704 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:03:20.077622 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c46d7a-8f2e-43b4-a7fc-9c43d30c9704 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:03:20.079065 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c46d7a-8f2e-43b4-a7fc-9c43d30c9704 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:03:20.091070 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 648/1272] 10.222.0.36 () {56 vars in 1148 bytes} [Tue May 3 14:03:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:03:20.097356 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5277f91-f2af-4054-a1ff-9e6d33c0f2f8 None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:03:20.196856 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5277f91-f2af-4054-a1ff-9e6d33c0f2f8 None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:03:20.239337 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1faf06-acf7-4fa6-b5e4-2d8a2ae2a0cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:03:20.240638 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1faf06-acf7-4fa6-b5e4-2d8a2ae2a0cf None admin] REQUEST_METHOD: `PUT` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:03:20.241002 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1faf06-acf7-4fa6-b5e4-2d8a2ae2a0cf None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:03:20.241354 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1faf06-acf7-4fa6-b5e4-2d8a2ae2a0cf None admin] PATH_INFO: `/v3/projects/de541be478754087934323bdbe41a579/users/164c7f36acf644e9bf93f158e876e9e3/roles/36abe9b50fd8479c86c4f8f70fd85aa3` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:03:20.244088 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1faf06-acf7-4fa6-b5e4-2d8a2ae2a0cf None admin] RBAC: Authorizing `identity:create_grant(project_id=de541be478754087934323bdbe41a579, user_id=164c7f36acf644e9bf93f158e876e9e3, role_id=36abe9b50fd8479c86c4f8f70fd85aa3)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:03:20.245572 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1faf06-acf7-4fa6-b5e4-2d8a2ae2a0cf None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:03:20.261155 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 625/1273] 10.222.0.36 () {58 vars in 1439 bytes} [Tue May 3 14:03:20 2022] PUT /identity/v3/projects/de541be478754087934323bdbe41a579/users/164c7f36acf644e9bf93f158e876e9e3/roles/36abe9b50fd8479c86c4f8f70fd85aa3 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:03:22.637118 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483c255e-e3d1-40db-ac53-d88ef2404ffa None None] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:03:22.638064 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483c255e-e3d1-40db-ac53-d88ef2404ffa None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:03:22.638064 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483c255e-e3d1-40db-ac53-d88ef2404ffa None None] PATH_INFO: `/` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:03:22.640163 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 649/1274] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 3 14:03:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 14:03:22.648096 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed278626-e4df-4487-a443-763c9f2c85c4 None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:03:22.648528 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed278626-e4df-4487-a443-763c9f2c85c4 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:03:22.648619 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed278626-e4df-4487-a443-763c9f2c85c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:03:22.668296 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-ed278626-e4df-4487-a443-763c9f2c85c4 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:03:22.669791 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-ed278626-e4df-4487-a443-763c9f2c85c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:03:22.745212 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 626/1275] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 3 14:03:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 03 14:03:22.772930 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483c255e-e3d1-40db-ac53-d88ef2404ffa None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:03:22.875089 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483c255e-e3d1-40db-ac53-d88ef2404ffa None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:03:22.912881 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82adf414-adc7-4074-83f4-8355f07ec09a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:03:22.913830 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82adf414-adc7-4074-83f4-8355f07ec09a None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:03:22.914118 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82adf414-adc7-4074-83f4-8355f07ec09a None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:03:22.914514 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82adf414-adc7-4074-83f4-8355f07ec09a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:03:22.925280 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82adf414-adc7-4074-83f4-8355f07ec09a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 14:03:22.933246 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application [None req-82adf414-adc7-4074-83f4-8355f07ec09a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 03 14:03:22.933246 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:03:22.933246 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 14:03:22.933246 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 14:03:22.933246 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 14:03:22.933246 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 14:03:22.933246 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 14:03:22.933246 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 14:03:22.933246 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 14:03:22.933246 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 14:03:22.933246 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 14:03:22.933246 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 14:03:22.933246 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 14:03:22.933246 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 14:03:22.933246 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 14:03:22.933246 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 14:03:22.934283 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 14:03:22.934283 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 14:03:22.934283 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 14:03:22.934283 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 14:03:22.934283 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 14:03:22.934283 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 14:03:22.934283 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 14:03:22.934283 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 14:03:22.934283 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 14:03:22.934283 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.get_or_create( May 03 14:03:22.934283 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 14:03:22.934283 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application with Lock( May 03 14:03:22.934283 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 14:03:22.934283 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._enter() May 03 14:03:22.934283 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 14:03:22.934283 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 14:03:22.935175 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 14:03:22.935175 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.creator() May 03 14:03:22.935175 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 14:03:22.935175 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application created_value = creator( May 03 14:03:22.935175 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 14:03:22.935175 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 14:03:22.935175 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 14:03:22.935175 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 14:03:22.935175 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 14:03:22.935175 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 14:03:22.935175 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 03 14:03:22.935175 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application May 03 14:03:22.935175 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 650/1276] 10.222.0.36 () {56 vars in 1096 bytes} [Tue May 3 14:03:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 14:03:22.940873 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed278626-e4df-4487-a443-763c9f2c85c4 None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:03:23.046097 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed278626-e4df-4487-a443-763c9f2c85c4 None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:03:23.082332 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03503802-0f7f-496d-9e8a-6288589491c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:03:23.082988 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03503802-0f7f-496d-9e8a-6288589491c6 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:03:23.083260 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03503802-0f7f-496d-9e8a-6288589491c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:03:23.083535 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03503802-0f7f-496d-9e8a-6288589491c6 None admin] PATH_INFO: `/v3/roles` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:03:23.084272 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03503802-0f7f-496d-9e8a-6288589491c6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80012) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:03:23.084573 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03503802-0f7f-496d-9e8a-6288589491c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:03:23.086071 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03503802-0f7f-496d-9e8a-6288589491c6 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:03:23.094149 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 627/1277] 10.222.0.36 () {56 vars in 1099 bytes} [Tue May 3 14:03:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:03:23.099959 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82adf414-adc7-4074-83f4-8355f07ec09a None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:03:23.202580 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82adf414-adc7-4074-83f4-8355f07ec09a None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:03:23.237371 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83b56a0-2b06-4ecf-b6de-8511a8394b4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:03:23.238167 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83b56a0-2b06-4ecf-b6de-8511a8394b4e None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:03:23.238441 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83b56a0-2b06-4ecf-b6de-8511a8394b4e None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:03:23.238715 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83b56a0-2b06-4ecf-b6de-8511a8394b4e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:03:23.249806 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83b56a0-2b06-4ecf-b6de-8511a8394b4e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:03:23.251252 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83b56a0-2b06-4ecf-b6de-8511a8394b4e None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:03:23.267970 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application [None req-a83b56a0-2b06-4ecf-b6de-8511a8394b4e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 14:03:23.267970 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:03:23.267970 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 14:03:23.267970 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 14:03:23.267970 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 14:03:23.267970 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 14:03:23.267970 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 14:03:23.267970 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 14:03:23.267970 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 14:03:23.267970 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 14:03:23.267970 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 14:03:23.267970 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 14:03:23.267970 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 14:03:23.267970 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 14:03:23.267970 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 14:03:23.268971 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 14:03:23.268971 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 14:03:23.268971 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 14:03:23.268971 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 14:03:23.268971 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 14:03:23.268971 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 14:03:23.268971 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.get_or_create( May 03 14:03:23.268971 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 14:03:23.268971 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application with Lock( May 03 14:03:23.268971 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 14:03:23.268971 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._enter() May 03 14:03:23.268971 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 14:03:23.268971 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 14:03:23.268971 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 14:03:23.268971 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.creator() May 03 14:03:23.268971 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 14:03:23.268971 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application created_value = creator( May 03 14:03:23.270174 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 14:03:23.270174 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 14:03:23.270174 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 14:03:23.270174 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application May 03 14:03:23.270174 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 651/1278] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 3 14:03:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 14:03:23.277762 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03503802-0f7f-496d-9e8a-6288589491c6 None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:03:23.386802 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03503802-0f7f-496d-9e8a-6288589491c6 None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:03:23.421647 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3977744-3712-4d1e-b997-9d5ba8134306 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:03:23.422300 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3977744-3712-4d1e-b997-9d5ba8134306 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:03:23.422577 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3977744-3712-4d1e-b997-9d5ba8134306 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:03:23.422847 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3977744-3712-4d1e-b997-9d5ba8134306 None admin] PATH_INFO: `/v3/domains` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:03:23.423549 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3977744-3712-4d1e-b997-9d5ba8134306 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80012) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:03:23.423851 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3977744-3712-4d1e-b997-9d5ba8134306 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:03:23.425209 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3977744-3712-4d1e-b997-9d5ba8134306 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:03:23.436655 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 628/1279] 10.222.0.36 () {56 vars in 1109 bytes} [Tue May 3 14:03:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:03:23.442702 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83b56a0-2b06-4ecf-b6de-8511a8394b4e None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:03:23.545535 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83b56a0-2b06-4ecf-b6de-8511a8394b4e None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:03:23.582473 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00f195a-4082-400a-b47b-0d70b13ce26b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:03:23.583267 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00f195a-4082-400a-b47b-0d70b13ce26b None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:03:23.583545 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00f195a-4082-400a-b47b-0d70b13ce26b None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:03:23.583816 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00f195a-4082-400a-b47b-0d70b13ce26b None admin] PATH_INFO: `/v3/users/placement` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:03:23.591990 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00f195a-4082-400a-b47b-0d70b13ce26b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:03:23.593460 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00f195a-4082-400a-b47b-0d70b13ce26b None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:03:23.607909 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application [None req-f00f195a-4082-400a-b47b-0d70b13ce26b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 03 14:03:23.607909 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:03:23.607909 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 14:03:23.607909 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 14:03:23.607909 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 14:03:23.607909 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 14:03:23.607909 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 14:03:23.607909 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 14:03:23.607909 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 14:03:23.607909 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 14:03:23.607909 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 14:03:23.607909 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 14:03:23.607909 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 14:03:23.607909 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 14:03:23.607909 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 14:03:23.607909 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 14:03:23.609011 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 14:03:23.609011 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 14:03:23.609011 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 14:03:23.609011 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 14:03:23.609011 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 14:03:23.609011 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 14:03:23.609011 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 14:03:23.609011 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 14:03:23.609011 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 14:03:23.609011 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.get_or_create( May 03 14:03:23.609011 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 14:03:23.609011 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application with Lock( May 03 14:03:23.609011 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 14:03:23.609011 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._enter() May 03 14:03:23.609011 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 14:03:23.609011 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 14:03:23.609011 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 14:03:23.609011 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.creator() May 03 14:03:23.610263 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 14:03:23.610263 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application created_value = creator( May 03 14:03:23.610263 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 14:03:23.610263 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 14:03:23.610263 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 14:03:23.610263 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 14:03:23.610263 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 14:03:23.610263 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 14:03:23.610263 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 03 14:03:23.610263 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application May 03 14:03:23.610263 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 652/1280] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 3 14:03:23 2022] GET /identity/v3/users/placement => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 14:03:23.615264 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3977744-3712-4d1e-b997-9d5ba8134306 None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:03:23.727222 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3977744-3712-4d1e-b997-9d5ba8134306 None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:03:23.762523 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467674d1-a0dc-4d86-abda-c5626726f3c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:03:23.763183 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467674d1-a0dc-4d86-abda-c5626726f3c4 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:03:23.763457 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467674d1-a0dc-4d86-abda-c5626726f3c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:03:23.763727 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467674d1-a0dc-4d86-abda-c5626726f3c4 None admin] PATH_INFO: `/v3/users` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:03:23.764557 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467674d1-a0dc-4d86-abda-c5626726f3c4 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80012) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:03:23.764858 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467674d1-a0dc-4d86-abda-c5626726f3c4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:03:23.766309 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467674d1-a0dc-4d86-abda-c5626726f3c4 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:03:23.782889 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 629/1281] 10.222.0.36 () {56 vars in 1143 bytes} [Tue May 3 14:03:23 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 14:03:23.791255 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00f195a-4082-400a-b47b-0d70b13ce26b None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:03:23.891697 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00f195a-4082-400a-b47b-0d70b13ce26b None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:03:23.925664 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d18d9f6-c4ac-4e18-a261-99a53602699c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:03:23.926291 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d18d9f6-c4ac-4e18-a261-99a53602699c None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:03:23.926623 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d18d9f6-c4ac-4e18-a261-99a53602699c None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:03:23.926896 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d18d9f6-c4ac-4e18-a261-99a53602699c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:03:23.993476 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d18d9f6-c4ac-4e18-a261-99a53602699c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:03:23.994905 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d18d9f6-c4ac-4e18-a261-99a53602699c None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:03:24.099522 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 653/1282] 10.222.0.36 () {58 vars in 1282 bytes} [Tue May 3 14:03:23 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 03 14:03:24.105649 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467674d1-a0dc-4d86-abda-c5626726f3c4 None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:03:24.207001 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467674d1-a0dc-4d86-abda-c5626726f3c4 None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:03:24.240642 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc2a072-63cc-4f50-9ee5-259d9df29130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:03:24.241450 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc2a072-63cc-4f50-9ee5-259d9df29130 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:03:24.241725 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc2a072-63cc-4f50-9ee5-259d9df29130 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:03:24.242038 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc2a072-63cc-4f50-9ee5-259d9df29130 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:03:24.252114 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc2a072-63cc-4f50-9ee5-259d9df29130 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:03:24.253567 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc2a072-63cc-4f50-9ee5-259d9df29130 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:03:24.271004 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application [None req-0fc2a072-63cc-4f50-9ee5-259d9df29130 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 14:03:24.271004 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:03:24.271004 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 14:03:24.271004 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 14:03:24.271004 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 14:03:24.271004 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 14:03:24.271004 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 14:03:24.271004 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 14:03:24.271004 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 14:03:24.271004 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 14:03:24.271004 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 14:03:24.271004 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 14:03:24.271004 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 14:03:24.271004 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 14:03:24.271004 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 14:03:24.272038 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 14:03:24.272038 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 14:03:24.272038 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 14:03:24.272038 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 14:03:24.272038 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 14:03:24.272038 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 14:03:24.272038 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.get_or_create( May 03 14:03:24.272038 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 14:03:24.272038 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application with Lock( May 03 14:03:24.272038 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 14:03:24.272038 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._enter() May 03 14:03:24.272038 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 14:03:24.272038 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 14:03:24.272038 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 14:03:24.272038 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.creator() May 03 14:03:24.272038 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 14:03:24.272038 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application created_value = creator( May 03 14:03:24.273844 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 14:03:24.273844 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 14:03:24.273844 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 14:03:24.273844 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application May 03 14:03:24.273844 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 630/1283] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 3 14:03:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 14:03:24.278705 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d18d9f6-c4ac-4e18-a261-99a53602699c None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:03:24.385113 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d18d9f6-c4ac-4e18-a261-99a53602699c None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:03:24.427967 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eeb20bd-43d3-4d5b-b872-353978ed8148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:03:24.428616 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeb20bd-43d3-4d5b-b872-353978ed8148 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:03:24.428900 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeb20bd-43d3-4d5b-b872-353978ed8148 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:03:24.429169 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeb20bd-43d3-4d5b-b872-353978ed8148 None admin] PATH_INFO: `/v3/domains` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:03:24.430421 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eeb20bd-43d3-4d5b-b872-353978ed8148 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:03:24.430728 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eeb20bd-43d3-4d5b-b872-353978ed8148 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:03:24.432115 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eeb20bd-43d3-4d5b-b872-353978ed8148 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:03:24.444301 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 654/1284] 10.222.0.36 () {56 vars in 1109 bytes} [Tue May 3 14:03:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:03:24.451982 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc2a072-63cc-4f50-9ee5-259d9df29130 None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:03:24.563608 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc2a072-63cc-4f50-9ee5-259d9df29130 None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:03:24.597858 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d94bacf-3bd6-443d-9845-f015391748d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:03:24.598637 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d94bacf-3bd6-443d-9845-f015391748d8 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:03:24.598916 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d94bacf-3bd6-443d-9845-f015391748d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:03:24.599187 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d94bacf-3bd6-443d-9845-f015391748d8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:03:24.605935 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d94bacf-3bd6-443d-9845-f015391748d8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:03:24.607378 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d94bacf-3bd6-443d-9845-f015391748d8 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:03:24.621134 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application [None req-6d94bacf-3bd6-443d-9845-f015391748d8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 14:03:24.621134 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:03:24.621134 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 14:03:24.621134 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 14:03:24.621134 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 14:03:24.621134 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 14:03:24.621134 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 14:03:24.621134 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 14:03:24.621134 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 14:03:24.621134 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 14:03:24.621134 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 14:03:24.621134 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 14:03:24.621134 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 14:03:24.621134 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 14:03:24.621134 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 14:03:24.622187 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 14:03:24.622187 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 14:03:24.622187 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 14:03:24.622187 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 14:03:24.622187 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 14:03:24.622187 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 14:03:24.622187 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.get_or_create( May 03 14:03:24.622187 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 14:03:24.622187 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application with Lock( May 03 14:03:24.622187 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 14:03:24.622187 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._enter() May 03 14:03:24.622187 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 14:03:24.622187 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 14:03:24.622187 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 14:03:24.622187 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.creator() May 03 14:03:24.622187 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 14:03:24.622187 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application created_value = creator( May 03 14:03:24.623234 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 14:03:24.623234 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 14:03:24.623234 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 14:03:24.623234 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 14:03:24.623234 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 14:03:24.623234 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 14:03:24.623234 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 14:03:24.623234 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: ERROR keystone.server.flask.application May 03 14:03:24.623234 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 631/1285] 10.222.0.36 () {56 vars in 1111 bytes} [Tue May 3 14:03:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 14:03:24.628915 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eeb20bd-43d3-4d5b-b872-353978ed8148 None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:03:24.747795 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eeb20bd-43d3-4d5b-b872-353978ed8148 None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:03:24.781157 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d04bff7-b282-4522-92d2-bcbaae46ff12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:03:24.781822 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d04bff7-b282-4522-92d2-bcbaae46ff12 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:03:24.782097 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d04bff7-b282-4522-92d2-bcbaae46ff12 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:03:24.782359 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d04bff7-b282-4522-92d2-bcbaae46ff12 None admin] PATH_INFO: `/v3/projects` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:03:24.783135 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d04bff7-b282-4522-92d2-bcbaae46ff12 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:03:24.783435 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d04bff7-b282-4522-92d2-bcbaae46ff12 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:03:24.784848 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d04bff7-b282-4522-92d2-bcbaae46ff12 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:03:24.796546 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 655/1286] 10.222.0.36 () {56 vars in 1148 bytes} [Tue May 3 14:03:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:03:24.803131 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d94bacf-3bd6-443d-9845-f015391748d8 None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:03:24.904641 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d94bacf-3bd6-443d-9845-f015391748d8 None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:03:24.937604 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7f1155-2dfb-4be6-80d0-db21e7d50c0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:03:24.938235 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7f1155-2dfb-4be6-80d0-db21e7d50c0b None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:03:24.938518 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7f1155-2dfb-4be6-80d0-db21e7d50c0b None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:03:24.938784 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7f1155-2dfb-4be6-80d0-db21e7d50c0b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:03:24.939596 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7f1155-2dfb-4be6-80d0-db21e7d50c0b None admin] RBAC: Adding query filter params (role.id=36abe9b50fd8479c86c4f8f70fd85aa3, scope.project.id=de541be478754087934323bdbe41a579, user.id=164c7f36acf644e9bf93f158e876e9e3) {{(pid=80012) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:03:24.939901 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7f1155-2dfb-4be6-80d0-db21e7d50c0b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:03:24.941520 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7f1155-2dfb-4be6-80d0-db21e7d50c0b None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:03:24.947360 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 632/1287] 10.222.0.36 () {56 vars in 1374 bytes} [Tue May 3 14:03:24 2022] GET /identity/v3/role_assignments?user.id=164c7f36acf644e9bf93f158e876e9e3&scope.project.id=de541be478754087934323bdbe41a579&role.id=36abe9b50fd8479c86c4f8f70fd85aa3 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:03:27.171850 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fe8e39-e775-4fb4-93c6-40292754d112 None None] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:03:27.172722 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fe8e39-e775-4fb4-93c6-40292754d112 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:03:27.172722 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fe8e39-e775-4fb4-93c6-40292754d112 None None] PATH_INFO: `/` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:03:27.174907 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 656/1288] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 3 14:03:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 14:03:27.180644 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963d9bb0-2e16-448f-9d55-efc9d2696f2b None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:03:27.181083 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963d9bb0-2e16-448f-9d55-efc9d2696f2b None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:03:27.181192 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963d9bb0-2e16-448f-9d55-efc9d2696f2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:03:27.200157 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-963d9bb0-2e16-448f-9d55-efc9d2696f2b None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:03:27.201374 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-963d9bb0-2e16-448f-9d55-efc9d2696f2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:03:27.273145 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 633/1289] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 3 14:03:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 14:03:27.301368 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fe8e39-e775-4fb4-93c6-40292754d112 None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:03:27.402831 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fe8e39-e775-4fb4-93c6-40292754d112 None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:03:27.437250 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88af2b5-75b4-47b6-91de-f82801042fdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:03:27.438065 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88af2b5-75b4-47b6-91de-f82801042fdd None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:03:27.438346 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88af2b5-75b4-47b6-91de-f82801042fdd None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:03:27.438624 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88af2b5-75b4-47b6-91de-f82801042fdd None admin] PATH_INFO: `/v3/services/placement` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:03:27.439262 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88af2b5-75b4-47b6-91de-f82801042fdd None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:03:27.440634 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88af2b5-75b4-47b6-91de-f82801042fdd None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:03:27.452712 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application [None req-b88af2b5-75b4-47b6-91de-f82801042fdd None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 03 14:03:27.452712 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:03:27.452712 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 03 14:03:27.452712 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 03 14:03:27.452712 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 03 14:03:27.452712 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 03 14:03:27.452712 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 03 14:03:27.452712 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 14:03:27.452712 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 03 14:03:27.452712 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application May 03 14:03:27.452712 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 03 14:03:27.452712 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application May 03 14:03:27.452712 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:03:27.452712 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 14:03:27.452712 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 14:03:27.452712 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 14:03:27.452712 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 14:03:27.453934 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 14:03:27.453934 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 14:03:27.453934 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 14:03:27.453934 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 14:03:27.453934 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 14:03:27.453934 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 14:03:27.453934 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 03 14:03:27.453934 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._get_service(service_id) May 03 14:03:27.453934 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 03 14:03:27.453934 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 03 14:03:27.453934 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 14:03:27.453934 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 14:03:27.453934 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 14:03:27.453934 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 14:03:27.453934 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 14:03:27.453934 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.get_or_create( May 03 14:03:27.455108 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 14:03:27.455108 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application with Lock( May 03 14:03:27.455108 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 14:03:27.455108 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._enter() May 03 14:03:27.455108 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 14:03:27.455108 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 14:03:27.455108 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 14:03:27.455108 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.creator() May 03 14:03:27.455108 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 14:03:27.455108 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application created_value = creator( May 03 14:03:27.455108 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 03 14:03:27.455108 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 14:03:27.455108 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 03 14:03:27.455108 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application May 03 14:03:27.455108 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 657/1290] 10.222.0.36 () {56 vars in 1117 bytes} [Tue May 3 14:03:27 2022] GET /identity/v3/services/placement => generated 90 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 14:03:27.460472 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963d9bb0-2e16-448f-9d55-efc9d2696f2b None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:03:27.560676 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963d9bb0-2e16-448f-9d55-efc9d2696f2b None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:03:27.594416 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcf306e-b6c7-4987-8c33-0264c89bb304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:03:27.595061 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcf306e-b6c7-4987-8c33-0264c89bb304 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:03:27.595340 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcf306e-b6c7-4987-8c33-0264c89bb304 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:03:27.595614 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcf306e-b6c7-4987-8c33-0264c89bb304 None admin] PATH_INFO: `/v3/services` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:03:27.596315 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcf306e-b6c7-4987-8c33-0264c89bb304 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80012) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:03:27.596622 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcf306e-b6c7-4987-8c33-0264c89bb304 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:03:27.598001 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcf306e-b6c7-4987-8c33-0264c89bb304 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:03:27.602947 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 634/1291] 10.222.0.36 () {56 vars in 1116 bytes} [Tue May 3 14:03:27 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:03:27.609459 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88af2b5-75b4-47b6-91de-f82801042fdd None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:03:27.728740 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88af2b5-75b4-47b6-91de-f82801042fdd None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:03:27.768034 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1843d53-ccfa-4d4a-a2e6-f3f367e04aea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:03:27.768834 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1843d53-ccfa-4d4a-a2e6-f3f367e04aea None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:03:27.769104 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1843d53-ccfa-4d4a-a2e6-f3f367e04aea None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:03:27.769404 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1843d53-ccfa-4d4a-a2e6-f3f367e04aea None admin] PATH_INFO: `/v3/services` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:03:27.770131 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1843d53-ccfa-4d4a-a2e6-f3f367e04aea None admin] RBAC: Adding query filter params (type=placement) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:03:27.770432 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1843d53-ccfa-4d4a-a2e6-f3f367e04aea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:03:27.771822 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1843d53-ccfa-4d4a-a2e6-f3f367e04aea None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:03:27.776147 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 658/1292] 10.222.0.36 () {56 vars in 1116 bytes} [Tue May 3 14:03:27 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:03:29.943918 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5dc2f3-55d5-4172-8f84-35cad3717fe1 None None] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:03:29.944481 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5dc2f3-55d5-4172-8f84-35cad3717fe1 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:03:29.944481 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5dc2f3-55d5-4172-8f84-35cad3717fe1 None None] PATH_INFO: `/` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:03:29.945900 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 635/1293] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 3 14:03:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 14:03:29.952102 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e3d21f-af54-42d4-a72c-3e884631d55f None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:03:29.952814 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e3d21f-af54-42d4-a72c-3e884631d55f None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:03:29.952962 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e3d21f-af54-42d4-a72c-3e884631d55f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:03:29.974264 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-c4e3d21f-af54-42d4-a72c-3e884631d55f None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:03:29.975463 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-c4e3d21f-af54-42d4-a72c-3e884631d55f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:03:30.049912 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 659/1294] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 3 14:03:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 14:03:30.074456 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5dc2f3-55d5-4172-8f84-35cad3717fe1 None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:03:30.176396 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5dc2f3-55d5-4172-8f84-35cad3717fe1 None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:03:30.209949 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dbdd79-0a02-4f2c-b80a-3d3f0496ba1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:03:30.210568 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dbdd79-0a02-4f2c-b80a-3d3f0496ba1d None admin] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:03:30.210933 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dbdd79-0a02-4f2c-b80a-3d3f0496ba1d None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:03:30.211213 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dbdd79-0a02-4f2c-b80a-3d3f0496ba1d None admin] PATH_INFO: `/v3/services` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:03:30.211922 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73dbdd79-0a02-4f2c-b80a-3d3f0496ba1d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:03:30.213615 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73dbdd79-0a02-4f2c-b80a-3d3f0496ba1d None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:03:30.229276 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 636/1295] 10.222.0.36 () {60 vars in 1141 bytes} [Tue May 3 14:03:30 2022] POST /identity/v3/services => generated 246 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 14:03:32.428675 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892f6bf5-aaf8-42e4-989b-ea7658cd047e None None] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:03:32.429915 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892f6bf5-aaf8-42e4-989b-ea7658cd047e None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:03:32.429915 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892f6bf5-aaf8-42e4-989b-ea7658cd047e None None] PATH_INFO: `/` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:03:32.431740 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 660/1296] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 3 14:03:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 14:03:32.437143 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3631426-f4d3-4a78-a509-7d2a61ebef9d None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:03:32.437613 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3631426-f4d3-4a78-a509-7d2a61ebef9d None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:03:32.437726 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3631426-f4d3-4a78-a509-7d2a61ebef9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:03:32.461736 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-f3631426-f4d3-4a78-a509-7d2a61ebef9d None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:03:32.463223 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-f3631426-f4d3-4a78-a509-7d2a61ebef9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:03:32.537155 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 637/1297] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 3 14:03:32 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 03 14:03:32.573661 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892f6bf5-aaf8-42e4-989b-ea7658cd047e None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:03:32.696088 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892f6bf5-aaf8-42e4-989b-ea7658cd047e None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:03:32.738685 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f487b78-49ab-4b1e-b4bf-856685222571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:03:32.739860 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f487b78-49ab-4b1e-b4bf-856685222571 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:03:32.740147 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f487b78-49ab-4b1e-b4bf-856685222571 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:03:32.740573 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f487b78-49ab-4b1e-b4bf-856685222571 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:03:32.741577 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f487b78-49ab-4b1e-b4bf-856685222571 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:03:32.743268 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f487b78-49ab-4b1e-b4bf-856685222571 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:03:32.759996 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application [None req-2f487b78-49ab-4b1e-b4bf-856685222571 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 03 14:03:32.759996 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:03:32.759996 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 03 14:03:32.759996 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 03 14:03:32.759996 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 03 14:03:32.759996 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 03 14:03:32.759996 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 03 14:03:32.759996 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 14:03:32.759996 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 03 14:03:32.759996 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application May 03 14:03:32.759996 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 03 14:03:32.759996 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application May 03 14:03:32.759996 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:03:32.759996 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 14:03:32.759996 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 14:03:32.759996 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 14:03:32.759996 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 14:03:32.761196 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 14:03:32.761196 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 14:03:32.761196 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 14:03:32.761196 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 14:03:32.761196 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 14:03:32.761196 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 14:03:32.761196 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 03 14:03:32.761196 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._get_service(service_id) May 03 14:03:32.761196 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 03 14:03:32.761196 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 03 14:03:32.761196 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 14:03:32.761196 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 14:03:32.761196 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 14:03:32.761196 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 14:03:32.761196 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 14:03:32.761196 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.get_or_create( May 03 14:03:32.762236 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 14:03:32.762236 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application with Lock( May 03 14:03:32.762236 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 14:03:32.762236 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._enter() May 03 14:03:32.762236 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 14:03:32.762236 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 14:03:32.762236 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 14:03:32.762236 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.creator() May 03 14:03:32.762236 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 14:03:32.762236 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application created_value = creator( May 03 14:03:32.762236 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 03 14:03:32.762236 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 14:03:32.762236 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 03 14:03:32.762236 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application May 03 14:03:32.762236 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 661/1298] 10.222.0.36 () {56 vars in 1117 bytes} [Tue May 3 14:03:32 2022] GET /identity/v3/services/placement => generated 90 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 14:03:32.767295 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3631426-f4d3-4a78-a509-7d2a61ebef9d None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:03:32.870224 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3631426-f4d3-4a78-a509-7d2a61ebef9d None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:03:32.903454 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbbf543-09c1-44f4-b8bc-afcf0d8e3339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:03:32.904101 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbbf543-09c1-44f4-b8bc-afcf0d8e3339 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:03:32.904376 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbbf543-09c1-44f4-b8bc-afcf0d8e3339 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:03:32.904649 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbbf543-09c1-44f4-b8bc-afcf0d8e3339 None admin] PATH_INFO: `/v3/services` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:03:32.905354 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbbf543-09c1-44f4-b8bc-afcf0d8e3339 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80012) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:03:32.905656 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbbf543-09c1-44f4-b8bc-afcf0d8e3339 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:03:32.907025 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbbf543-09c1-44f4-b8bc-afcf0d8e3339 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:03:32.912025 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 638/1299] 10.222.0.36 () {56 vars in 1116 bytes} [Tue May 3 14:03:32 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:03:32.919110 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f487b78-49ab-4b1e-b4bf-856685222571 None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:03:33.024504 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f487b78-49ab-4b1e-b4bf-856685222571 None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:03:33.057327 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae5d304-6179-41dd-93f9-f1295d2425b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:03:33.058004 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae5d304-6179-41dd-93f9-f1295d2425b0 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:03:33.058276 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae5d304-6179-41dd-93f9-f1295d2425b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:03:33.058546 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae5d304-6179-41dd-93f9-f1295d2425b0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:03:33.059328 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae5d304-6179-41dd-93f9-f1295d2425b0 None admin] RBAC: Adding query filter params (interface=public, service_id=3a31442cc6084e79816538fb7ee2cafd, region_id=RegionOne) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:03:33.059635 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae5d304-6179-41dd-93f9-f1295d2425b0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:03:33.060990 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae5d304-6179-41dd-93f9-f1295d2425b0 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:03:33.067379 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 662/1300] 10.222.0.36 () {56 vars in 1251 bytes} [Tue May 3 14:03:32 2022] GET /identity/v3/endpoints?service_id=3a31442cc6084e79816538fb7ee2cafd&interface=public®ion_id=RegionOne => generated 194 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:03:33.073969 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbbf543-09c1-44f4-b8bc-afcf0d8e3339 None admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:03:33.177121 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbbf543-09c1-44f4-b8bc-afcf0d8e3339 None admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:03:33.210443 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38936378-8820-48ae-87a3-0cd8dfdf61e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:03:33.211096 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38936378-8820-48ae-87a3-0cd8dfdf61e0 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:03:33.211373 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38936378-8820-48ae-87a3-0cd8dfdf61e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:03:33.211639 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38936378-8820-48ae-87a3-0cd8dfdf61e0 None admin] PATH_INFO: `/v3/services` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:03:33.212314 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38936378-8820-48ae-87a3-0cd8dfdf61e0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:03:33.214012 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38936378-8820-48ae-87a3-0cd8dfdf61e0 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:03:33.220601 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 639/1301] 10.222.0.36 () {56 vars in 1087 bytes} [Tue May 3 14:03:33 2022] GET /identity/v3/services => generated 2191 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 14:03:35.425408 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8edcfd-f8fe-4515-a51a-62d70b7bb11f None None] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:03:35.425943 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8edcfd-f8fe-4515-a51a-62d70b7bb11f None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:03:35.425943 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8edcfd-f8fe-4515-a51a-62d70b7bb11f None None] PATH_INFO: `/` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:03:35.427932 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 663/1302] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 3 14:03:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 14:03:35.436017 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78889413-e463-461e-a7e9-c063576f5c40 None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:03:35.436403 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78889413-e463-461e-a7e9-c063576f5c40 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:03:35.436570 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78889413-e463-461e-a7e9-c063576f5c40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:03:35.453675 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-78889413-e463-461e-a7e9-c063576f5c40 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:03:35.454847 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-78889413-e463-461e-a7e9-c063576f5c40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:03:35.526317 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 640/1303] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 3 14:03:35 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 14:03:35.553558 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8edcfd-f8fe-4515-a51a-62d70b7bb11f None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:03:35.653882 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8edcfd-f8fe-4515-a51a-62d70b7bb11f None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:03:35.693418 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389f3569-ed71-4513-afaa-01a6ee88c044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:03:35.694545 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389f3569-ed71-4513-afaa-01a6ee88c044 None admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:03:35.694998 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389f3569-ed71-4513-afaa-01a6ee88c044 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:03:35.695477 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389f3569-ed71-4513-afaa-01a6ee88c044 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:03:35.696129 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389f3569-ed71-4513-afaa-01a6ee88c044 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:03:35.697529 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389f3569-ed71-4513-afaa-01a6ee88c044 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:03:35.709685 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application [None req-389f3569-ed71-4513-afaa-01a6ee88c044 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 03 14:03:35.709685 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:03:35.709685 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 03 14:03:35.709685 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 03 14:03:35.709685 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 03 14:03:35.709685 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 03 14:03:35.709685 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 03 14:03:35.709685 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 14:03:35.709685 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 03 14:03:35.709685 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application May 03 14:03:35.709685 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 03 14:03:35.709685 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application May 03 14:03:35.709685 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 14:03:35.709685 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 14:03:35.709685 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 14:03:35.709685 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 14:03:35.709685 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 14:03:35.710905 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 14:03:35.710905 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 14:03:35.710905 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 14:03:35.710905 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 14:03:35.710905 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 14:03:35.710905 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 14:03:35.710905 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 03 14:03:35.710905 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._get_service(service_id) May 03 14:03:35.710905 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 03 14:03:35.710905 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 03 14:03:35.710905 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 14:03:35.710905 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 14:03:35.710905 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 14:03:35.710905 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 14:03:35.710905 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 14:03:35.710905 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.get_or_create( May 03 14:03:35.712165 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 14:03:35.712165 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application with Lock( May 03 14:03:35.712165 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 14:03:35.712165 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self._enter() May 03 14:03:35.712165 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 14:03:35.712165 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 14:03:35.712165 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 14:03:35.712165 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application return self.creator() May 03 14:03:35.712165 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 14:03:35.712165 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application created_value = creator( May 03 14:03:35.712165 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 03 14:03:35.712165 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 14:03:35.712165 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 03 14:03:35.712165 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: ERROR keystone.server.flask.application May 03 14:03:35.712165 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 664/1304] 10.222.0.36 () {56 vars in 1117 bytes} [Tue May 3 14:03:35 2022] GET /identity/v3/services/placement => generated 90 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 14:03:35.717549 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78889413-e463-461e-a7e9-c063576f5c40 None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:03:35.819461 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78889413-e463-461e-a7e9-c063576f5c40 None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:03:35.856990 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575ef34f-ba0a-4070-90f9-7f055dbb7547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:03:35.857677 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575ef34f-ba0a-4070-90f9-7f055dbb7547 None admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:03:35.857958 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575ef34f-ba0a-4070-90f9-7f055dbb7547 None admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:03:35.858233 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575ef34f-ba0a-4070-90f9-7f055dbb7547 None admin] PATH_INFO: `/v3/services` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:03:35.858943 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575ef34f-ba0a-4070-90f9-7f055dbb7547 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80012) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:03:35.859245 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575ef34f-ba0a-4070-90f9-7f055dbb7547 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:03:35.860609 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575ef34f-ba0a-4070-90f9-7f055dbb7547 None admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:03:35.865641 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 641/1305] 10.222.0.36 () {56 vars in 1116 bytes} [Tue May 3 14:03:35 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:03:35.874605 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389f3569-ed71-4513-afaa-01a6ee88c044 None admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:03:35.980175 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389f3569-ed71-4513-afaa-01a6ee88c044 None admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:03:36.014217 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89574ca8-f039-44e1-8a25-2eb2c61df980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:03:36.014862 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89574ca8-f039-44e1-8a25-2eb2c61df980 None admin] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:03:36.015141 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89574ca8-f039-44e1-8a25-2eb2c61df980 None admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:03:36.015416 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89574ca8-f039-44e1-8a25-2eb2c61df980 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:03:36.016160 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89574ca8-f039-44e1-8a25-2eb2c61df980 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:03:36.017545 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89574ca8-f039-44e1-8a25-2eb2c61df980 None admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:03:36.042484 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 665/1306] 10.222.0.36 () {60 vars in 1144 bytes} [Tue May 3 14:03:35 2022] POST /identity/v3/endpoints => generated 331 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 14:04:39.565011 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c410a9-6059-4e21-a4d2-a66f6ad0a347 None None] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:04:39.566010 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c410a9-6059-4e21-a4d2-a66f6ad0a347 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:04:39.566509 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c410a9-6059-4e21-a4d2-a66f6ad0a347 None None] PATH_INFO: `/` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:04:39.573844 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89793a6b-4dac-49a1-a61b-cd89610d2a55 None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:04:39.574765 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89793a6b-4dac-49a1-a61b-cd89610d2a55 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:04:39.575272 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89793a6b-4dac-49a1-a61b-cd89610d2a55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:04:39.578765 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 642/1307] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 3 14:04:39 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 14:04:39.651764 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-89793a6b-4dac-49a1-a61b-cd89610d2a55 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:04:39.653638 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-89793a6b-4dac-49a1-a61b-cd89610d2a55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:04:39.821384 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 666/1308] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 3 14:04:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:04:39.879675 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93244b8f-cb36-4b8e-9d73-87c4acbac600 None None] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:04:39.880155 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93244b8f-cb36-4b8e-9d73-87c4acbac600 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:04:39.880677 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93244b8f-cb36-4b8e-9d73-87c4acbac600 None None] PATH_INFO: `/` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:04:39.883299 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 643/1309] 10.222.0.36 () {54 vars in 964 bytes} [Tue May 3 14:04:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 14:04:39.889200 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ebf37b-002f-4e8d-8f0f-e660e6d1a5ce None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:04:39.889518 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ebf37b-002f-4e8d-8f0f-e660e6d1a5ce None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:04:39.889796 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ebf37b-002f-4e8d-8f0f-e660e6d1a5ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:04:40.071892 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-f6ebf37b-002f-4e8d-8f0f-e660e6d1a5ce None None] MFA Rules not processed for user `937bea4f355144b4a7ee11baabc3a4cb`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:04:40.075187 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-f6ebf37b-002f-4e8d-8f0f-e660e6d1a5ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:04:40.261140 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 667/1310] 10.222.0.36 () {58 vars in 1061 bytes} [Tue May 3 14:04:39 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 373 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:04:40.270028 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93244b8f-cb36-4b8e-9d73-87c4acbac600 None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:04:40.271819 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-93244b8f-cb36-4b8e-9d73-87c4acbac600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:04:40.439593 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93244b8f-cb36-4b8e-9d73-87c4acbac600 None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:04:40.518671 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b5a2dd-275e-4a16-a42f-f3aa3a543586 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '937bea4f355144b4a7ee11baabc3a4cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:04:40.519326 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b5a2dd-275e-4a16-a42f-f3aa3a543586 service neutron] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:04:40.519637 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b5a2dd-275e-4a16-a42f-f3aa3a543586 service neutron] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:04:40.520082 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b5a2dd-275e-4a16-a42f-f3aa3a543586 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:04:40.522165 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-e6b5a2dd-275e-4a16-a42f-f3aa3a543586 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:04:40.634287 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b5a2dd-275e-4a16-a42f-f3aa3a543586 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:04:40.636502 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b5a2dd-275e-4a16-a42f-f3aa3a543586 service neutron] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:04:40.669601 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 644/1311] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:04:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 14:04:43.203610 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10876a1b-f196-4928-9c8f-3d0406488109 None None] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:04:43.204208 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10876a1b-f196-4928-9c8f-3d0406488109 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:04:43.204208 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10876a1b-f196-4928-9c8f-3d0406488109 None None] PATH_INFO: `/` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:04:43.205593 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 668/1312] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 3 14:04:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 14:04:43.211142 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ab9e29-6439-4e13-946c-8e159901bca0 None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:04:43.211668 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ab9e29-6439-4e13-946c-8e159901bca0 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:04:43.211668 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ab9e29-6439-4e13-946c-8e159901bca0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:04:43.291863 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-21ab9e29-6439-4e13-946c-8e159901bca0 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:04:43.293062 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-21ab9e29-6439-4e13-946c-8e159901bca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:04:43.395037 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 645/1313] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 3 14:04:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:04:43.433550 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10876a1b-f196-4928-9c8f-3d0406488109 None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:04:43.435192 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-10876a1b-f196-4928-9c8f-3d0406488109 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:04:43.545984 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10876a1b-f196-4928-9c8f-3d0406488109 None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:04:43.621183 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bbd0d2-3e43-4ff6-a34c-9bfcf7bfe3ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '937bea4f355144b4a7ee11baabc3a4cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:04:43.621869 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bbd0d2-3e43-4ff6-a34c-9bfcf7bfe3ce service neutron] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:04:43.622146 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bbd0d2-3e43-4ff6-a34c-9bfcf7bfe3ce service neutron] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:04:43.622413 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bbd0d2-3e43-4ff6-a34c-9bfcf7bfe3ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:04:43.624127 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-b6bbd0d2-3e43-4ff6-a34c-9bfcf7bfe3ce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:04:43.734115 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bbd0d2-3e43-4ff6-a34c-9bfcf7bfe3ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:04:43.735582 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bbd0d2-3e43-4ff6-a34c-9bfcf7bfe3ce service neutron] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:04:43.754194 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 669/1314] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:04:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 14:04:46.259697 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101769da-f5c4-4023-8dc1-5553819f8fed None None] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:04:46.260319 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101769da-f5c4-4023-8dc1-5553819f8fed None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:04:46.260319 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101769da-f5c4-4023-8dc1-5553819f8fed None None] PATH_INFO: `/` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:04:46.261651 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 646/1315] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 3 14:04:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 14:04:46.267818 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295ecd43-43d1-48e4-ac98-ca6430eeff56 None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:04:46.268567 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295ecd43-43d1-48e4-ac98-ca6430eeff56 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:04:46.268707 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295ecd43-43d1-48e4-ac98-ca6430eeff56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:04:46.342950 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-295ecd43-43d1-48e4-ac98-ca6430eeff56 None None] MFA Rules not processed for user `e9f93aa2136e485ab8827ada190d87ce`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:04:46.344094 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-295ecd43-43d1-48e4-ac98-ca6430eeff56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:04:46.447503 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 670/1316] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 3 14:04:46 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:04:46.494626 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101769da-f5c4-4023-8dc1-5553819f8fed None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:04:46.496207 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-101769da-f5c4-4023-8dc1-5553819f8fed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:04:46.602432 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101769da-f5c4-4023-8dc1-5553819f8fed None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:04:46.676935 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d81b48-91c5-4fac-9afd-0762738fcaff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '937bea4f355144b4a7ee11baabc3a4cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:04:46.677645 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d81b48-91c5-4fac-9afd-0762738fcaff service neutron] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:04:46.677930 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d81b48-91c5-4fac-9afd-0762738fcaff service neutron] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:04:46.678199 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d81b48-91c5-4fac-9afd-0762738fcaff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:04:46.679841 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-85d81b48-91c5-4fac-9afd-0762738fcaff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:04:46.786098 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d81b48-91c5-4fac-9afd-0762738fcaff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:04:46.787933 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d81b48-91c5-4fac-9afd-0762738fcaff service neutron] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:04:46.805901 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 647/1317] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:04:46 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 14:04:49.562346 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c67b44b-05ad-440c-9551-9c360ca2e49d None None] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:04:49.563212 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c67b44b-05ad-440c-9551-9c360ca2e49d None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:04:49.563212 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c67b44b-05ad-440c-9551-9c360ca2e49d None None] PATH_INFO: `/` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:04:49.565463 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 671/1318] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 3 14:04:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 14:04:49.570764 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8093ce15-dac9-4c46-aa7f-7cad021a81db None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:04:49.571198 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8093ce15-dac9-4c46-aa7f-7cad021a81db None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:04:49.571293 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8093ce15-dac9-4c46-aa7f-7cad021a81db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:04:49.644355 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-8093ce15-dac9-4c46-aa7f-7cad021a81db None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:04:49.645590 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-8093ce15-dac9-4c46-aa7f-7cad021a81db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:04:49.753864 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 648/1319] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 3 14:04:49 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:04:49.795425 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c67b44b-05ad-440c-9551-9c360ca2e49d None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:04:49.797944 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-4c67b44b-05ad-440c-9551-9c360ca2e49d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:04:49.916096 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c67b44b-05ad-440c-9551-9c360ca2e49d None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:04:49.988797 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b14b29a-a44c-4333-bdb3-c46da74a3342 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '937bea4f355144b4a7ee11baabc3a4cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:04:49.989469 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b14b29a-a44c-4333-bdb3-c46da74a3342 service neutron] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:04:49.989777 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b14b29a-a44c-4333-bdb3-c46da74a3342 service neutron] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:04:49.990025 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b14b29a-a44c-4333-bdb3-c46da74a3342 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:04:49.991675 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-8b14b29a-a44c-4333-bdb3-c46da74a3342 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:04:50.103883 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b14b29a-a44c-4333-bdb3-c46da74a3342 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:04:50.105333 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b14b29a-a44c-4333-bdb3-c46da74a3342 service neutron] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:04:50.124427 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 672/1320] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:04:49 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 14:04:53.017912 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324aa413-82f9-461f-a240-f84bab436c21 None None] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:04:53.018483 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324aa413-82f9-461f-a240-f84bab436c21 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:04:53.018483 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324aa413-82f9-461f-a240-f84bab436c21 None None] PATH_INFO: `/` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:04:53.020002 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 649/1321] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 3 14:04:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 14:04:53.025237 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492f24c5-0ff5-4c53-870b-d4c622af3c61 None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:04:53.025685 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492f24c5-0ff5-4c53-870b-d4c622af3c61 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:04:53.025798 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492f24c5-0ff5-4c53-870b-d4c622af3c61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:04:53.091205 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-492f24c5-0ff5-4c53-870b-d4c622af3c61 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:04:53.092405 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-492f24c5-0ff5-4c53-870b-d4c622af3c61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:04:53.187009 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 673/1322] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 3 14:04:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:04:53.238903 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16166ea0-9800-4a96-83e0-2d8027e99511 None None] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:04:53.239187 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16166ea0-9800-4a96-83e0-2d8027e99511 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:04:53.239497 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16166ea0-9800-4a96-83e0-2d8027e99511 None None] PATH_INFO: `/` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:04:53.241029 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 650/1323] 10.222.0.36 () {54 vars in 964 bytes} [Tue May 3 14:04:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 14:04:53.247386 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0941d7-624d-4238-9e88-24776dca2cac None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:04:53.247669 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0941d7-624d-4238-9e88-24776dca2cac None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:04:53.247959 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0941d7-624d-4238-9e88-24776dca2cac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:04:53.321777 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-ed0941d7-624d-4238-9e88-24776dca2cac None None] MFA Rules not processed for user `937bea4f355144b4a7ee11baabc3a4cb`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:04:53.322866 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-ed0941d7-624d-4238-9e88-24776dca2cac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:04:53.398137 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 674/1324] 10.222.0.36 () {58 vars in 1061 bytes} [Tue May 3 14:04:53 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:04:53.407063 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16166ea0-9800-4a96-83e0-2d8027e99511 None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:04:53.408594 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-16166ea0-9800-4a96-83e0-2d8027e99511 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:04:53.516935 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16166ea0-9800-4a96-83e0-2d8027e99511 None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:04:53.593642 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab3529b-cced-4a3d-8963-9f6e34f7f9a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '937bea4f355144b4a7ee11baabc3a4cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:04:53.594219 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab3529b-cced-4a3d-8963-9f6e34f7f9a5 service neutron] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:04:53.594504 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab3529b-cced-4a3d-8963-9f6e34f7f9a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:04:53.594779 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab3529b-cced-4a3d-8963-9f6e34f7f9a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:04:53.596421 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-5ab3529b-cced-4a3d-8963-9f6e34f7f9a5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:04:53.707232 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab3529b-cced-4a3d-8963-9f6e34f7f9a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:04:53.708963 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab3529b-cced-4a3d-8963-9f6e34f7f9a5 service neutron] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:04:53.727968 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 651/1325] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:04:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 14:04:56.260621 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fac9c2-e171-40ff-9716-98fc6b8f9bb6 None None] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:04:56.261216 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fac9c2-e171-40ff-9716-98fc6b8f9bb6 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:04:56.261216 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fac9c2-e171-40ff-9716-98fc6b8f9bb6 None None] PATH_INFO: `/` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:04:56.262567 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 675/1326] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 3 14:04:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 14:04:56.268264 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33165c03-ab57-4cf8-9460-be426ccd1abe None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:04:56.268717 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33165c03-ab57-4cf8-9460-be426ccd1abe None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:04:56.268824 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33165c03-ab57-4cf8-9460-be426ccd1abe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:04:56.334074 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-33165c03-ab57-4cf8-9460-be426ccd1abe None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:04:56.335223 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-33165c03-ab57-4cf8-9460-be426ccd1abe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:04:56.432174 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 652/1327] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 3 14:04:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:04:56.472229 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fac9c2-e171-40ff-9716-98fc6b8f9bb6 None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:04:56.473832 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-14fac9c2-e171-40ff-9716-98fc6b8f9bb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:04:56.578212 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fac9c2-e171-40ff-9716-98fc6b8f9bb6 None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:04:56.655973 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d73001-be7b-4070-83b9-318dfb45d3a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '937bea4f355144b4a7ee11baabc3a4cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:04:56.656536 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d73001-be7b-4070-83b9-318dfb45d3a5 service neutron] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:04:56.656817 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d73001-be7b-4070-83b9-318dfb45d3a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:04:56.657085 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d73001-be7b-4070-83b9-318dfb45d3a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:04:56.658746 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-f1d73001-be7b-4070-83b9-318dfb45d3a5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:04:56.774991 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d73001-be7b-4070-83b9-318dfb45d3a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:04:56.776439 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d73001-be7b-4070-83b9-318dfb45d3a5 service neutron] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:04:56.795427 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 676/1328] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:04:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 14:04:59.095386 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dbbf6a-74af-4117-9fad-4b7f20714ab0 None None] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:04:59.095937 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dbbf6a-74af-4117-9fad-4b7f20714ab0 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:04:59.095937 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dbbf6a-74af-4117-9fad-4b7f20714ab0 None None] PATH_INFO: `/` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:04:59.097323 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 653/1329] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 3 14:04:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 14:04:59.102789 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827168af-34d6-4317-bf76-29e24df70997 None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:04:59.103249 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827168af-34d6-4317-bf76-29e24df70997 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:04:59.103345 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827168af-34d6-4317-bf76-29e24df70997 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:04:59.170213 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-827168af-34d6-4317-bf76-29e24df70997 None None] MFA Rules not processed for user `e9f93aa2136e485ab8827ada190d87ce`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:04:59.171422 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-827168af-34d6-4317-bf76-29e24df70997 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:04:59.269754 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 677/1330] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 3 14:04:59 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:04:59.307180 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dbbf6a-74af-4117-9fad-4b7f20714ab0 None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:04:59.308749 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-83dbbf6a-74af-4117-9fad-4b7f20714ab0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:04:59.416870 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dbbf6a-74af-4117-9fad-4b7f20714ab0 None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:04:59.490723 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8be23c9-ee77-443f-97d9-99dfdfb0f7ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '937bea4f355144b4a7ee11baabc3a4cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:04:59.491478 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8be23c9-ee77-443f-97d9-99dfdfb0f7ca service neutron] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:04:59.491764 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8be23c9-ee77-443f-97d9-99dfdfb0f7ca service neutron] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:04:59.492043 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8be23c9-ee77-443f-97d9-99dfdfb0f7ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:04:59.493732 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-f8be23c9-ee77-443f-97d9-99dfdfb0f7ca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:04:59.603919 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8be23c9-ee77-443f-97d9-99dfdfb0f7ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:04:59.605393 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8be23c9-ee77-443f-97d9-99dfdfb0f7ca service neutron] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:04:59.625932 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 654/1331] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:04:59 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 14:05:02.261499 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35275289-8031-4626-9097-92c1af1f33c4 None None] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:05:02.262073 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35275289-8031-4626-9097-92c1af1f33c4 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:05:02.262073 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35275289-8031-4626-9097-92c1af1f33c4 None None] PATH_INFO: `/` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:05:02.263443 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 678/1332] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 3 14:05:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 14:05:02.268774 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02524fef-dd36-4537-85f0-eff1bbc39935 None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:05:02.269201 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02524fef-dd36-4537-85f0-eff1bbc39935 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:05:02.269433 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02524fef-dd36-4537-85f0-eff1bbc39935 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:05:02.337809 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-02524fef-dd36-4537-85f0-eff1bbc39935 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:05:02.339028 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-02524fef-dd36-4537-85f0-eff1bbc39935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:05:02.435993 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 655/1333] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 3 14:05:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:05:02.473727 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35275289-8031-4626-9097-92c1af1f33c4 None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:05:02.475806 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-35275289-8031-4626-9097-92c1af1f33c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:05:02.582822 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35275289-8031-4626-9097-92c1af1f33c4 None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:05:02.657691 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0add7e-e701-4796-8fa0-ec74d1cd2113 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '937bea4f355144b4a7ee11baabc3a4cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:05:02.658337 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0add7e-e701-4796-8fa0-ec74d1cd2113 service neutron] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:05:02.658586 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0add7e-e701-4796-8fa0-ec74d1cd2113 service neutron] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:05:02.658888 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0add7e-e701-4796-8fa0-ec74d1cd2113 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:05:02.660511 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-dc0add7e-e701-4796-8fa0-ec74d1cd2113 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:05:02.770415 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0add7e-e701-4796-8fa0-ec74d1cd2113 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:05:02.771886 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0add7e-e701-4796-8fa0-ec74d1cd2113 service neutron] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:05:02.790379 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 679/1334] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:05:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 14:05:05.067165 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973e2727-cbe6-4aa1-84f0-ced0ea93cf1f None None] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:05:05.067664 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973e2727-cbe6-4aa1-84f0-ced0ea93cf1f None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:05:05.067801 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973e2727-cbe6-4aa1-84f0-ced0ea93cf1f None None] PATH_INFO: `/` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:05:05.069194 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 656/1335] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 3 14:05:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 14:05:05.076527 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5565f9-3329-4e55-99da-739979d61682 None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:05:05.076997 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5565f9-3329-4e55-99da-739979d61682 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:05:05.077091 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5565f9-3329-4e55-99da-739979d61682 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:05:05.147839 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-be5565f9-3329-4e55-99da-739979d61682 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:05:05.149045 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-be5565f9-3329-4e55-99da-739979d61682 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:05:05.250195 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 680/1336] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 3 14:05:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 14:05:05.291653 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973e2727-cbe6-4aa1-84f0-ced0ea93cf1f None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:05:05.293176 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-973e2727-cbe6-4aa1-84f0-ced0ea93cf1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:05:05.411551 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973e2727-cbe6-4aa1-84f0-ced0ea93cf1f None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:05:05.486159 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73ac631-1ce2-4d58-8f61-393b27979998 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '937bea4f355144b4a7ee11baabc3a4cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:05:05.486805 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73ac631-1ce2-4d58-8f61-393b27979998 service neutron] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:05:05.487088 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73ac631-1ce2-4d58-8f61-393b27979998 service neutron] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:05:05.487361 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73ac631-1ce2-4d58-8f61-393b27979998 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:05:05.488990 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-b73ac631-1ce2-4d58-8f61-393b27979998 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:05:05.602047 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73ac631-1ce2-4d58-8f61-393b27979998 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:05:05.603470 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73ac631-1ce2-4d58-8f61-393b27979998 service neutron] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:05:05.621341 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 657/1337] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:05:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 14:05:08.296217 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a7fc8c-2663-427e-82c9-cab6e5f4c763 None None] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:05:08.297123 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a7fc8c-2663-427e-82c9-cab6e5f4c763 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:05:08.297123 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a7fc8c-2663-427e-82c9-cab6e5f4c763 None None] PATH_INFO: `/` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:05:08.299268 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 681/1338] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 3 14:05:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 14:05:08.304883 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6a0562-3e60-4730-8f91-69805ea646a4 None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:05:08.305344 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6a0562-3e60-4730-8f91-69805ea646a4 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:05:08.305471 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6a0562-3e60-4730-8f91-69805ea646a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:05:08.388381 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-2d6a0562-3e60-4730-8f91-69805ea646a4 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:05:08.389560 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-2d6a0562-3e60-4730-8f91-69805ea646a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:05:08.502295 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 658/1339] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 3 14:05:08 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:05:08.538491 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a7fc8c-2663-427e-82c9-cab6e5f4c763 None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:05:08.540847 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-d9a7fc8c-2663-427e-82c9-cab6e5f4c763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:05:08.672802 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a7fc8c-2663-427e-82c9-cab6e5f4c763 None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:05:08.749854 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15198294-3d7d-4af7-bbe8-9ec687287855 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '937bea4f355144b4a7ee11baabc3a4cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:05:08.750499 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15198294-3d7d-4af7-bbe8-9ec687287855 service neutron] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:05:08.750774 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15198294-3d7d-4af7-bbe8-9ec687287855 service neutron] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:05:08.751043 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15198294-3d7d-4af7-bbe8-9ec687287855 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:05:08.752679 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-15198294-3d7d-4af7-bbe8-9ec687287855 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:05:08.861658 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15198294-3d7d-4af7-bbe8-9ec687287855 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:05:08.863072 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15198294-3d7d-4af7-bbe8-9ec687287855 service neutron] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:05:08.880933 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 682/1340] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:05:08 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 14:05:13.195989 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1357ad6e-1e98-4f1d-bd68-2678d21adbf1 None None] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:05:13.196580 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1357ad6e-1e98-4f1d-bd68-2678d21adbf1 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:05:13.196580 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1357ad6e-1e98-4f1d-bd68-2678d21adbf1 None None] PATH_INFO: `/` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:05:13.197867 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 659/1341] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 3 14:05:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 14:05:13.203498 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab504b6-4aaf-423f-9a1e-a4026b1888cc None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:05:13.203962 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab504b6-4aaf-423f-9a1e-a4026b1888cc None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:05:13.204098 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab504b6-4aaf-423f-9a1e-a4026b1888cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:05:13.276339 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-1ab504b6-4aaf-423f-9a1e-a4026b1888cc None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:05:13.277546 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-1ab504b6-4aaf-423f-9a1e-a4026b1888cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:05:13.383711 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 683/1342] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 3 14:05:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:05:13.422009 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1357ad6e-1e98-4f1d-bd68-2678d21adbf1 None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:05:13.424489 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-1357ad6e-1e98-4f1d-bd68-2678d21adbf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:05:13.521846 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1357ad6e-1e98-4f1d-bd68-2678d21adbf1 None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:05:13.526386 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292240fb-2867-4ed6-ba71-b04541d4e2c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '937bea4f355144b4a7ee11baabc3a4cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:05:13.527036 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292240fb-2867-4ed6-ba71-b04541d4e2c7 service neutron] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:05:13.527312 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292240fb-2867-4ed6-ba71-b04541d4e2c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:05:13.527581 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292240fb-2867-4ed6-ba71-b04541d4e2c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:05:13.537560 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292240fb-2867-4ed6-ba71-b04541d4e2c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:05:13.538984 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292240fb-2867-4ed6-ba71-b04541d4e2c7 service neutron] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:05:13.548335 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 660/1343] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:05:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 14:05:16.340217 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39e8941-9c2b-475a-b6f4-54c194b814cf None None] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:05:16.340790 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39e8941-9c2b-475a-b6f4-54c194b814cf None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:05:16.340790 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39e8941-9c2b-475a-b6f4-54c194b814cf None None] PATH_INFO: `/` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:05:16.342222 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 684/1344] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 3 14:05:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 14:05:16.347349 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e056f9e2-2fec-43dd-8ecc-8e64f1d798a2 None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:05:16.347819 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e056f9e2-2fec-43dd-8ecc-8e64f1d798a2 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:05:16.347909 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e056f9e2-2fec-43dd-8ecc-8e64f1d798a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:05:16.375496 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-e056f9e2-2fec-43dd-8ecc-8e64f1d798a2 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:05:16.376693 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-e056f9e2-2fec-43dd-8ecc-8e64f1d798a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:05:16.452459 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 661/1345] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 3 14:05:16 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:05:16.489266 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39e8941-9c2b-475a-b6f4-54c194b814cf None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:05:16.491272 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-b39e8941-9c2b-475a-b6f4-54c194b814cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:05:16.504371 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39e8941-9c2b-475a-b6f4-54c194b814cf None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:05:16.508364 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cf81ca-0ca5-4b07-88f2-34ac3f788a4e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '937bea4f355144b4a7ee11baabc3a4cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:05:16.508992 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cf81ca-0ca5-4b07-88f2-34ac3f788a4e service neutron] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:05:16.509266 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cf81ca-0ca5-4b07-88f2-34ac3f788a4e service neutron] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:05:16.509561 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cf81ca-0ca5-4b07-88f2-34ac3f788a4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:05:16.518715 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cf81ca-0ca5-4b07-88f2-34ac3f788a4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:05:16.520146 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cf81ca-0ca5-4b07-88f2-34ac3f788a4e service neutron] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:05:16.530119 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 685/1346] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:05:16 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 14:05:21.066376 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef4264e-6d59-45bc-a109-7934483c7eba None None] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:05:21.066376 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef4264e-6d59-45bc-a109-7934483c7eba None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:05:21.066847 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef4264e-6d59-45bc-a109-7934483c7eba None None] PATH_INFO: `/` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:05:21.068456 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 662/1347] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 3 14:05:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 14:05:21.073791 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893c0b31-cc16-4a6f-8557-26e1becda38e None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:05:21.074242 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893c0b31-cc16-4a6f-8557-26e1becda38e None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:05:21.074347 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893c0b31-cc16-4a6f-8557-26e1becda38e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:05:21.094561 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-893c0b31-cc16-4a6f-8557-26e1becda38e None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:05:21.095769 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-893c0b31-cc16-4a6f-8557-26e1becda38e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:05:21.105499 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 686/1348] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 3 14:05:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:05:21.143006 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef4264e-6d59-45bc-a109-7934483c7eba None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:05:21.154294 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef4264e-6d59-45bc-a109-7934483c7eba None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:05:21.157713 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8d64e3-d4f5-438a-9e77-19dedd0a0b18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '937bea4f355144b4a7ee11baabc3a4cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:05:21.158350 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8d64e3-d4f5-438a-9e77-19dedd0a0b18 service neutron] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:05:21.158629 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8d64e3-d4f5-438a-9e77-19dedd0a0b18 service neutron] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:05:21.158904 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8d64e3-d4f5-438a-9e77-19dedd0a0b18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:05:21.167993 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8d64e3-d4f5-438a-9e77-19dedd0a0b18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:05:21.169443 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8d64e3-d4f5-438a-9e77-19dedd0a0b18 service neutron] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:05:21.179186 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 663/1349] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:05:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 14:05:26.555107 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afff2a6-e127-4e92-a624-6bff39842810 None None] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:05:26.555979 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afff2a6-e127-4e92-a624-6bff39842810 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:05:26.556409 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afff2a6-e127-4e92-a624-6bff39842810 None None] PATH_INFO: `/` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:05:26.557972 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 687/1350] 10.222.0.36 () {54 vars in 921 bytes} [Tue May 3 14:05:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 14:05:26.563109 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79430ae7-c520-44fc-b6dd-e1cc55e1bac6 None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:05:26.563868 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79430ae7-c520-44fc-b6dd-e1cc55e1bac6 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:05:26.564319 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79430ae7-c520-44fc-b6dd-e1cc55e1bac6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:05:26.640424 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-79430ae7-c520-44fc-b6dd-e1cc55e1bac6 None None] MFA Rules not processed for user `164c7f36acf644e9bf93f158e876e9e3`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:05:26.642058 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-79430ae7-c520-44fc-b6dd-e1cc55e1bac6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:05:26.729236 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 664/1351] 10.222.0.36 () {58 vars in 1018 bytes} [Tue May 3 14:05:26 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 14:05:30.817460 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b043ab6-db36-4316-825c-239c4afdf979 None None] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:05:30.818027 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b043ab6-db36-4316-825c-239c4afdf979 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:05:30.818337 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b043ab6-db36-4316-825c-239c4afdf979 None None] PATH_INFO: `/` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:05:30.820430 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 688/1352] 10.222.0.36 () {54 vars in 921 bytes} [Tue May 3 14:05:30 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 14:05:30.825331 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af358ca-fbe6-449d-b9ad-9987c5533890 None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:05:30.825747 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af358ca-fbe6-449d-b9ad-9987c5533890 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:05:30.826121 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af358ca-fbe6-449d-b9ad-9987c5533890 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:05:30.845722 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-1af358ca-fbe6-449d-b9ad-9987c5533890 None None] MFA Rules not processed for user `164c7f36acf644e9bf93f158e876e9e3`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:05:30.847008 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-1af358ca-fbe6-449d-b9ad-9987c5533890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:05:30.855940 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 665/1353] 10.222.0.36 () {58 vars in 1018 bytes} [Tue May 3 14:05:30 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:05:32.338755 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb2f155-3657-460d-95fe-426f24e240db None None] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:05:32.339307 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb2f155-3657-460d-95fe-426f24e240db None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:05:32.339307 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb2f155-3657-460d-95fe-426f24e240db None None] PATH_INFO: `/` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:05:32.340707 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 689/1354] 10.222.0.36 () {54 vars in 921 bytes} [Tue May 3 14:05:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 14:05:32.345811 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db47c734-7c58-4280-b06b-9ac67911ffc2 None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:05:32.346225 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db47c734-7c58-4280-b06b-9ac67911ffc2 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:05:32.346368 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db47c734-7c58-4280-b06b-9ac67911ffc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:05:32.364845 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-db47c734-7c58-4280-b06b-9ac67911ffc2 None None] MFA Rules not processed for user `164c7f36acf644e9bf93f158e876e9e3`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:05:32.366072 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-db47c734-7c58-4280-b06b-9ac67911ffc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:05:32.375160 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 666/1355] 10.222.0.36 () {58 vars in 1018 bytes} [Tue May 3 14:05:32 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:05:36.335400 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a351984c-192f-4d01-ae6d-36bd075c58af None None] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:05:36.336372 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a351984c-192f-4d01-ae6d-36bd075c58af None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:05:36.336660 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a351984c-192f-4d01-ae6d-36bd075c58af None None] PATH_INFO: `/` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:05:36.338505 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 690/1356] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 3 14:05:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 14:05:36.343751 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8f738c-61ab-4a1b-96c3-94327131005f None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:05:36.344200 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8f738c-61ab-4a1b-96c3-94327131005f None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:05:36.344490 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8f738c-61ab-4a1b-96c3-94327131005f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:05:36.365934 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-ac8f738c-61ab-4a1b-96c3-94327131005f None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:05:36.367369 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-ac8f738c-61ab-4a1b-96c3-94327131005f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:05:36.376969 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 667/1357] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 3 14:05:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:05:36.423819 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0021e83f-d37e-43bd-9529-9bd0907ee7d0 None None] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:05:36.424482 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0021e83f-d37e-43bd-9529-9bd0907ee7d0 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:05:36.424833 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0021e83f-d37e-43bd-9529-9bd0907ee7d0 None None] PATH_INFO: `/` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:05:36.426584 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 691/1358] 10.222.0.36 () {54 vars in 960 bytes} [Tue May 3 14:05:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 14:05:36.445143 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df973665-1476-4ce2-a8ad-3e90d1b93745 None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:05:36.447432 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df973665-1476-4ce2-a8ad-3e90d1b93745 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:05:36.447895 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df973665-1476-4ce2-a8ad-3e90d1b93745 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:05:36.498467 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-df973665-1476-4ce2-a8ad-3e90d1b93745 None None] MFA Rules not processed for user `63489e658c094a2598a2ac62159d2fda`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:05:36.499718 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-df973665-1476-4ce2-a8ad-3e90d1b93745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:05:36.586637 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 668/1359] 10.222.0.36 () {58 vars in 1057 bytes} [Tue May 3 14:05:36 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:05:36.595427 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0021e83f-d37e-43bd-9529-9bd0907ee7d0 None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:05:36.610896 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0021e83f-d37e-43bd-9529-9bd0907ee7d0 None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:05:36.616651 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a67b7c6-2333-494e-b311-de762f2dea4d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63489e658c094a2598a2ac62159d2fda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:05:36.617331 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a67b7c6-2333-494e-b311-de762f2dea4d service nova] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:05:36.617585 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a67b7c6-2333-494e-b311-de762f2dea4d service nova] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:05:36.618052 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a67b7c6-2333-494e-b311-de762f2dea4d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:05:36.644064 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a67b7c6-2333-494e-b311-de762f2dea4d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:05:36.646846 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a67b7c6-2333-494e-b311-de762f2dea4d service nova] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:05:36.658643 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 692/1360] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:05:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 14:05:39.122662 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398b7abb-d60d-45a8-9963-17b7057505b9 None None] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:05:39.123206 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398b7abb-d60d-45a8-9963-17b7057505b9 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:05:39.123206 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398b7abb-d60d-45a8-9963-17b7057505b9 None None] PATH_INFO: `/` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:05:39.124547 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 669/1361] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 3 14:05:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 14:05:39.130163 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a66349-c056-4213-84ad-63c99022e9b8 None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:05:39.130619 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a66349-c056-4213-84ad-63c99022e9b8 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:05:39.130703 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a66349-c056-4213-84ad-63c99022e9b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:05:39.148356 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-f5a66349-c056-4213-84ad-63c99022e9b8 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:05:39.149887 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-f5a66349-c056-4213-84ad-63c99022e9b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:05:39.157890 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 693/1362] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 3 14:05:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:05:39.200946 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398b7abb-d60d-45a8-9963-17b7057505b9 None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:05:39.219375 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398b7abb-d60d-45a8-9963-17b7057505b9 None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:05:39.227116 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3b272f-3a6b-489a-b3df-0df3acef0a67 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63489e658c094a2598a2ac62159d2fda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:05:39.227931 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3b272f-3a6b-489a-b3df-0df3acef0a67 service nova] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:05:39.228274 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3b272f-3a6b-489a-b3df-0df3acef0a67 service nova] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:05:39.228613 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3b272f-3a6b-489a-b3df-0df3acef0a67 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:05:39.237747 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3b272f-3a6b-489a-b3df-0df3acef0a67 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:05:39.239492 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3b272f-3a6b-489a-b3df-0df3acef0a67 service nova] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:05:39.250591 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 670/1363] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:05:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 14:05:41.784840 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2bb93a-7dbf-4ccb-9bce-5fa1ede2e075 None None] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:05:41.785498 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2bb93a-7dbf-4ccb-9bce-5fa1ede2e075 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:05:41.785685 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2bb93a-7dbf-4ccb-9bce-5fa1ede2e075 None None] PATH_INFO: `/` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:05:41.787223 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 694/1364] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 3 14:05:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 14:05:41.792185 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f3102f-8775-4f33-bb7b-eb89c34e8cfd None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:05:41.792591 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f3102f-8775-4f33-bb7b-eb89c34e8cfd None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:05:41.792747 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f3102f-8775-4f33-bb7b-eb89c34e8cfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:05:41.810745 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-a2f3102f-8775-4f33-bb7b-eb89c34e8cfd None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:05:41.811936 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-a2f3102f-8775-4f33-bb7b-eb89c34e8cfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:05:41.820976 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 671/1365] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 3 14:05:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:05:41.866554 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa5ca5c-cf7f-4947-8308-c8827de0fd65 None None] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:05:41.866916 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa5ca5c-cf7f-4947-8308-c8827de0fd65 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:05:41.867260 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa5ca5c-cf7f-4947-8308-c8827de0fd65 None None] PATH_INFO: `/` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:05:41.868793 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 695/1366] 10.222.0.36 () {54 vars in 960 bytes} [Tue May 3 14:05:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 14:05:41.874071 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42644636-7b85-4e69-81f1-132026a38659 None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:05:41.874358 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42644636-7b85-4e69-81f1-132026a38659 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:05:41.874631 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42644636-7b85-4e69-81f1-132026a38659 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:05:41.893013 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-42644636-7b85-4e69-81f1-132026a38659 None None] MFA Rules not processed for user `63489e658c094a2598a2ac62159d2fda`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:05:41.894198 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-42644636-7b85-4e69-81f1-132026a38659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:05:41.904357 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 672/1367] 10.222.0.36 () {58 vars in 1057 bytes} [Tue May 3 14:05:41 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 14:05:41.912242 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa5ca5c-cf7f-4947-8308-c8827de0fd65 None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:05:41.928980 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa5ca5c-cf7f-4947-8308-c8827de0fd65 None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:05:41.934653 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5cd36a-8929-41cb-9648-5f2723a85f18 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63489e658c094a2598a2ac62159d2fda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:05:41.935393 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5cd36a-8929-41cb-9648-5f2723a85f18 service nova] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:05:41.935739 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5cd36a-8929-41cb-9648-5f2723a85f18 service nova] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:05:41.936079 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5cd36a-8929-41cb-9648-5f2723a85f18 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:05:41.944739 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5cd36a-8929-41cb-9648-5f2723a85f18 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:05:41.946363 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5cd36a-8929-41cb-9648-5f2723a85f18 service nova] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:05:41.956080 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 696/1368] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:05:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 14:05:44.327294 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6736d00f-8f6a-41d2-b64b-4a468ad3cd3f None None] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:05:44.327885 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6736d00f-8f6a-41d2-b64b-4a468ad3cd3f None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:05:44.327885 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6736d00f-8f6a-41d2-b64b-4a468ad3cd3f None None] PATH_INFO: `/` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:05:44.329569 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 673/1369] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 3 14:05:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 14:05:44.335541 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c428502-f704-45ab-88ac-0698001060ba None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:05:44.336138 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c428502-f704-45ab-88ac-0698001060ba None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:05:44.336138 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c428502-f704-45ab-88ac-0698001060ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:05:44.356380 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-5c428502-f704-45ab-88ac-0698001060ba None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:05:44.357884 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-5c428502-f704-45ab-88ac-0698001060ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:05:44.369353 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 697/1370] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 3 14:05:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:05:44.410929 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6736d00f-8f6a-41d2-b64b-4a468ad3cd3f None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:05:44.425644 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6736d00f-8f6a-41d2-b64b-4a468ad3cd3f None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:05:44.431652 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3384f7-a64c-4fc6-b8bf-3a7b67b0db45 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63489e658c094a2598a2ac62159d2fda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:05:44.432525 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3384f7-a64c-4fc6-b8bf-3a7b67b0db45 service nova] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:05:44.432966 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3384f7-a64c-4fc6-b8bf-3a7b67b0db45 service nova] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:05:44.433421 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3384f7-a64c-4fc6-b8bf-3a7b67b0db45 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:05:44.442683 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3384f7-a64c-4fc6-b8bf-3a7b67b0db45 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:05:44.444485 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3384f7-a64c-4fc6-b8bf-3a7b67b0db45 service nova] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:05:44.454800 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 674/1371] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:05:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 14:05:44.513441 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a332c0-e55b-42c4-9d92-f8af8c9f6763 None None] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:05:44.514058 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a332c0-e55b-42c4-9d92-f8af8c9f6763 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:05:44.514444 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a332c0-e55b-42c4-9d92-f8af8c9f6763 None None] PATH_INFO: `/` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:05:44.516151 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 698/1372] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 3 14:05:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 14:05:44.522058 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b41ca38-b49b-4f13-807e-1164adf099d6 None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:05:44.522333 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b41ca38-b49b-4f13-807e-1164adf099d6 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:05:44.522828 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b41ca38-b49b-4f13-807e-1164adf099d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:05:44.544440 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-0b41ca38-b49b-4f13-807e-1164adf099d6 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:05:44.546163 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-0b41ca38-b49b-4f13-807e-1164adf099d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:05:44.555768 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 675/1373] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 3 14:05:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:05:44.864300 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851bc3fd-1e8f-4270-9492-55788e85ab5b None None] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:05:44.864597 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851bc3fd-1e8f-4270-9492-55788e85ab5b None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:05:44.865082 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851bc3fd-1e8f-4270-9492-55788e85ab5b None None] PATH_INFO: `/` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:05:44.866872 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 699/1374] 10.222.0.36 () {54 vars in 963 bytes} [Tue May 3 14:05:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 14:05:44.873111 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04c7fc3-807e-47af-b4f9-199a36f1650d None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:05:44.873492 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04c7fc3-807e-47af-b4f9-199a36f1650d None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:05:44.873802 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04c7fc3-807e-47af-b4f9-199a36f1650d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:05:44.931618 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-a04c7fc3-807e-47af-b4f9-199a36f1650d None None] MFA Rules not processed for user `5b014f4c7ba1414cb8a597f5bc4033f7`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:05:44.932998 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-a04c7fc3-807e-47af-b4f9-199a36f1650d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:05:45.000728 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 676/1375] 10.222.0.36 () {58 vars in 1060 bytes} [Tue May 3 14:05:44 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:05:45.009864 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851bc3fd-1e8f-4270-9492-55788e85ab5b None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:05:45.022663 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851bc3fd-1e8f-4270-9492-55788e85ab5b None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:05:45.026869 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2dc788-392f-45e1-b6ee-6b5a5fb61907 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b014f4c7ba1414cb8a597f5bc4033f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:05:45.027653 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2dc788-392f-45e1-b6ee-6b5a5fb61907 service cinder] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:05:45.027908 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2dc788-392f-45e1-b6ee-6b5a5fb61907 service cinder] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:05:45.028247 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2dc788-392f-45e1-b6ee-6b5a5fb61907 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:05:45.039173 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2dc788-392f-45e1-b6ee-6b5a5fb61907 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:05:45.040880 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2dc788-392f-45e1-b6ee-6b5a5fb61907 service cinder] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:05:45.056109 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 700/1376] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:05:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 14:05:46.848182 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9ee0f2-cdc5-4e2b-97ed-266f4f386a71 None None] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:05:46.848795 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9ee0f2-cdc5-4e2b-97ed-266f4f386a71 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:05:46.848795 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9ee0f2-cdc5-4e2b-97ed-266f4f386a71 None None] PATH_INFO: `/` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:05:46.850386 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 677/1377] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 3 14:05:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 14:05:46.857084 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a4cf15-b12d-4785-b3fd-e9cb43e77a0e None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:05:46.857774 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a4cf15-b12d-4785-b3fd-e9cb43e77a0e None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:05:46.857774 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a4cf15-b12d-4785-b3fd-e9cb43e77a0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:05:46.878736 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-08a4cf15-b12d-4785-b3fd-e9cb43e77a0e None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:05:46.880169 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-08a4cf15-b12d-4785-b3fd-e9cb43e77a0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:05:46.889934 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 701/1378] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 3 14:05:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:05:46.941078 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9ee0f2-cdc5-4e2b-97ed-266f4f386a71 None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:05:46.960078 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9ee0f2-cdc5-4e2b-97ed-266f4f386a71 None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:05:46.966745 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9382932-03ed-41e2-8e6d-a09d0b5d7d52 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63489e658c094a2598a2ac62159d2fda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:05:46.967410 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9382932-03ed-41e2-8e6d-a09d0b5d7d52 service nova] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:05:46.967694 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9382932-03ed-41e2-8e6d-a09d0b5d7d52 service nova] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:05:46.967972 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9382932-03ed-41e2-8e6d-a09d0b5d7d52 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:05:46.977990 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9382932-03ed-41e2-8e6d-a09d0b5d7d52 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:05:46.979589 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9382932-03ed-41e2-8e6d-a09d0b5d7d52 service nova] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:05:46.990470 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 678/1379] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:05:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 14:05:49.272814 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f9eaa4-1987-409a-a0c6-56f1b7dfa2ef None None] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:05:49.273610 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f9eaa4-1987-409a-a0c6-56f1b7dfa2ef None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:05:49.273610 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f9eaa4-1987-409a-a0c6-56f1b7dfa2ef None None] PATH_INFO: `/` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:05:49.274710 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 702/1380] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 3 14:05:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 14:05:49.279977 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03f8a94-08d8-4ca3-9fc3-cc2877d77d49 None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:05:49.280411 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03f8a94-08d8-4ca3-9fc3-cc2877d77d49 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:05:49.280494 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03f8a94-08d8-4ca3-9fc3-cc2877d77d49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:05:49.298670 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-e03f8a94-08d8-4ca3-9fc3-cc2877d77d49 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:05:49.299814 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-e03f8a94-08d8-4ca3-9fc3-cc2877d77d49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:05:49.307845 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 679/1381] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 3 14:05:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:05:49.351888 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f9eaa4-1987-409a-a0c6-56f1b7dfa2ef None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:05:49.366822 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f9eaa4-1987-409a-a0c6-56f1b7dfa2ef None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:05:49.372467 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fe9f20-ab80-4968-a247-75e3956d5137 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63489e658c094a2598a2ac62159d2fda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:05:49.373236 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fe9f20-ab80-4968-a247-75e3956d5137 service nova] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:05:49.373560 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fe9f20-ab80-4968-a247-75e3956d5137 service nova] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:05:49.373933 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fe9f20-ab80-4968-a247-75e3956d5137 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:05:49.384358 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fe9f20-ab80-4968-a247-75e3956d5137 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:05:49.385978 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fe9f20-ab80-4968-a247-75e3956d5137 service nova] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:05:49.395840 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 703/1382] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:05:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 14:05:51.656150 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd92878-b514-4157-90d5-3c1c549d2d18 None None] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:05:51.656735 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd92878-b514-4157-90d5-3c1c549d2d18 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:05:51.656735 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd92878-b514-4157-90d5-3c1c549d2d18 None None] PATH_INFO: `/` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:05:51.658316 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 680/1383] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 3 14:05:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 14:05:51.664514 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2a6b08-c82b-4245-8455-4de229daee52 None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:05:51.665042 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2a6b08-c82b-4245-8455-4de229daee52 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:05:51.665162 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2a6b08-c82b-4245-8455-4de229daee52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:05:51.686394 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-1b2a6b08-c82b-4245-8455-4de229daee52 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:05:51.687666 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-1b2a6b08-c82b-4245-8455-4de229daee52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:05:51.695938 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 704/1384] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 3 14:05:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:05:51.737335 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd92878-b514-4157-90d5-3c1c549d2d18 None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:05:51.752232 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd92878-b514-4157-90d5-3c1c549d2d18 None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:05:51.757821 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9da7de9-c22f-4b69-a776-1e3ef69c6f18 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63489e658c094a2598a2ac62159d2fda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:05:51.758461 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9da7de9-c22f-4b69-a776-1e3ef69c6f18 service nova] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:05:51.758740 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9da7de9-c22f-4b69-a776-1e3ef69c6f18 service nova] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:05:51.759016 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9da7de9-c22f-4b69-a776-1e3ef69c6f18 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:05:51.767529 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9da7de9-c22f-4b69-a776-1e3ef69c6f18 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:05:51.769094 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9da7de9-c22f-4b69-a776-1e3ef69c6f18 service nova] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:05:51.778745 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 681/1385] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:05:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 14:05:54.003553 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa728f1-9e1e-429f-b36a-972ed581d82c None None] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:05:54.004414 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa728f1-9e1e-429f-b36a-972ed581d82c None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:05:54.004414 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa728f1-9e1e-429f-b36a-972ed581d82c None None] PATH_INFO: `/` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:05:54.005884 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 705/1386] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 3 14:05:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 14:05:54.013252 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1d724d-b9cd-49d1-9c5b-3b8400ebe803 None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:05:54.013808 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1d724d-b9cd-49d1-9c5b-3b8400ebe803 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:05:54.014026 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1d724d-b9cd-49d1-9c5b-3b8400ebe803 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:05:54.038151 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-9d1d724d-b9cd-49d1-9c5b-3b8400ebe803 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:05:54.039991 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-9d1d724d-b9cd-49d1-9c5b-3b8400ebe803 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:05:54.051069 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 682/1387] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 3 14:05:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:05:54.107860 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa728f1-9e1e-429f-b36a-972ed581d82c None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:05:54.122776 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa728f1-9e1e-429f-b36a-972ed581d82c None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:05:54.128923 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e10ba7b-6efa-4351-9659-d06644bb4b57 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63489e658c094a2598a2ac62159d2fda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:05:54.129611 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e10ba7b-6efa-4351-9659-d06644bb4b57 service nova] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:05:54.129930 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e10ba7b-6efa-4351-9659-d06644bb4b57 service nova] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:05:54.130232 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e10ba7b-6efa-4351-9659-d06644bb4b57 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:05:54.139311 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e10ba7b-6efa-4351-9659-d06644bb4b57 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:05:54.140943 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e10ba7b-6efa-4351-9659-d06644bb4b57 service nova] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:05:54.151407 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 706/1388] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:05:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 14:05:56.443596 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12503470-7113-405e-ae6d-b5bd4076f641 None None] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:05:56.444141 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12503470-7113-405e-ae6d-b5bd4076f641 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:05:56.444251 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12503470-7113-405e-ae6d-b5bd4076f641 None None] PATH_INFO: `/` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:05:56.445915 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 683/1389] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 3 14:05:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 14:05:56.453139 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c14e95b-a6bf-491b-8d6a-0912d90d5d48 None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:05:56.453647 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c14e95b-a6bf-491b-8d6a-0912d90d5d48 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:05:56.453733 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c14e95b-a6bf-491b-8d6a-0912d90d5d48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:05:56.474418 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-8c14e95b-a6bf-491b-8d6a-0912d90d5d48 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:05:56.475617 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-8c14e95b-a6bf-491b-8d6a-0912d90d5d48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:05:56.484779 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 707/1390] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 3 14:05:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:05:56.538703 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12503470-7113-405e-ae6d-b5bd4076f641 None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:05:56.559485 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12503470-7113-405e-ae6d-b5bd4076f641 None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:05:56.567454 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cb631e-5741-4a85-8cbe-e656c39c9d25 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63489e658c094a2598a2ac62159d2fda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:05:56.568380 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cb631e-5741-4a85-8cbe-e656c39c9d25 service nova] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:05:56.568872 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cb631e-5741-4a85-8cbe-e656c39c9d25 service nova] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:05:56.569237 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cb631e-5741-4a85-8cbe-e656c39c9d25 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:05:56.581269 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cb631e-5741-4a85-8cbe-e656c39c9d25 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:05:56.583628 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cb631e-5741-4a85-8cbe-e656c39c9d25 service nova] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:05:56.597249 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 684/1391] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:05:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 14:05:58.877857 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04723de-a98c-4ec6-9929-3649e0b6b10a None None] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:05:58.878530 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04723de-a98c-4ec6-9929-3649e0b6b10a None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:05:58.878530 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04723de-a98c-4ec6-9929-3649e0b6b10a None None] PATH_INFO: `/` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:05:58.880066 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 708/1392] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 3 14:05:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 14:05:58.885303 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f31575-db07-476d-8a9b-e3a855abc36b None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:05:58.885757 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f31575-db07-476d-8a9b-e3a855abc36b None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:05:58.885911 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f31575-db07-476d-8a9b-e3a855abc36b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:05:58.903758 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-08f31575-db07-476d-8a9b-e3a855abc36b None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:05:58.904915 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-08f31575-db07-476d-8a9b-e3a855abc36b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:05:58.912927 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 685/1393] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 3 14:05:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:05:58.956091 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04723de-a98c-4ec6-9929-3649e0b6b10a None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:05:58.971092 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04723de-a98c-4ec6-9929-3649e0b6b10a None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:05:58.977160 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c357bd58-c2e3-4457-8f39-f8f579684967 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63489e658c094a2598a2ac62159d2fda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:05:58.977841 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c357bd58-c2e3-4457-8f39-f8f579684967 service nova] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:05:58.978121 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c357bd58-c2e3-4457-8f39-f8f579684967 service nova] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:05:58.978400 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c357bd58-c2e3-4457-8f39-f8f579684967 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:05:58.986854 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c357bd58-c2e3-4457-8f39-f8f579684967 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:05:58.988559 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c357bd58-c2e3-4457-8f39-f8f579684967 service nova] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:05:58.998152 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 709/1394] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:05:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 14:06:00.982790 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c91090-a7fa-4f96-b13a-418637324776 None None] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:06:00.983396 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c91090-a7fa-4f96-b13a-418637324776 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:06:00.983396 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c91090-a7fa-4f96-b13a-418637324776 None None] PATH_INFO: `/` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:06:00.984725 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 686/1395] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 3 14:06:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 14:06:00.990265 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92491c8-3411-4373-9af9-88b2df303435 None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:06:00.990727 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92491c8-3411-4373-9af9-88b2df303435 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:06:00.990835 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92491c8-3411-4373-9af9-88b2df303435 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:06:01.009129 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-d92491c8-3411-4373-9af9-88b2df303435 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:06:01.010349 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-d92491c8-3411-4373-9af9-88b2df303435 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:06:01.019235 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 710/1396] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 3 14:06:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:06:01.078847 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d0b19c-95dc-4ccb-a2c0-002db2e66a2f None None] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:06:01.079130 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d0b19c-95dc-4ccb-a2c0-002db2e66a2f None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:06:01.079430 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d0b19c-95dc-4ccb-a2c0-002db2e66a2f None None] PATH_INFO: `/` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:06:01.080793 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 687/1397] 10.222.0.36 () {54 vars in 962 bytes} [Tue May 3 14:06:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 14:06:01.086907 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e837bb39-62ab-438c-9333-74d4eef3d95d None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:06:01.087194 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e837bb39-62ab-438c-9333-74d4eef3d95d None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:06:01.087783 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e837bb39-62ab-438c-9333-74d4eef3d95d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:06:01.137268 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-e837bb39-62ab-438c-9333-74d4eef3d95d None None] MFA Rules not processed for user `616de5e7daed46849efc75ad77ea054e`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:06:01.138477 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-e837bb39-62ab-438c-9333-74d4eef3d95d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:06:01.200309 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 711/1398] 10.222.0.36 () {58 vars in 1059 bytes} [Tue May 3 14:06:01 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:06:01.208231 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d0b19c-95dc-4ccb-a2c0-002db2e66a2f None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:06:01.220599 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d0b19c-95dc-4ccb-a2c0-002db2e66a2f None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:06:01.225021 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0953b1-0316-406b-9f65-7c2a66a7a910 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '616de5e7daed46849efc75ad77ea054e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:06:01.225700 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0953b1-0316-406b-9f65-7c2a66a7a910 service glance] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:06:01.225984 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0953b1-0316-406b-9f65-7c2a66a7a910 service glance] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:06:01.226262 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0953b1-0316-406b-9f65-7c2a66a7a910 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:06:01.235666 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0953b1-0316-406b-9f65-7c2a66a7a910 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:06:01.237035 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0953b1-0316-406b-9f65-7c2a66a7a910 service glance] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:06:01.246562 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6672f5-dbbd-48ee-9473-3bf2925c4cfc None None] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:06:01.246850 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6672f5-dbbd-48ee-9473-3bf2925c4cfc None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:06:01.246967 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 688/1399] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:06:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 14:06:01.247137 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6672f5-dbbd-48ee-9473-3bf2925c4cfc None None] PATH_INFO: `/` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:06:01.248576 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 712/1400] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 3 14:06:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 14:06:01.253694 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6abc10c-ed8d-4218-ac5d-ee37012bc9c3 None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:06:01.254017 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6abc10c-ed8d-4218-ac5d-ee37012bc9c3 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:06:01.254496 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6abc10c-ed8d-4218-ac5d-ee37012bc9c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:06:01.272829 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-d6abc10c-ed8d-4218-ac5d-ee37012bc9c3 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:06:01.274071 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-d6abc10c-ed8d-4218-ac5d-ee37012bc9c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:06:01.282517 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 689/1401] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 3 14:06:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 14:06:01.326244 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6672f5-dbbd-48ee-9473-3bf2925c4cfc None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:06:01.341858 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6672f5-dbbd-48ee-9473-3bf2925c4cfc None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:06:01.348313 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33c9123-9461-43bb-a3cd-d721ee851d1d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63489e658c094a2598a2ac62159d2fda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:06:01.348954 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33c9123-9461-43bb-a3cd-d721ee851d1d service nova] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:06:01.349234 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33c9123-9461-43bb-a3cd-d721ee851d1d service nova] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:06:01.349539 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33c9123-9461-43bb-a3cd-d721ee851d1d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:06:01.357694 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33c9123-9461-43bb-a3cd-d721ee851d1d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:06:01.359281 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33c9123-9461-43bb-a3cd-d721ee851d1d service nova] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:06:01.368791 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 713/1402] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:06:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 14:06:01.681038 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90c857b-73fa-4c93-8a36-2e4ee6bdf96b None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:06:01.681333 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90c857b-73fa-4c93-8a36-2e4ee6bdf96b None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:06:01.681667 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90c857b-73fa-4c93-8a36-2e4ee6bdf96b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:06:01.732087 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-a90c857b-73fa-4c93-8a36-2e4ee6bdf96b None None] MFA Rules not processed for user `dec39ff0b6544a738e5aae06e9a8cb38`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:06:01.733315 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-a90c857b-73fa-4c93-8a36-2e4ee6bdf96b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:06:01.796470 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 690/1403] 10.222.0.36 () {58 vars in 1009 bytes} [Tue May 3 14:06:01 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:06:01.841241 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2148a369-3ae0-4a03-b359-650481a933a7 None None] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:06:01.841597 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2148a369-3ae0-4a03-b359-650481a933a7 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:06:01.841875 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2148a369-3ae0-4a03-b359-650481a933a7 None None] PATH_INFO: `/` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:06:01.843273 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 714/1404] 10.222.0.36 () {54 vars in 942 bytes} [Tue May 3 14:06:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 14:06:01.849811 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5632bc88-6474-40d1-90f8-ffbe55c7095d None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:06:01.850167 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5632bc88-6474-40d1-90f8-ffbe55c7095d None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:06:01.850451 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5632bc88-6474-40d1-90f8-ffbe55c7095d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:06:01.898181 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-5632bc88-6474-40d1-90f8-ffbe55c7095d None None] MFA Rules not processed for user `e1180e29180d44418390cf22d3e0bd6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:06:01.899360 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-5632bc88-6474-40d1-90f8-ffbe55c7095d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:06:01.971656 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 691/1405] 10.222.0.36 () {58 vars in 1039 bytes} [Tue May 3 14:06:01 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:06:01.981444 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2148a369-3ae0-4a03-b359-650481a933a7 None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:06:01.995748 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2148a369-3ae0-4a03-b359-650481a933a7 None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:06:02.000945 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b722b6-13b7-4ea4-be89-b956cc93869c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1180e29180d44418390cf22d3e0bd6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:06:02.001613 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b722b6-13b7-4ea4-be89-b956cc93869c service swift] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:06:02.001892 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b722b6-13b7-4ea4-be89-b956cc93869c service swift] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:06:02.002169 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b722b6-13b7-4ea4-be89-b956cc93869c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:06:02.010216 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b722b6-13b7-4ea4-be89-b956cc93869c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:06:02.011797 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b722b6-13b7-4ea4-be89-b956cc93869c service swift] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:06:02.019849 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 715/1406] 10.222.0.36 () {60 vars in 1384 bytes} [Tue May 3 14:06:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 03 14:06:03.643121 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7950a522-da7e-4885-acc6-029bf212792d None None] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:06:03.643706 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7950a522-da7e-4885-acc6-029bf212792d None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:06:03.643706 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7950a522-da7e-4885-acc6-029bf212792d None None] PATH_INFO: `/` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:06:03.645124 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 692/1407] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 3 14:06:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 14:06:03.650448 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d822d94d-06cb-4038-a804-4d630d0563d3 None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:06:03.650883 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d822d94d-06cb-4038-a804-4d630d0563d3 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:06:03.650999 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d822d94d-06cb-4038-a804-4d630d0563d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:06:03.670859 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-d822d94d-06cb-4038-a804-4d630d0563d3 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:06:03.672324 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-d822d94d-06cb-4038-a804-4d630d0563d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:06:03.681215 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 716/1408] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 3 14:06:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:06:03.740478 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7950a522-da7e-4885-acc6-029bf212792d None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:06:03.757824 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7950a522-da7e-4885-acc6-029bf212792d None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:06:03.764207 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4426aa31-b3d7-440b-9683-b70bfdf4de09 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63489e658c094a2598a2ac62159d2fda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:06:03.765138 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4426aa31-b3d7-440b-9683-b70bfdf4de09 service nova] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:06:03.765689 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4426aa31-b3d7-440b-9683-b70bfdf4de09 service nova] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:06:03.766172 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4426aa31-b3d7-440b-9683-b70bfdf4de09 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:06:03.777346 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4426aa31-b3d7-440b-9683-b70bfdf4de09 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:06:03.779374 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4426aa31-b3d7-440b-9683-b70bfdf4de09 service nova] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:06:03.794945 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 693/1409] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:06:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 14:06:25.159043 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187b83cf-f022-4078-9964-ef43e3cad023 None None] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:06:25.159805 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187b83cf-f022-4078-9964-ef43e3cad023 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:06:25.159805 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187b83cf-f022-4078-9964-ef43e3cad023 None None] PATH_INFO: `/` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:06:25.161034 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 717/1410] 10.222.0.36 () {54 vars in 918 bytes} [Tue May 3 14:06:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 14:06:25.166339 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b755c95-11a0-424d-bf1e-3562c6fd1e35 None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:06:25.166844 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b755c95-11a0-424d-bf1e-3562c6fd1e35 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:06:25.166844 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b755c95-11a0-424d-bf1e-3562c6fd1e35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:06:25.186165 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-7b755c95-11a0-424d-bf1e-3562c6fd1e35 None None] MFA Rules not processed for user `164c7f36acf644e9bf93f158e876e9e3`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:06:25.187357 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-7b755c95-11a0-424d-bf1e-3562c6fd1e35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:06:25.198080 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 694/1411] 10.222.0.36 () {58 vars in 1015 bytes} [Tue May 3 14:06:25 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:06:25.212764 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588947ba-1791-4813-94af-cc3780585f30 None None] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:06:25.213050 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588947ba-1791-4813-94af-cc3780585f30 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:06:25.213331 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588947ba-1791-4813-94af-cc3780585f30 None None] PATH_INFO: `/` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:06:25.214746 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 718/1412] 10.222.0.36 () {54 vars in 918 bytes} [Tue May 3 14:06:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 14:06:25.219452 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc8fe44-b109-43fd-a870-fb3aeddfb498 None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:06:25.219755 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc8fe44-b109-43fd-a870-fb3aeddfb498 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:06:25.220063 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc8fe44-b109-43fd-a870-fb3aeddfb498 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:06:25.238992 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-ddc8fe44-b109-43fd-a870-fb3aeddfb498 None None] MFA Rules not processed for user `63489e658c094a2598a2ac62159d2fda`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:06:25.240173 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-ddc8fe44-b109-43fd-a870-fb3aeddfb498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:06:25.250994 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 695/1413] 10.222.0.36 () {58 vars in 1015 bytes} [Tue May 3 14:06:25 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:06:28.078905 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105c1926-6dc6-49a6-8bd9-c9e692107385 None None] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:06:28.079408 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105c1926-6dc6-49a6-8bd9-c9e692107385 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:06:28.079408 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105c1926-6dc6-49a6-8bd9-c9e692107385 None None] PATH_INFO: `/` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:06:28.080813 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 719/1414] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 3 14:06:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 14:06:28.086296 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9165f9dd-f0fa-4cb0-bdb1-88f95c88822c None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:06:28.086736 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9165f9dd-f0fa-4cb0-bdb1-88f95c88822c None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:06:28.086858 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9165f9dd-f0fa-4cb0-bdb1-88f95c88822c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:06:28.105014 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-9165f9dd-f0fa-4cb0-bdb1-88f95c88822c None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:06:28.106217 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-9165f9dd-f0fa-4cb0-bdb1-88f95c88822c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:06:28.114602 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 696/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 3 14:06:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:06:28.160633 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105c1926-6dc6-49a6-8bd9-c9e692107385 None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:06:28.176625 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105c1926-6dc6-49a6-8bd9-c9e692107385 None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:06:28.182307 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb9f517-374f-4373-a4a6-1f7131afa163 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63489e658c094a2598a2ac62159d2fda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:06:28.182990 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb9f517-374f-4373-a4a6-1f7131afa163 service nova] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:06:28.183273 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb9f517-374f-4373-a4a6-1f7131afa163 service nova] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:06:28.183541 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb9f517-374f-4373-a4a6-1f7131afa163 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:06:28.192149 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb9f517-374f-4373-a4a6-1f7131afa163 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:06:28.193776 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb9f517-374f-4373-a4a6-1f7131afa163 service nova] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:06:28.203859 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 720/1416] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:06:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 14:06:29.516365 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795eda12-64b2-4787-ac7b-2d24de111a4d None None] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:06:29.517273 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795eda12-64b2-4787-ac7b-2d24de111a4d None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:06:29.517418 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795eda12-64b2-4787-ac7b-2d24de111a4d None None] PATH_INFO: `/` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:06:29.519887 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 697/1417] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 3 14:06:29 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 14:06:29.528026 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f130840a-d793-4ea9-a1ae-8504e01d3091 None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:06:29.528744 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f130840a-d793-4ea9-a1ae-8504e01d3091 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:06:29.528937 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f130840a-d793-4ea9-a1ae-8504e01d3091 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:06:29.550180 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-f130840a-d793-4ea9-a1ae-8504e01d3091 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:06:29.551384 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-f130840a-d793-4ea9-a1ae-8504e01d3091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:06:29.559362 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 721/1418] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 3 14:06:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:06:29.717206 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795eda12-64b2-4787-ac7b-2d24de111a4d None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:06:29.734419 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795eda12-64b2-4787-ac7b-2d24de111a4d None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:06:29.740493 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41db628b-db07-4a65-8a3f-a836997e678d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63489e658c094a2598a2ac62159d2fda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:06:29.741166 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41db628b-db07-4a65-8a3f-a836997e678d service nova] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:06:29.741474 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41db628b-db07-4a65-8a3f-a836997e678d service nova] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:06:29.741774 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41db628b-db07-4a65-8a3f-a836997e678d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:06:29.750501 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41db628b-db07-4a65-8a3f-a836997e678d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:06:29.752110 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41db628b-db07-4a65-8a3f-a836997e678d service nova] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:06:29.762095 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 698/1419] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:06:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 14:06:31.015377 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5638f836-bad1-40a2-8315-01846c3313a6 None None] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:06:31.016318 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5638f836-bad1-40a2-8315-01846c3313a6 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:06:31.016318 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5638f836-bad1-40a2-8315-01846c3313a6 None None] PATH_INFO: `/` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:06:31.018534 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 722/1420] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 3 14:06:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 14:06:31.026843 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf40e76-fb76-4220-983d-477d9434faa3 None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:06:31.027315 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf40e76-fb76-4220-983d-477d9434faa3 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:06:31.027431 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf40e76-fb76-4220-983d-477d9434faa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:06:31.049502 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-6bf40e76-fb76-4220-983d-477d9434faa3 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:06:31.050745 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-6bf40e76-fb76-4220-983d-477d9434faa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:06:31.062411 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 699/1421] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 3 14:06:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:06:31.215400 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5638f836-bad1-40a2-8315-01846c3313a6 None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:06:31.234791 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5638f836-bad1-40a2-8315-01846c3313a6 None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:06:31.241318 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c00b3f-f9d1-4926-9470-e26b3201f04d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63489e658c094a2598a2ac62159d2fda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:06:31.242001 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c00b3f-f9d1-4926-9470-e26b3201f04d service nova] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:06:31.242272 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c00b3f-f9d1-4926-9470-e26b3201f04d service nova] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:06:31.242538 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c00b3f-f9d1-4926-9470-e26b3201f04d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:06:31.251181 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c00b3f-f9d1-4926-9470-e26b3201f04d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:06:31.252752 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c00b3f-f9d1-4926-9470-e26b3201f04d service nova] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:06:31.262736 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 723/1422] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:06:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 14:06:32.499846 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36041d64-22b9-4d75-828b-bdc2c10681a5 None None] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:06:32.500409 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36041d64-22b9-4d75-828b-bdc2c10681a5 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:06:32.500409 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36041d64-22b9-4d75-828b-bdc2c10681a5 None None] PATH_INFO: `/` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:06:32.501804 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 700/1423] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 3 14:06:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 14:06:32.508151 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651e8f89-8087-4f57-8068-79cc235b1bbd None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:06:32.508932 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651e8f89-8087-4f57-8068-79cc235b1bbd None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:06:32.509125 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651e8f89-8087-4f57-8068-79cc235b1bbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:06:32.537608 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-651e8f89-8087-4f57-8068-79cc235b1bbd None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:06:32.538817 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-651e8f89-8087-4f57-8068-79cc235b1bbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:06:32.548730 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 724/1424] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 3 14:06:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:06:32.701049 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36041d64-22b9-4d75-828b-bdc2c10681a5 None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:06:32.725151 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36041d64-22b9-4d75-828b-bdc2c10681a5 None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:06:32.731209 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8028adfa-6fb2-4adb-a6bf-b281e425e603 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63489e658c094a2598a2ac62159d2fda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:06:32.731839 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8028adfa-6fb2-4adb-a6bf-b281e425e603 service nova] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:06:32.732113 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8028adfa-6fb2-4adb-a6bf-b281e425e603 service nova] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:06:32.732378 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8028adfa-6fb2-4adb-a6bf-b281e425e603 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:06:32.741385 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8028adfa-6fb2-4adb-a6bf-b281e425e603 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:06:32.742963 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8028adfa-6fb2-4adb-a6bf-b281e425e603 service nova] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:06:32.752250 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 701/1425] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:06:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 14:06:33.988942 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1fe18c-2115-4a29-8fdb-25798a1ebebd None None] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:06:33.989849 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1fe18c-2115-4a29-8fdb-25798a1ebebd None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:06:33.989849 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1fe18c-2115-4a29-8fdb-25798a1ebebd None None] PATH_INFO: `/` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:06:33.991962 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 725/1426] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 3 14:06:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 14:06:33.998101 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa64ecf-a23f-46de-a089-0789c2a4b870 None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:06:33.998549 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa64ecf-a23f-46de-a089-0789c2a4b870 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:06:33.998735 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa64ecf-a23f-46de-a089-0789c2a4b870 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:06:34.019572 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-6aa64ecf-a23f-46de-a089-0789c2a4b870 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:06:34.020822 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-6aa64ecf-a23f-46de-a089-0789c2a4b870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:06:34.029732 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 702/1427] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 3 14:06:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:06:34.179608 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1fe18c-2115-4a29-8fdb-25798a1ebebd None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:06:34.200194 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1fe18c-2115-4a29-8fdb-25798a1ebebd None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:06:34.206887 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236640c3-e782-4f29-aeee-dd344af9c8f4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63489e658c094a2598a2ac62159d2fda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:06:34.207517 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236640c3-e782-4f29-aeee-dd344af9c8f4 service nova] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:06:34.207793 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236640c3-e782-4f29-aeee-dd344af9c8f4 service nova] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:06:34.208061 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236640c3-e782-4f29-aeee-dd344af9c8f4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:06:34.216721 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236640c3-e782-4f29-aeee-dd344af9c8f4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:06:34.218296 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236640c3-e782-4f29-aeee-dd344af9c8f4 service nova] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:06:34.228290 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 726/1428] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:06:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 14:06:35.425714 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa1c262-997e-48b1-a4c8-b9184e56f1a9 None None] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:06:35.426242 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa1c262-997e-48b1-a4c8-b9184e56f1a9 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:06:35.426242 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa1c262-997e-48b1-a4c8-b9184e56f1a9 None None] PATH_INFO: `/` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:06:35.427602 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 703/1429] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 3 14:06:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 14:06:35.433682 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02967344-a7f1-4b53-8720-b5b5d4743dd8 None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:06:35.434092 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02967344-a7f1-4b53-8720-b5b5d4743dd8 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:06:35.434259 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02967344-a7f1-4b53-8720-b5b5d4743dd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:06:35.460736 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-02967344-a7f1-4b53-8720-b5b5d4743dd8 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:06:35.461973 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-02967344-a7f1-4b53-8720-b5b5d4743dd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:06:35.472324 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 727/1430] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 3 14:06:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:06:35.622251 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa1c262-997e-48b1-a4c8-b9184e56f1a9 None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:06:35.638062 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa1c262-997e-48b1-a4c8-b9184e56f1a9 None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:06:35.644062 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cf5d95-2b83-430b-b4c3-2d025fc77860 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63489e658c094a2598a2ac62159d2fda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:06:35.644716 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cf5d95-2b83-430b-b4c3-2d025fc77860 service nova] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:06:35.644966 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cf5d95-2b83-430b-b4c3-2d025fc77860 service nova] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:06:35.645236 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cf5d95-2b83-430b-b4c3-2d025fc77860 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:06:35.653458 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cf5d95-2b83-430b-b4c3-2d025fc77860 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:06:35.655014 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cf5d95-2b83-430b-b4c3-2d025fc77860 service nova] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:06:35.664393 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 704/1431] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:06:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 03 14:06:36.844455 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f79680-a3e1-455f-b660-2ad08e0e031a None None] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:06:36.845396 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f79680-a3e1-455f-b660-2ad08e0e031a None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:06:36.845396 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f79680-a3e1-455f-b660-2ad08e0e031a None None] PATH_INFO: `/` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:06:36.847763 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 728/1432] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 3 14:06:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 14:06:36.855944 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5923f026-dc56-4946-96d2-84e84aa905e4 None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:06:36.856431 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5923f026-dc56-4946-96d2-84e84aa905e4 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:06:36.856538 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5923f026-dc56-4946-96d2-84e84aa905e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:06:36.878689 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-5923f026-dc56-4946-96d2-84e84aa905e4 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:06:36.879816 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-5923f026-dc56-4946-96d2-84e84aa905e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:06:36.888143 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 705/1433] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 3 14:06:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:06:37.036038 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f79680-a3e1-455f-b660-2ad08e0e031a None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:06:37.058499 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f79680-a3e1-455f-b660-2ad08e0e031a None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:06:37.066083 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f914b48-b727-4417-8d87-76708cebd7c5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63489e658c094a2598a2ac62159d2fda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:06:37.066713 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f914b48-b727-4417-8d87-76708cebd7c5 service nova] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:06:37.066994 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f914b48-b727-4417-8d87-76708cebd7c5 service nova] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:06:37.067251 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f914b48-b727-4417-8d87-76708cebd7c5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:06:37.076091 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f914b48-b727-4417-8d87-76708cebd7c5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:06:37.077721 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f914b48-b727-4417-8d87-76708cebd7c5 service nova] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:06:37.087228 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 729/1434] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:06:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 14:06:38.266642 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de3d3e9-f009-4d5f-8d08-7cbee0a103c4 None None] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:06:38.267324 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de3d3e9-f009-4d5f-8d08-7cbee0a103c4 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:06:38.267324 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de3d3e9-f009-4d5f-8d08-7cbee0a103c4 None None] PATH_INFO: `/` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:06:38.268659 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 706/1435] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 3 14:06:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 14:06:38.275276 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701f096c-1615-4dff-860d-63cc60e5957d None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:06:38.276055 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701f096c-1615-4dff-860d-63cc60e5957d None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:06:38.276268 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701f096c-1615-4dff-860d-63cc60e5957d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:06:38.303520 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-701f096c-1615-4dff-860d-63cc60e5957d None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:06:38.304726 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-701f096c-1615-4dff-860d-63cc60e5957d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:06:38.313427 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 730/1436] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 3 14:06:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:06:38.468799 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de3d3e9-f009-4d5f-8d08-7cbee0a103c4 None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:06:38.491830 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de3d3e9-f009-4d5f-8d08-7cbee0a103c4 None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:06:38.498533 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f287efb2-912e-409f-aa3e-92581e34410d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63489e658c094a2598a2ac62159d2fda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:06:38.499172 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f287efb2-912e-409f-aa3e-92581e34410d service nova] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:06:38.499452 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f287efb2-912e-409f-aa3e-92581e34410d service nova] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:06:38.499725 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f287efb2-912e-409f-aa3e-92581e34410d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:06:38.508649 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f287efb2-912e-409f-aa3e-92581e34410d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:06:38.510285 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f287efb2-912e-409f-aa3e-92581e34410d service nova] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:06:38.519451 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 707/1437] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:06:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 14:06:39.731848 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0660aedb-d3e4-4f86-9596-a869b40ad0fe None None] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:06:39.732468 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0660aedb-d3e4-4f86-9596-a869b40ad0fe None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:06:39.732468 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0660aedb-d3e4-4f86-9596-a869b40ad0fe None None] PATH_INFO: `/` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:06:39.733840 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 731/1438] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 3 14:06:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 14:06:39.739914 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7d6c62-88e1-49b2-a7e8-777a19903618 None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:06:39.740407 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7d6c62-88e1-49b2-a7e8-777a19903618 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:06:39.740506 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7d6c62-88e1-49b2-a7e8-777a19903618 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:06:39.770266 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-0f7d6c62-88e1-49b2-a7e8-777a19903618 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:06:39.771452 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-0f7d6c62-88e1-49b2-a7e8-777a19903618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:06:39.780751 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 708/1439] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 3 14:06:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:06:39.937138 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0660aedb-d3e4-4f86-9596-a869b40ad0fe None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:06:39.960088 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0660aedb-d3e4-4f86-9596-a869b40ad0fe None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:06:39.966842 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f55879b-c50d-4317-ae4c-610549a97530 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63489e658c094a2598a2ac62159d2fda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:06:39.967476 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f55879b-c50d-4317-ae4c-610549a97530 service nova] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:06:39.967748 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f55879b-c50d-4317-ae4c-610549a97530 service nova] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:06:39.968014 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f55879b-c50d-4317-ae4c-610549a97530 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:06:39.976521 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f55879b-c50d-4317-ae4c-610549a97530 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:06:39.978137 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f55879b-c50d-4317-ae4c-610549a97530 service nova] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:06:39.987865 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 732/1440] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:06:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 14:06:42.076544 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bbac25-dad6-4a26-bcbe-f257f7b88c7d None None] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:06:42.077092 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bbac25-dad6-4a26-bcbe-f257f7b88c7d None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:06:42.077092 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bbac25-dad6-4a26-bcbe-f257f7b88c7d None None] PATH_INFO: `/` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:06:42.078489 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 709/1441] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 3 14:06:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 14:06:42.084011 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3248ed6f-04b2-48fb-93d4-1f4a1b30cbc8 None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:06:42.084460 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3248ed6f-04b2-48fb-93d4-1f4a1b30cbc8 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:06:42.084572 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3248ed6f-04b2-48fb-93d4-1f4a1b30cbc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:06:42.114987 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-3248ed6f-04b2-48fb-93d4-1f4a1b30cbc8 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:06:42.116813 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-3248ed6f-04b2-48fb-93d4-1f4a1b30cbc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:06:42.127815 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 733/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 3 14:06:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:06:42.170134 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bbac25-dad6-4a26-bcbe-f257f7b88c7d None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:06:42.181661 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bbac25-dad6-4a26-bcbe-f257f7b88c7d None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:06:42.185223 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4940cc91-2875-4b16-8611-89c1786f2cbf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '937bea4f355144b4a7ee11baabc3a4cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:06:42.185881 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4940cc91-2875-4b16-8611-89c1786f2cbf service neutron] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:06:42.186153 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4940cc91-2875-4b16-8611-89c1786f2cbf service neutron] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:06:42.186421 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4940cc91-2875-4b16-8611-89c1786f2cbf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:06:42.195965 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4940cc91-2875-4b16-8611-89c1786f2cbf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:06:42.197569 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4940cc91-2875-4b16-8611-89c1786f2cbf service neutron] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:06:42.207974 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 710/1443] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:06:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 14:06:44.638238 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0679464e-bc28-457a-8b40-94412c928f96 None None] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:06:44.639417 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0679464e-bc28-457a-8b40-94412c928f96 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:06:44.639417 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0679464e-bc28-457a-8b40-94412c928f96 None None] PATH_INFO: `/` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:06:44.641137 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 734/1444] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 3 14:06:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 14:06:44.647935 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db9d175-92d7-4fbd-867b-22b3fcbfd8fd None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:06:44.648737 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db9d175-92d7-4fbd-867b-22b3fcbfd8fd None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:06:44.648913 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db9d175-92d7-4fbd-867b-22b3fcbfd8fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:06:44.669679 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-2db9d175-92d7-4fbd-867b-22b3fcbfd8fd None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:06:44.670866 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-2db9d175-92d7-4fbd-867b-22b3fcbfd8fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:06:44.679226 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 711/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 3 14:06:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:06:44.718522 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0679464e-bc28-457a-8b40-94412c928f96 None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:06:44.730477 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0679464e-bc28-457a-8b40-94412c928f96 None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:06:44.735140 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3e4a5a-6408-4a46-8fd0-97f0b88ff175 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '937bea4f355144b4a7ee11baabc3a4cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:06:44.735775 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3e4a5a-6408-4a46-8fd0-97f0b88ff175 service neutron] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:06:44.736050 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3e4a5a-6408-4a46-8fd0-97f0b88ff175 service neutron] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:06:44.736335 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3e4a5a-6408-4a46-8fd0-97f0b88ff175 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:06:44.746164 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3e4a5a-6408-4a46-8fd0-97f0b88ff175 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:06:44.747619 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3e4a5a-6408-4a46-8fd0-97f0b88ff175 service neutron] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:06:44.757522 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 735/1446] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:06:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 14:06:47.300149 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8886493d-b895-48f2-bfe5-aa9de719e7f6 None None] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:06:47.301227 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8886493d-b895-48f2-bfe5-aa9de719e7f6 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:06:47.301227 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8886493d-b895-48f2-bfe5-aa9de719e7f6 None None] PATH_INFO: `/` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:06:47.303242 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 712/1447] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 3 14:06:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 14:06:47.308740 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b66c9f2-f041-4d4f-8c31-7e1a7a4e5870 None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:06:47.309172 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b66c9f2-f041-4d4f-8c31-7e1a7a4e5870 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:06:47.309300 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b66c9f2-f041-4d4f-8c31-7e1a7a4e5870 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:06:47.331948 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-9b66c9f2-f041-4d4f-8c31-7e1a7a4e5870 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:06:47.333053 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-9b66c9f2-f041-4d4f-8c31-7e1a7a4e5870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:06:47.342371 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 736/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 3 14:06:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:06:47.382314 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8886493d-b895-48f2-bfe5-aa9de719e7f6 None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:06:47.394630 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8886493d-b895-48f2-bfe5-aa9de719e7f6 None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:06:47.399447 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e1bdf2-a7cf-4879-8135-b4839b5b20e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '937bea4f355144b4a7ee11baabc3a4cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:06:47.400091 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e1bdf2-a7cf-4879-8135-b4839b5b20e3 service neutron] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:06:47.400366 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e1bdf2-a7cf-4879-8135-b4839b5b20e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:06:47.400635 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e1bdf2-a7cf-4879-8135-b4839b5b20e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:06:47.411193 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e1bdf2-a7cf-4879-8135-b4839b5b20e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:06:47.412611 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e1bdf2-a7cf-4879-8135-b4839b5b20e3 service neutron] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:06:47.422362 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 713/1449] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:06:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 14:06:49.825249 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eb9f51-34b9-4c96-b8c9-3ca320d69bc1 None None] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:06:49.826171 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eb9f51-34b9-4c96-b8c9-3ca320d69bc1 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:06:49.826171 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eb9f51-34b9-4c96-b8c9-3ca320d69bc1 None None] PATH_INFO: `/` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:06:49.828363 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 737/1450] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 3 14:06:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 14:06:49.834903 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c41ad90-997a-4dee-accd-daf74953b197 None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:06:49.835684 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c41ad90-997a-4dee-accd-daf74953b197 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:06:49.835841 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c41ad90-997a-4dee-accd-daf74953b197 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:06:49.858898 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-2c41ad90-997a-4dee-accd-daf74953b197 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:06:49.860109 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-2c41ad90-997a-4dee-accd-daf74953b197 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:06:49.869617 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 714/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 3 14:06:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:06:49.908359 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07eb9f51-34b9-4c96-b8c9-3ca320d69bc1 None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:06:49.921244 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07eb9f51-34b9-4c96-b8c9-3ca320d69bc1 None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:06:49.926273 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927547b7-cca4-4a3b-b5bf-98d4df55a147 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '937bea4f355144b4a7ee11baabc3a4cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:06:49.926904 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927547b7-cca4-4a3b-b5bf-98d4df55a147 service neutron] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:06:49.927178 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927547b7-cca4-4a3b-b5bf-98d4df55a147 service neutron] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:06:49.927447 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927547b7-cca4-4a3b-b5bf-98d4df55a147 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:06:49.937891 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927547b7-cca4-4a3b-b5bf-98d4df55a147 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:06:49.939316 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927547b7-cca4-4a3b-b5bf-98d4df55a147 service neutron] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:06:49.948522 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 738/1452] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:06:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 14:06:52.214657 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac50dcb-73cd-44f5-9fc0-01b3ea11fcd3 None None] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:06:52.215261 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac50dcb-73cd-44f5-9fc0-01b3ea11fcd3 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:06:52.215261 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac50dcb-73cd-44f5-9fc0-01b3ea11fcd3 None None] PATH_INFO: `/` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:06:52.217433 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 715/1453] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 3 14:06:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 14:06:52.225412 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959199a7-a3a0-4ce1-a43b-d61abaed3d59 None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:06:52.225898 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959199a7-a3a0-4ce1-a43b-d61abaed3d59 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:06:52.226006 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959199a7-a3a0-4ce1-a43b-d61abaed3d59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:06:52.248049 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-959199a7-a3a0-4ce1-a43b-d61abaed3d59 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:06:52.249695 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-959199a7-a3a0-4ce1-a43b-d61abaed3d59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:06:52.259672 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 739/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 3 14:06:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:06:52.301220 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac50dcb-73cd-44f5-9fc0-01b3ea11fcd3 None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:06:52.319007 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac50dcb-73cd-44f5-9fc0-01b3ea11fcd3 None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:06:52.323854 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536f17e1-69b1-4f4e-ab76-80e6a1766425 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '937bea4f355144b4a7ee11baabc3a4cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:06:52.324570 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536f17e1-69b1-4f4e-ab76-80e6a1766425 service neutron] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:06:52.324847 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536f17e1-69b1-4f4e-ab76-80e6a1766425 service neutron] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:06:52.325117 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536f17e1-69b1-4f4e-ab76-80e6a1766425 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:06:52.334949 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536f17e1-69b1-4f4e-ab76-80e6a1766425 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:06:52.336385 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536f17e1-69b1-4f4e-ab76-80e6a1766425 service neutron] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:06:52.346533 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 716/1455] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:06:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 14:06:54.627186 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04075cfd-682f-451c-827c-b75f873ee210 None None] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:06:54.627814 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04075cfd-682f-451c-827c-b75f873ee210 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:06:54.627814 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04075cfd-682f-451c-827c-b75f873ee210 None None] PATH_INFO: `/` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:06:54.629155 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 740/1456] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 3 14:06:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 14:06:54.635786 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb4a28f-15f6-42b1-9784-dc8d33629561 None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:06:54.636530 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb4a28f-15f6-42b1-9784-dc8d33629561 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:06:54.636805 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb4a28f-15f6-42b1-9784-dc8d33629561 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:06:54.657778 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-7cb4a28f-15f6-42b1-9784-dc8d33629561 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:06:54.658976 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-7cb4a28f-15f6-42b1-9784-dc8d33629561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:06:54.667401 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 717/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 3 14:06:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:06:54.705580 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04075cfd-682f-451c-827c-b75f873ee210 None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:06:54.717900 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04075cfd-682f-451c-827c-b75f873ee210 None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:06:54.722171 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a3dabc-250a-42b3-9bed-f3e1583680ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '937bea4f355144b4a7ee11baabc3a4cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:06:54.722822 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a3dabc-250a-42b3-9bed-f3e1583680ac service neutron] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:06:54.723103 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a3dabc-250a-42b3-9bed-f3e1583680ac service neutron] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:06:54.723370 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a3dabc-250a-42b3-9bed-f3e1583680ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:06:54.732376 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a3dabc-250a-42b3-9bed-f3e1583680ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:06:54.733932 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a3dabc-250a-42b3-9bed-f3e1583680ac service neutron] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:06:54.743097 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 741/1458] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:06:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 14:06:56.999237 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1b6859-4781-40da-9f29-6db6ed902eac None None] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:06:57.000151 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1b6859-4781-40da-9f29-6db6ed902eac None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:06:57.000151 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1b6859-4781-40da-9f29-6db6ed902eac None None] PATH_INFO: `/` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:06:57.002445 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 718/1459] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 3 14:06:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 14:06:57.007909 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116db44b-cda8-4477-92f4-335d2604c950 None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:06:57.008366 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116db44b-cda8-4477-92f4-335d2604c950 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:06:57.008470 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116db44b-cda8-4477-92f4-335d2604c950 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:06:57.027206 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-116db44b-cda8-4477-92f4-335d2604c950 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:06:57.028351 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-116db44b-cda8-4477-92f4-335d2604c950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:06:57.036709 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 742/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 3 14:06:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:06:57.073502 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1b6859-4781-40da-9f29-6db6ed902eac None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:06:57.088301 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1b6859-4781-40da-9f29-6db6ed902eac None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:06:57.095333 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6377cc6-bf16-429b-af52-d792dff8433e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '937bea4f355144b4a7ee11baabc3a4cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:06:57.096240 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6377cc6-bf16-429b-af52-d792dff8433e service neutron] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:06:57.096577 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6377cc6-bf16-429b-af52-d792dff8433e service neutron] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:06:57.096851 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6377cc6-bf16-429b-af52-d792dff8433e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:06:57.112293 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6377cc6-bf16-429b-af52-d792dff8433e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:06:57.113753 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6377cc6-bf16-429b-af52-d792dff8433e service neutron] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:06:57.123873 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 719/1461] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:06:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 14:06:59.376925 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77ff481-52fe-468d-89d2-fa9ba8af1501 None None] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:06:59.377659 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77ff481-52fe-468d-89d2-fa9ba8af1501 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:06:59.377659 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77ff481-52fe-468d-89d2-fa9ba8af1501 None None] PATH_INFO: `/` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:06:59.379243 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 743/1462] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 3 14:06:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 14:06:59.385275 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccee292-04cc-4387-af40-ad080c60ee96 None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:06:59.385752 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccee292-04cc-4387-af40-ad080c60ee96 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:06:59.385866 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccee292-04cc-4387-af40-ad080c60ee96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:06:59.408224 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-9ccee292-04cc-4387-af40-ad080c60ee96 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:06:59.409486 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-9ccee292-04cc-4387-af40-ad080c60ee96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:06:59.418901 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 720/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 3 14:06:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:06:59.457542 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77ff481-52fe-468d-89d2-fa9ba8af1501 None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:06:59.472417 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77ff481-52fe-468d-89d2-fa9ba8af1501 None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:06:59.478337 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfae8f6f-27bf-481a-8dc3-5f03e5e3bdae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '937bea4f355144b4a7ee11baabc3a4cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:06:59.478999 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfae8f6f-27bf-481a-8dc3-5f03e5e3bdae service neutron] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:06:59.479277 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfae8f6f-27bf-481a-8dc3-5f03e5e3bdae service neutron] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:06:59.479547 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfae8f6f-27bf-481a-8dc3-5f03e5e3bdae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:06:59.491230 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfae8f6f-27bf-481a-8dc3-5f03e5e3bdae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:06:59.492679 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfae8f6f-27bf-481a-8dc3-5f03e5e3bdae service neutron] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:06:59.502798 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 744/1464] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:06:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 14:07:01.805036 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e2f0f5-3b62-4b8d-9f88-933f87e60ff0 None None] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:07:01.805602 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e2f0f5-3b62-4b8d-9f88-933f87e60ff0 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:07:01.805602 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e2f0f5-3b62-4b8d-9f88-933f87e60ff0 None None] PATH_INFO: `/` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:07:01.807028 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 721/1465] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 3 14:07:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 14:07:01.812533 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd4e2cb-b466-45f8-9d76-426348d68462 None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:07:01.812961 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd4e2cb-b466-45f8-9d76-426348d68462 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:07:01.813055 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd4e2cb-b466-45f8-9d76-426348d68462 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:07:01.831915 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-dfd4e2cb-b466-45f8-9d76-426348d68462 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:07:01.833102 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-dfd4e2cb-b466-45f8-9d76-426348d68462 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:07:01.841917 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 745/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 3 14:07:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:07:01.878668 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e2f0f5-3b62-4b8d-9f88-933f87e60ff0 None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:07:01.889853 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e2f0f5-3b62-4b8d-9f88-933f87e60ff0 None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:07:01.893755 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0012b272-f347-4e14-a468-422e38b31a07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '937bea4f355144b4a7ee11baabc3a4cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:07:01.894392 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0012b272-f347-4e14-a468-422e38b31a07 service neutron] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:07:01.894672 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0012b272-f347-4e14-a468-422e38b31a07 service neutron] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:07:01.894952 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0012b272-f347-4e14-a468-422e38b31a07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:07:01.903805 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0012b272-f347-4e14-a468-422e38b31a07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:07:01.905226 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0012b272-f347-4e14-a468-422e38b31a07 service neutron] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:07:01.914440 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 722/1467] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:07:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 14:07:04.123900 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a326b898-4ae8-4890-99d8-d4939e5b17e9 None None] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:07:04.124446 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a326b898-4ae8-4890-99d8-d4939e5b17e9 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:07:04.124446 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a326b898-4ae8-4890-99d8-d4939e5b17e9 None None] PATH_INFO: `/` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:07:04.125851 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 746/1468] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 3 14:07:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 14:07:04.131478 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad16cdf-ba00-4691-ba65-5082ab97a18b None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:07:04.131946 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad16cdf-ba00-4691-ba65-5082ab97a18b None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:07:04.132051 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad16cdf-ba00-4691-ba65-5082ab97a18b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:07:04.151486 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-3ad16cdf-ba00-4691-ba65-5082ab97a18b None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:07:04.152684 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-3ad16cdf-ba00-4691-ba65-5082ab97a18b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:07:04.163726 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 723/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 3 14:07:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:07:04.202948 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a326b898-4ae8-4890-99d8-d4939e5b17e9 None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:07:04.220791 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a326b898-4ae8-4890-99d8-d4939e5b17e9 None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:07:04.225532 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a5487d-41a1-4cfb-a642-3d36812d1351 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '937bea4f355144b4a7ee11baabc3a4cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:07:04.226175 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a5487d-41a1-4cfb-a642-3d36812d1351 service neutron] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:07:04.226456 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a5487d-41a1-4cfb-a642-3d36812d1351 service neutron] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:07:04.226729 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a5487d-41a1-4cfb-a642-3d36812d1351 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:07:04.236855 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a5487d-41a1-4cfb-a642-3d36812d1351 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:07:04.238433 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a5487d-41a1-4cfb-a642-3d36812d1351 service neutron] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:07:04.247990 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 747/1470] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:07:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 14:07:37.293700 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb005a1-b4e4-41cd-b440-69d4a2c8206c None None] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:07:37.294628 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb005a1-b4e4-41cd-b440-69d4a2c8206c None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:07:37.294628 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb005a1-b4e4-41cd-b440-69d4a2c8206c None None] PATH_INFO: `/` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:07:37.296864 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 724/1471] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 3 14:07:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 14:07:37.305985 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b9c663-ba96-4d16-9a04-0de79cfb862a None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:07:37.306772 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b9c663-ba96-4d16-9a04-0de79cfb862a None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:07:37.306942 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b9c663-ba96-4d16-9a04-0de79cfb862a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:07:37.328511 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-94b9c663-ba96-4d16-9a04-0de79cfb862a None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:07:37.329741 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-94b9c663-ba96-4d16-9a04-0de79cfb862a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:07:37.338849 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 748/1472] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 3 14:07:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:07:37.390255 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f84fb0-e109-4b28-be89-4acb11ce59fa None None] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:07:37.390745 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f84fb0-e109-4b28-be89-4acb11ce59fa None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:07:37.391205 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f84fb0-e109-4b28-be89-4acb11ce59fa None None] PATH_INFO: `/` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:07:37.393497 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 725/1473] 10.222.0.36 () {54 vars in 962 bytes} [Tue May 3 14:07:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 14:07:37.398391 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204ba0b4-90c5-43fa-9601-2d8e87c2dbe5 None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:07:37.398676 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204ba0b4-90c5-43fa-9601-2d8e87c2dbe5 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:07:37.398948 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204ba0b4-90c5-43fa-9601-2d8e87c2dbe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:07:37.427989 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-204ba0b4-90c5-43fa-9601-2d8e87c2dbe5 None None] MFA Rules not processed for user `616de5e7daed46849efc75ad77ea054e`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:07:37.429201 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-204ba0b4-90c5-43fa-9601-2d8e87c2dbe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:07:37.436920 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 749/1474] 10.222.0.36 () {58 vars in 1059 bytes} [Tue May 3 14:07:37 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:07:37.444600 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f84fb0-e109-4b28-be89-4acb11ce59fa None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:07:37.457029 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f84fb0-e109-4b28-be89-4acb11ce59fa None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:07:37.461609 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb519187-3c16-4899-a100-c407b8f3a6df service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '616de5e7daed46849efc75ad77ea054e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:07:37.462241 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb519187-3c16-4899-a100-c407b8f3a6df service glance] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:07:37.462834 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb519187-3c16-4899-a100-c407b8f3a6df service glance] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:07:37.463107 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb519187-3c16-4899-a100-c407b8f3a6df service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:07:37.473491 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb519187-3c16-4899-a100-c407b8f3a6df service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:07:37.474931 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb519187-3c16-4899-a100-c407b8f3a6df service glance] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:07:37.484803 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 726/1475] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:07:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 14:07:39.782804 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5201b068-79fc-4a0f-8dee-72c774896390 None None] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:07:39.783264 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5201b068-79fc-4a0f-8dee-72c774896390 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:07:39.783368 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5201b068-79fc-4a0f-8dee-72c774896390 None None] PATH_INFO: `/` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:07:39.784776 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 750/1476] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 3 14:07:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 14:07:39.791105 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5430edc-4ce4-417f-9090-afedc9fb9919 None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:07:39.791872 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5430edc-4ce4-417f-9090-afedc9fb9919 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:07:39.792039 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5430edc-4ce4-417f-9090-afedc9fb9919 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:07:39.812951 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-f5430edc-4ce4-417f-9090-afedc9fb9919 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:07:39.814182 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-f5430edc-4ce4-417f-9090-afedc9fb9919 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:07:39.822937 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 727/1477] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 3 14:07:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:07:39.847541 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5201b068-79fc-4a0f-8dee-72c774896390 None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:07:39.861502 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5201b068-79fc-4a0f-8dee-72c774896390 None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:07:39.866625 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc97e1c-499b-4386-aba3-f59e2df5517e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:07:39.867260 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc97e1c-499b-4386-aba3-f59e2df5517e admin admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:07:39.867533 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc97e1c-499b-4386-aba3-f59e2df5517e admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:07:39.867802 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc97e1c-499b-4386-aba3-f59e2df5517e admin admin] PATH_INFO: `/v3/projects` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:07:39.868558 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc97e1c-499b-4386-aba3-f59e2df5517e admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:07:39.870346 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: WARNING py.warnings [None req-8bc97e1c-499b-4386-aba3-f59e2df5517e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 03 14:07:39.870346 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: warnings.warn(msg) May 03 14:07:39.870346 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: May 03 14:07:39.871478 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc97e1c-499b-4386-aba3-f59e2df5517e admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:07:39.890129 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 751/1478] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 3 14:07:39 2022] GET /identity/v3/projects => generated 2553 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 14:07:42.148116 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec2c5f9-fa59-4ba8-8da3-ae2fa46409be None None] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:07:42.148696 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec2c5f9-fa59-4ba8-8da3-ae2fa46409be None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:07:42.148696 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec2c5f9-fa59-4ba8-8da3-ae2fa46409be None None] PATH_INFO: `/` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:07:42.150089 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 728/1479] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 3 14:07:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 14:07:42.156538 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09af212-f618-46cd-b7bd-0739c1e14906 None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:07:42.157333 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09af212-f618-46cd-b7bd-0739c1e14906 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:07:42.157522 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09af212-f618-46cd-b7bd-0739c1e14906 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:07:42.181065 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-d09af212-f618-46cd-b7bd-0739c1e14906 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:07:42.182313 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-d09af212-f618-46cd-b7bd-0739c1e14906 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:07:42.191321 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 752/1480] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 3 14:07:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:07:42.233811 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec2c5f9-fa59-4ba8-8da3-ae2fa46409be None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:07:42.248224 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec2c5f9-fa59-4ba8-8da3-ae2fa46409be None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:07:42.254266 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d2c027-2813-4cd2-ad70-0d2934654b9f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63489e658c094a2598a2ac62159d2fda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:07:42.254895 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d2c027-2813-4cd2-ad70-0d2934654b9f service nova] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:07:42.255173 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d2c027-2813-4cd2-ad70-0d2934654b9f service nova] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:07:42.255446 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d2c027-2813-4cd2-ad70-0d2934654b9f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:07:42.263925 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d2c027-2813-4cd2-ad70-0d2934654b9f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:07:42.265543 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d2c027-2813-4cd2-ad70-0d2934654b9f service nova] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:07:42.279192 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 729/1481] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:07:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 14:07:44.674780 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3179ec21-272c-41b7-98ea-e8cc7f363b90 None None] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:07:44.675378 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3179ec21-272c-41b7-98ea-e8cc7f363b90 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:07:44.675378 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3179ec21-272c-41b7-98ea-e8cc7f363b90 None None] PATH_INFO: `/` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:07:44.676696 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 753/1482] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 3 14:07:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 14:07:44.682122 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec770af-74ea-4027-afa4-261440dba7e4 None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:07:44.682550 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec770af-74ea-4027-afa4-261440dba7e4 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:07:44.682643 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec770af-74ea-4027-afa4-261440dba7e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:07:44.701154 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-4ec770af-74ea-4027-afa4-261440dba7e4 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:07:44.702352 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-4ec770af-74ea-4027-afa4-261440dba7e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:07:44.711248 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 730/1483] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 3 14:07:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:07:44.746842 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3179ec21-272c-41b7-98ea-e8cc7f363b90 None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:07:44.761502 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3179ec21-272c-41b7-98ea-e8cc7f363b90 None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:07:44.767071 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a441bc4a-c166-4360-96fb-aac84aead131 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '937bea4f355144b4a7ee11baabc3a4cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:07:44.767730 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a441bc4a-c166-4360-96fb-aac84aead131 service neutron] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:07:44.768001 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a441bc4a-c166-4360-96fb-aac84aead131 service neutron] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:07:44.768275 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a441bc4a-c166-4360-96fb-aac84aead131 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:07:44.778294 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a441bc4a-c166-4360-96fb-aac84aead131 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:07:44.779711 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a441bc4a-c166-4360-96fb-aac84aead131 service neutron] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:07:44.789661 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 754/1484] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:07:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 14:07:47.065711 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84adf7c-7fc4-4da1-bb81-655f27e89eb0 None None] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:07:47.066335 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84adf7c-7fc4-4da1-bb81-655f27e89eb0 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:07:47.066335 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84adf7c-7fc4-4da1-bb81-655f27e89eb0 None None] PATH_INFO: `/` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:07:47.067926 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 731/1485] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 3 14:07:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 14:07:47.075731 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bff141-7f29-4ede-a4b1-d47dccec6243 None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:07:47.076302 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bff141-7f29-4ede-a4b1-d47dccec6243 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:07:47.076302 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bff141-7f29-4ede-a4b1-d47dccec6243 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:07:47.102449 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-f0bff141-7f29-4ede-a4b1-d47dccec6243 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:07:47.103656 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-f0bff141-7f29-4ede-a4b1-d47dccec6243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:07:47.112694 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 755/1486] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 3 14:07:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 14:07:47.154501 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84adf7c-7fc4-4da1-bb81-655f27e89eb0 None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:07:47.173682 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84adf7c-7fc4-4da1-bb81-655f27e89eb0 None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:07:47.178162 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9869d7b6-dc32-4557-bc40-61c0cff057a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '937bea4f355144b4a7ee11baabc3a4cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:07:47.178799 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9869d7b6-dc32-4557-bc40-61c0cff057a0 service neutron] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:07:47.179073 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9869d7b6-dc32-4557-bc40-61c0cff057a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:07:47.179338 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9869d7b6-dc32-4557-bc40-61c0cff057a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:07:47.189256 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9869d7b6-dc32-4557-bc40-61c0cff057a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:07:47.190732 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9869d7b6-dc32-4557-bc40-61c0cff057a0 service neutron] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:07:47.200727 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 732/1487] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:07:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 14:07:49.525614 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d6cf90-91e1-428d-9e34-13f6d26913ad None None] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:07:49.526512 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d6cf90-91e1-428d-9e34-13f6d26913ad None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:07:49.526512 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d6cf90-91e1-428d-9e34-13f6d26913ad None None] PATH_INFO: `/` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:07:49.528637 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 756/1488] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 3 14:07:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 14:07:49.537824 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c29316-ca1b-4fc6-83c6-a1ead285401b None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:07:49.538273 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c29316-ca1b-4fc6-83c6-a1ead285401b None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:07:49.538379 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c29316-ca1b-4fc6-83c6-a1ead285401b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:07:49.560532 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-76c29316-ca1b-4fc6-83c6-a1ead285401b None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:07:49.561763 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-76c29316-ca1b-4fc6-83c6-a1ead285401b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:07:49.570648 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 733/1489] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 3 14:07:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:07:49.610510 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d6cf90-91e1-428d-9e34-13f6d26913ad None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:07:49.623130 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d6cf90-91e1-428d-9e34-13f6d26913ad None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:07:49.627568 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9673e8aa-0630-4f99-b0ef-03fe00a79807 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '937bea4f355144b4a7ee11baabc3a4cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:07:49.628215 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9673e8aa-0630-4f99-b0ef-03fe00a79807 service neutron] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:07:49.628497 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9673e8aa-0630-4f99-b0ef-03fe00a79807 service neutron] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:07:49.628799 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9673e8aa-0630-4f99-b0ef-03fe00a79807 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:07:49.638212 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9673e8aa-0630-4f99-b0ef-03fe00a79807 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:07:49.639648 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9673e8aa-0630-4f99-b0ef-03fe00a79807 service neutron] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:07:49.649948 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 757/1490] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:07:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 14:07:52.066614 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1a11fd-42cb-4e71-9c39-942408b6a6fa None None] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:07:52.066614 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1a11fd-42cb-4e71-9c39-942408b6a6fa None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:07:52.066614 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1a11fd-42cb-4e71-9c39-942408b6a6fa None None] PATH_INFO: `/` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:07:52.068012 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 734/1491] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 3 14:07:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 14:07:52.074123 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd55cad-9cac-4813-8aff-490725e72705 None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:07:52.074602 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd55cad-9cac-4813-8aff-490725e72705 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:07:52.074795 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd55cad-9cac-4813-8aff-490725e72705 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:07:52.099712 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-4fd55cad-9cac-4813-8aff-490725e72705 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:07:52.100891 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-4fd55cad-9cac-4813-8aff-490725e72705 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:07:52.111215 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 758/1492] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 3 14:07:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:07:52.151714 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1a11fd-42cb-4e71-9c39-942408b6a6fa None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:07:52.165492 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1a11fd-42cb-4e71-9c39-942408b6a6fa None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:07:52.169231 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7175ba-016c-4b5d-ae37-51901ab5bf31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '937bea4f355144b4a7ee11baabc3a4cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:07:52.169908 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7175ba-016c-4b5d-ae37-51901ab5bf31 service neutron] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:07:52.170188 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7175ba-016c-4b5d-ae37-51901ab5bf31 service neutron] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:07:52.170462 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7175ba-016c-4b5d-ae37-51901ab5bf31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:07:52.180015 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7175ba-016c-4b5d-ae37-51901ab5bf31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:07:52.181490 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7175ba-016c-4b5d-ae37-51901ab5bf31 service neutron] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:07:52.190849 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 735/1493] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:07:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 14:09:19.041581 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcab52b-c7f3-4d92-bdde-ad24df16982a None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:09:19.042137 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcab52b-c7f3-4d92-bdde-ad24df16982a None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:09:19.042137 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcab52b-c7f3-4d92-bdde-ad24df16982a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:09:19.066787 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-ebcab52b-c7f3-4d92-bdde-ad24df16982a None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:09:19.067958 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-ebcab52b-c7f3-4d92-bdde-ad24df16982a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:09:19.077524 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 759/1494] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:09:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:09:19.086126 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9e8464-e164-456c-907b-9152c76be5b8 None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:09:19.086575 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9e8464-e164-456c-907b-9152c76be5b8 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:09:19.086682 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9e8464-e164-456c-907b-9152c76be5b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:09:19.106644 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-ca9e8464-e164-456c-907b-9152c76be5b8 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:09:19.107817 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-ca9e8464-e164-456c-907b-9152c76be5b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:09:19.117873 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 736/1495] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:09:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:09:19.122485 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcab52b-c7f3-4d92-bdde-ad24df16982a None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:09:19.132998 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcab52b-c7f3-4d92-bdde-ad24df16982a None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:09:19.139047 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798b6bda-5709-4358-a9e3-7d7a80bd7f76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:09:19.139668 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798b6bda-5709-4358-a9e3-7d7a80bd7f76 admin admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:09:19.140100 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798b6bda-5709-4358-a9e3-7d7a80bd7f76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:09:19.140366 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798b6bda-5709-4358-a9e3-7d7a80bd7f76 admin admin] PATH_INFO: `/v3/domains` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:09:19.141084 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798b6bda-5709-4358-a9e3-7d7a80bd7f76 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:09:19.141409 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798b6bda-5709-4358-a9e3-7d7a80bd7f76 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:09:19.142436 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: WARNING py.warnings [None req-798b6bda-5709-4358-a9e3-7d7a80bd7f76 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 03 14:09:19.142436 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: warnings.warn(msg) May 03 14:09:19.142436 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: May 03 14:09:19.143303 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798b6bda-5709-4358-a9e3-7d7a80bd7f76 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:09:19.156230 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 760/1496] 10.222.0.36 () {58 vars in 1152 bytes} [Tue May 3 14:09:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:09:19.168988 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9e8464-e164-456c-907b-9152c76be5b8 None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:09:19.183012 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9e8464-e164-456c-907b-9152c76be5b8 None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:09:19.190339 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a79480f-c279-4528-83d2-8646b4a768bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:09:19.191001 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a79480f-c279-4528-83d2-8646b4a768bc admin admin] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:09:19.191278 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a79480f-c279-4528-83d2-8646b4a768bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:09:19.191548 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a79480f-c279-4528-83d2-8646b4a768bc admin admin] PATH_INFO: `/v3/projects` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:09:19.192234 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a79480f-c279-4528-83d2-8646b4a768bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:09:19.194075 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: WARNING py.warnings [None req-4a79480f-c279-4528-83d2-8646b4a768bc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 03 14:09:19.194075 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: warnings.warn(msg) May 03 14:09:19.194075 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: May 03 14:09:19.195270 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a79480f-c279-4528-83d2-8646b4a768bc admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:09:19.235454 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 737/1497] 10.222.0.36 () {60 vars in 1152 bytes} [Tue May 3 14:09:19 2022] POST /identity/v3/projects => generated 379 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 14:09:19.240485 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798b6bda-5709-4358-a9e3-7d7a80bd7f76 admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:09:19.253904 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798b6bda-5709-4358-a9e3-7d7a80bd7f76 admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:09:19.310303 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cb40e6-9b5d-438a-82a2-36659526cbea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:09:19.310970 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cb40e6-9b5d-438a-82a2-36659526cbea admin admin] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:09:19.311246 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cb40e6-9b5d-438a-82a2-36659526cbea admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:09:19.311532 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cb40e6-9b5d-438a-82a2-36659526cbea admin admin] PATH_INFO: `/v3/users` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:09:19.312227 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cb40e6-9b5d-438a-82a2-36659526cbea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:09:19.313224 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: WARNING py.warnings [None req-94cb40e6-9b5d-438a-82a2-36659526cbea admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 03 14:09:19.313224 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: warnings.warn(msg) May 03 14:09:19.313224 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: May 03 14:09:19.314529 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cb40e6-9b5d-438a-82a2-36659526cbea admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:09:19.335616 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 761/1498] 10.222.0.36 () {60 vars in 1143 bytes} [Tue May 3 14:09:19 2022] POST /identity/v3/users => generated 290 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 14:09:19.340140 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a79480f-c279-4528-83d2-8646b4a768bc admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:09:19.350587 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a79480f-c279-4528-83d2-8646b4a768bc admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:09:19.355334 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f56179d-c8ac-4b1d-b499-8433cf389adc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:09:19.355987 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f56179d-c8ac-4b1d-b499-8433cf389adc admin admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:09:19.356275 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f56179d-c8ac-4b1d-b499-8433cf389adc admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:09:19.356541 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f56179d-c8ac-4b1d-b499-8433cf389adc admin admin] PATH_INFO: `/v3/roles` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:09:19.357306 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f56179d-c8ac-4b1d-b499-8433cf389adc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:09:19.358349 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: WARNING py.warnings [None req-1f56179d-c8ac-4b1d-b499-8433cf389adc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 03 14:09:19.358349 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: warnings.warn(msg) May 03 14:09:19.358349 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: May 03 14:09:19.359264 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f56179d-c8ac-4b1d-b499-8433cf389adc admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:09:19.373049 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 738/1499] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 3 14:09:19 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 14:09:19.378589 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cb40e6-9b5d-438a-82a2-36659526cbea admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:09:19.392461 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cb40e6-9b5d-438a-82a2-36659526cbea admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:09:19.397164 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2999c57e-620f-434c-acd0-4a603eef2676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:09:19.397868 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2999c57e-620f-434c-acd0-4a603eef2676 admin admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:09:19.398141 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2999c57e-620f-434c-acd0-4a603eef2676 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:09:19.398411 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2999c57e-620f-434c-acd0-4a603eef2676 admin admin] PATH_INFO: `/v3/roles` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:09:19.399133 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2999c57e-620f-434c-acd0-4a603eef2676 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:09:19.400138 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: WARNING py.warnings [None req-2999c57e-620f-434c-acd0-4a603eef2676 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 03 14:09:19.400138 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: warnings.warn(msg) May 03 14:09:19.400138 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: May 03 14:09:19.401003 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2999c57e-620f-434c-acd0-4a603eef2676 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:09:19.414606 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 762/1500] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 3 14:09:19 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 14:09:19.418870 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f56179d-c8ac-4b1d-b499-8433cf389adc admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:09:19.429561 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f56179d-c8ac-4b1d-b499-8433cf389adc admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:09:19.434254 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a7b7a4-25f4-4b9d-a692-c4480b9e5995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:09:19.435126 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a7b7a4-25f4-4b9d-a692-c4480b9e5995 admin admin] REQUEST_METHOD: `PUT` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:09:19.435417 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a7b7a4-25f4-4b9d-a692-c4480b9e5995 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:09:19.435692 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a7b7a4-25f4-4b9d-a692-c4480b9e5995 admin admin] PATH_INFO: `/v3/projects/a6e7ec609403494791d3550bfa9343e4/users/b1399768696344999bffe8d65d77e824/roles/441fdc11e95b47f4813f72610e39018b` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:09:19.451492 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a7b7a4-25f4-4b9d-a692-c4480b9e5995 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6e7ec609403494791d3550bfa9343e4, user_id=b1399768696344999bffe8d65d77e824, role_id=441fdc11e95b47f4813f72610e39018b)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:09:19.452832 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: WARNING py.warnings [None req-66a7b7a4-25f4-4b9d-a692-c4480b9e5995 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 03 14:09:19.452832 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: warnings.warn(msg) May 03 14:09:19.452832 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: May 03 14:09:19.454725 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a7b7a4-25f4-4b9d-a692-c4480b9e5995 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:09:19.471819 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 739/1501] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 3 14:09:19 2022] PUT /identity/v3/projects/a6e7ec609403494791d3550bfa9343e4/users/b1399768696344999bffe8d65d77e824/roles/441fdc11e95b47f4813f72610e39018b => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 14:09:19.487811 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb37a62-9f69-49a1-b1af-25aeb68cc6a1 None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:09:19.488025 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb37a62-9f69-49a1-b1af-25aeb68cc6a1 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:09:19.488284 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb37a62-9f69-49a1-b1af-25aeb68cc6a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:09:19.516399 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-9eb37a62-9f69-49a1-b1af-25aeb68cc6a1 None None] MFA Rules not processed for user `b1399768696344999bffe8d65d77e824`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:09:19.517651 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-9eb37a62-9f69-49a1-b1af-25aeb68cc6a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:09:19.588315 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 763/1502] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:09:19 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:09:19.599979 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a7b7a4-25f4-4b9d-a692-c4480b9e5995 admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:09:19.682562 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a7b7a4-25f4-4b9d-a692-c4480b9e5995 admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:09:19.689613 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dd49b8-9e11-4be0-bdf1-4e0f2d0e1b4a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63489e658c094a2598a2ac62159d2fda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:09:19.690261 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dd49b8-9e11-4be0-bdf1-4e0f2d0e1b4a service nova] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:09:19.690537 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dd49b8-9e11-4be0-bdf1-4e0f2d0e1b4a service nova] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:09:19.690803 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dd49b8-9e11-4be0-bdf1-4e0f2d0e1b4a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:09:19.699522 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19dd49b8-9e11-4be0-bdf1-4e0f2d0e1b4a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:09:19.701222 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19dd49b8-9e11-4be0-bdf1-4e0f2d0e1b4a service nova] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:09:19.710379 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 740/1503] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:09:19 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 14:09:19.781034 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90490184-d5b1-45d6-b267-1061828c26cd None None] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:09:19.781361 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90490184-d5b1-45d6-b267-1061828c26cd None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:09:19.781644 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90490184-d5b1-45d6-b267-1061828c26cd None None] PATH_INFO: `/` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:09:19.782941 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 764/1504] 10.222.0.36 () {52 vars in 829 bytes} [Tue May 3 14:09:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 14:09:19.786884 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dd49b8-9e11-4be0-bdf1-4e0f2d0e1b4a service nova] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:09:19.860704 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dd49b8-9e11-4be0-bdf1-4e0f2d0e1b4a service nova] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:09:19.868680 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7108c28c-fd4d-44b5-9017-4be3f02f5720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:09:19.870044 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7108c28c-fd4d-44b5-9017-4be3f02f5720 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:09:19.870404 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7108c28c-fd4d-44b5-9017-4be3f02f5720 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:09:19.870777 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7108c28c-fd4d-44b5-9017-4be3f02f5720 admin admin] PATH_INFO: `/v3/users/b1399768696344999bffe8d65d77e824` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:09:19.872552 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7108c28c-fd4d-44b5-9017-4be3f02f5720 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1399768696344999bffe8d65d77e824)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:09:19.874043 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: WARNING py.warnings [None req-7108c28c-fd4d-44b5-9017-4be3f02f5720 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 03 14:09:19.874043 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: warnings.warn(msg) May 03 14:09:19.874043 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: May 03 14:09:19.875484 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7108c28c-fd4d-44b5-9017-4be3f02f5720 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:09:19.942808 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-7108c28c-fd4d-44b5-9017-4be3f02f5720 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1399768696344999bffe8d65d77e824'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:09:19.955652 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-7108c28c-fd4d-44b5-9017-4be3f02f5720 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1399768696344999bffe8d65d77e824'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:09:19.956359 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-7108c28c-fd4d-44b5-9017-4be3f02f5720 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1399768696344999bffe8d65d77e824'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:09:19.975721 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-7108c28c-fd4d-44b5-9017-4be3f02f5720 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1399768696344999bffe8d65d77e824'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:09:19.979778 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-7108c28c-fd4d-44b5-9017-4be3f02f5720 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1399768696344999bffe8d65d77e824'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:09:20.000409 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 741/1505] 10.222.0.36 () {58 vars in 1223 bytes} [Tue May 3 14:09:19 2022] DELETE /identity/v3/users/b1399768696344999bffe8d65d77e824 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:09:20.005012 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194a3ca3-27e3-4a2e-963e-f60cbadc9ce1 None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:09:20.005325 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194a3ca3-27e3-4a2e-963e-f60cbadc9ce1 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:09:20.005609 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194a3ca3-27e3-4a2e-963e-f60cbadc9ce1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:09:20.023643 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-194a3ca3-27e3-4a2e-963e-f60cbadc9ce1 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:09:20.024848 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-194a3ca3-27e3-4a2e-963e-f60cbadc9ce1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:09:20.086461 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 765/1506] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:09:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:09:20.096464 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7108c28c-fd4d-44b5-9017-4be3f02f5720 admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:09:20.098005 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-7108c28c-fd4d-44b5-9017-4be3f02f5720 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:09:20.163099 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7108c28c-fd4d-44b5-9017-4be3f02f5720 admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:09:20.169766 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc3afc7-f795-40a0-9b35-deb039ba8fbf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '937bea4f355144b4a7ee11baabc3a4cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:09:20.170793 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc3afc7-f795-40a0-9b35-deb039ba8fbf service neutron] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:09:20.171211 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc3afc7-f795-40a0-9b35-deb039ba8fbf service neutron] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:09:20.171488 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc3afc7-f795-40a0-9b35-deb039ba8fbf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:09:20.181578 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc3afc7-f795-40a0-9b35-deb039ba8fbf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:09:20.183009 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc3afc7-f795-40a0-9b35-deb039ba8fbf service neutron] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:09:20.192440 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 742/1507] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:09:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 14:09:20.531687 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194a3ca3-27e3-4a2e-963e-f60cbadc9ce1 None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:09:20.533597 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-194a3ca3-27e3-4a2e-963e-f60cbadc9ce1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:09:20.546094 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194a3ca3-27e3-4a2e-963e-f60cbadc9ce1 None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:09:20.551705 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d68cfa-ac8b-432d-ba6e-36fafcc1c81d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:09:20.552617 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d68cfa-ac8b-432d-ba6e-36fafcc1c81d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:09:20.552897 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d68cfa-ac8b-432d-ba6e-36fafcc1c81d admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:09:20.553174 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d68cfa-ac8b-432d-ba6e-36fafcc1c81d admin admin] PATH_INFO: `/v3/projects/a6e7ec609403494791d3550bfa9343e4` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:09:20.554517 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d68cfa-ac8b-432d-ba6e-36fafcc1c81d admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6e7ec609403494791d3550bfa9343e4)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:09:20.555744 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: WARNING py.warnings [None req-04d68cfa-ac8b-432d-ba6e-36fafcc1c81d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 03 14:09:20.555744 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: warnings.warn(msg) May 03 14:09:20.555744 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: May 03 14:09:20.556954 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d68cfa-ac8b-432d-ba6e-36fafcc1c81d admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:09:20.617416 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-04d68cfa-ac8b-432d-ba6e-36fafcc1c81d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6e7ec609403494791d3550bfa9343e4', 'request_id': 'req-04d68cfa-ac8b-432d-ba6e-36fafcc1c81d'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:09:20.623366 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-04d68cfa-ac8b-432d-ba6e-36fafcc1c81d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6e7ec609403494791d3550bfa9343e4', 'request_id': 'req-04d68cfa-ac8b-432d-ba6e-36fafcc1c81d'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:09:20.635291 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-04d68cfa-ac8b-432d-ba6e-36fafcc1c81d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6e7ec609403494791d3550bfa9343e4', 'request_id': 'req-04d68cfa-ac8b-432d-ba6e-36fafcc1c81d'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:09:20.654084 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-04d68cfa-ac8b-432d-ba6e-36fafcc1c81d admin admin] The token cache is being invalidate because project a6e7ec609403494791d3550bfa9343e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80013) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 14:09:20.654367 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-04d68cfa-ac8b-432d-ba6e-36fafcc1c81d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:09:20.655044 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-04d68cfa-ac8b-432d-ba6e-36fafcc1c81d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:09:20.656785 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 766/1508] 10.222.0.36 () {58 vars in 1232 bytes} [Tue May 3 14:09:20 2022] DELETE /identity/v3/projects/a6e7ec609403494791d3550bfa9343e4 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:11:01.943954 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2681151a-fe2a-4572-a32e-457c725e436c None None] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:11:01.944520 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2681151a-fe2a-4572-a32e-457c725e436c None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:11:01.944890 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2681151a-fe2a-4572-a32e-457c725e436c None None] PATH_INFO: `/` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:11:01.946467 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 743/1509] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 3 14:11:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 14:11:01.952053 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228d08c6-a6a7-464e-98a1-08a0521e7d38 None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:11:01.952520 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228d08c6-a6a7-464e-98a1-08a0521e7d38 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:11:01.952620 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228d08c6-a6a7-464e-98a1-08a0521e7d38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:11:01.979101 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-228d08c6-a6a7-464e-98a1-08a0521e7d38 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:11:01.980359 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-228d08c6-a6a7-464e-98a1-08a0521e7d38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:11:02.045030 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 767/1510] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 3 14:11:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 14:11:02.195825 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2681151a-fe2a-4572-a32e-457c725e436c None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:11:02.198976 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-2681151a-fe2a-4572-a32e-457c725e436c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:11:02.285174 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2681151a-fe2a-4572-a32e-457c725e436c None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:11:02.291569 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf549da-c35c-4788-91a0-fbc4e9a32d75 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63489e658c094a2598a2ac62159d2fda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:11:02.292232 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf549da-c35c-4788-91a0-fbc4e9a32d75 service nova] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:11:02.292513 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf549da-c35c-4788-91a0-fbc4e9a32d75 service nova] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:11:02.292784 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf549da-c35c-4788-91a0-fbc4e9a32d75 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:11:02.301785 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf549da-c35c-4788-91a0-fbc4e9a32d75 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:11:02.303381 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf549da-c35c-4788-91a0-fbc4e9a32d75 service nova] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:11:02.312754 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 744/1511] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:11:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 14:11:02.640282 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e20a0c-4a36-4c44-a7bf-1c988c20e5e8 None None] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:11:02.640558 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e20a0c-4a36-4c44-a7bf-1c988c20e5e8 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:11:02.640831 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e20a0c-4a36-4c44-a7bf-1c988c20e5e8 None None] PATH_INFO: `/v3` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:11:02.642368 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 768/1512] 10.222.0.26 () {54 vars in 925 bytes} [Tue May 3 14:11:02 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:11:02.648658 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c171e60a-6b55-40d5-b2e8-29dcaa15deaf None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:11:02.648945 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c171e60a-6b55-40d5-b2e8-29dcaa15deaf None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:11:02.649218 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c171e60a-6b55-40d5-b2e8-29dcaa15deaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:11:02.668808 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-c171e60a-6b55-40d5-b2e8-29dcaa15deaf None None] MFA Rules not processed for user `164c7f36acf644e9bf93f158e876e9e3`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:11:02.669999 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-c171e60a-6b55-40d5-b2e8-29dcaa15deaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:11:02.736652 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 745/1513] 10.222.0.26 () {58 vars in 1015 bytes} [Tue May 3 14:11:02 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 14:11:03.532252 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee013f0-a1d9-47f4-92b8-1e2863a453e6 None None] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:11:03.533222 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee013f0-a1d9-47f4-92b8-1e2863a453e6 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:11:03.533454 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee013f0-a1d9-47f4-92b8-1e2863a453e6 None None] PATH_INFO: `/` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:11:03.535531 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 769/1514] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 3 14:11:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 14:11:03.540672 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b5fa7d-6a47-4a50-b065-ea678a88f7ca None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:11:03.541134 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b5fa7d-6a47-4a50-b065-ea678a88f7ca None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:11:03.541239 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b5fa7d-6a47-4a50-b065-ea678a88f7ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:11:03.559952 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-b3b5fa7d-6a47-4a50-b065-ea678a88f7ca None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:11:03.561143 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-b3b5fa7d-6a47-4a50-b065-ea678a88f7ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:11:03.569465 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 746/1515] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 3 14:11:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:11:03.718446 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee013f0-a1d9-47f4-92b8-1e2863a453e6 None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:11:03.735269 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee013f0-a1d9-47f4-92b8-1e2863a453e6 None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:11:03.741335 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507617b6-2e6e-42a2-ae21-358bc0e8674b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63489e658c094a2598a2ac62159d2fda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:11:03.741976 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507617b6-2e6e-42a2-ae21-358bc0e8674b service nova] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:11:03.742293 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507617b6-2e6e-42a2-ae21-358bc0e8674b service nova] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:11:03.742563 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507617b6-2e6e-42a2-ae21-358bc0e8674b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:11:03.751709 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507617b6-2e6e-42a2-ae21-358bc0e8674b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:11:03.753452 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507617b6-2e6e-42a2-ae21-358bc0e8674b service nova] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:11:03.763413 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 770/1516] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:11:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 14:11:06.601042 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c9cf14-4c86-4793-bcd0-42b3a626c87f None None] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:11:06.601575 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c9cf14-4c86-4793-bcd0-42b3a626c87f None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:11:06.601575 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c9cf14-4c86-4793-bcd0-42b3a626c87f None None] PATH_INFO: `/` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:11:06.602995 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 747/1517] 10.222.0.36 () {54 vars in 960 bytes} [Tue May 3 14:11:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 14:11:06.608372 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ab34f1-55e7-4fa3-abfc-705311b1bdc6 None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:11:06.608850 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ab34f1-55e7-4fa3-abfc-705311b1bdc6 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:11:06.608955 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ab34f1-55e7-4fa3-abfc-705311b1bdc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:11:06.628031 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-c0ab34f1-55e7-4fa3-abfc-705311b1bdc6 None None] MFA Rules not processed for user `164c7f36acf644e9bf93f158e876e9e3`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:11:06.629228 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-c0ab34f1-55e7-4fa3-abfc-705311b1bdc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:11:06.639232 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 771/1518] 10.222.0.36 () {58 vars in 1057 bytes} [Tue May 3 14:11:06 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:11:06.648914 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c9cf14-4c86-4793-bcd0-42b3a626c87f None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:11:06.663029 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c9cf14-4c86-4793-bcd0-42b3a626c87f None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:11:06.667845 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed42970-7235-48da-90c8-4188faa5744d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '164c7f36acf644e9bf93f158e876e9e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:11:06.668488 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed42970-7235-48da-90c8-4188faa5744d service placement] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:11:06.668766 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed42970-7235-48da-90c8-4188faa5744d service placement] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:11:06.669037 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed42970-7235-48da-90c8-4188faa5744d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:11:06.677125 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed42970-7235-48da-90c8-4188faa5744d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:11:06.678752 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed42970-7235-48da-90c8-4188faa5744d service placement] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:11:06.688181 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 748/1519] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:11:06 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 14:11:15.388261 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a714aa2-bde1-4f21-b645-22097338079e None None] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:11:15.388802 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a714aa2-bde1-4f21-b645-22097338079e None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:11:15.388802 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a714aa2-bde1-4f21-b645-22097338079e None None] PATH_INFO: `/` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:11:15.390147 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 772/1520] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 3 14:11:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 14:11:15.396039 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0526a12d-5658-4157-a1a6-57371bbf241e None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:11:15.396497 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0526a12d-5658-4157-a1a6-57371bbf241e None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:11:15.396668 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0526a12d-5658-4157-a1a6-57371bbf241e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:11:15.419380 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-0526a12d-5658-4157-a1a6-57371bbf241e None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:11:15.420599 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-0526a12d-5658-4157-a1a6-57371bbf241e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:11:15.429831 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 749/1521] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 3 14:11:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:11:15.581845 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a714aa2-bde1-4f21-b645-22097338079e None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:11:15.598811 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a714aa2-bde1-4f21-b645-22097338079e None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:11:15.605268 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94d8fe2-5333-4dfb-8cb1-57b0a9cfe1d4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63489e658c094a2598a2ac62159d2fda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:11:15.605936 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94d8fe2-5333-4dfb-8cb1-57b0a9cfe1d4 service nova] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:11:15.606219 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94d8fe2-5333-4dfb-8cb1-57b0a9cfe1d4 service nova] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:11:15.606637 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94d8fe2-5333-4dfb-8cb1-57b0a9cfe1d4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:11:15.615941 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94d8fe2-5333-4dfb-8cb1-57b0a9cfe1d4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:11:15.617552 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94d8fe2-5333-4dfb-8cb1-57b0a9cfe1d4 service nova] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:11:15.627560 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 773/1522] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:11:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 14:11:16.818596 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66e9e65-7dd4-4825-9417-58a238e2d52f None None] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:11:16.819207 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66e9e65-7dd4-4825-9417-58a238e2d52f None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:11:16.819207 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66e9e65-7dd4-4825-9417-58a238e2d52f None None] PATH_INFO: `/` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:11:16.821158 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 750/1523] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 3 14:11:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 14:11:16.829189 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bac62b-1e4c-47c8-a4c3-f028439846fb None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:11:16.829654 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bac62b-1e4c-47c8-a4c3-f028439846fb None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:11:16.829822 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bac62b-1e4c-47c8-a4c3-f028439846fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:11:16.855447 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-f7bac62b-1e4c-47c8-a4c3-f028439846fb None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:11:16.856649 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-f7bac62b-1e4c-47c8-a4c3-f028439846fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:11:16.865656 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 774/1524] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 3 14:11:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:11:17.018062 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66e9e65-7dd4-4825-9417-58a238e2d52f None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:11:17.034503 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66e9e65-7dd4-4825-9417-58a238e2d52f None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:11:17.040900 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed6c362-c436-4c2f-8c6d-b7cfec4019cd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63489e658c094a2598a2ac62159d2fda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:11:17.041606 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed6c362-c436-4c2f-8c6d-b7cfec4019cd service nova] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:11:17.041858 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed6c362-c436-4c2f-8c6d-b7cfec4019cd service nova] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:11:17.042155 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed6c362-c436-4c2f-8c6d-b7cfec4019cd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:11:17.050668 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed6c362-c436-4c2f-8c6d-b7cfec4019cd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:11:17.052217 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed6c362-c436-4c2f-8c6d-b7cfec4019cd service nova] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:11:17.061595 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 751/1525] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:11:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 14:11:21.300252 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1191e50-f3b7-4b4b-a398-ba23a73311da None None] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:11:21.300962 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1191e50-f3b7-4b4b-a398-ba23a73311da None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:11:21.300962 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1191e50-f3b7-4b4b-a398-ba23a73311da None None] PATH_INFO: `/` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:11:21.302200 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 775/1526] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 3 14:11:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 14:11:21.307994 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4676600f-5310-40c3-84b7-f23982715921 None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:11:21.308458 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4676600f-5310-40c3-84b7-f23982715921 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:11:21.308568 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4676600f-5310-40c3-84b7-f23982715921 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:11:21.326768 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-4676600f-5310-40c3-84b7-f23982715921 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:11:21.327878 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-4676600f-5310-40c3-84b7-f23982715921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:11:21.337333 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 752/1527] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 3 14:11:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:11:21.376696 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1191e50-f3b7-4b4b-a398-ba23a73311da None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:11:21.379147 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-f1191e50-f3b7-4b4b-a398-ba23a73311da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:11:21.450197 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1191e50-f3b7-4b4b-a398-ba23a73311da None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:11:21.454760 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564cbfe7-bf75-4052-ba5d-69b0a80b1c09 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '937bea4f355144b4a7ee11baabc3a4cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:11:21.455385 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564cbfe7-bf75-4052-ba5d-69b0a80b1c09 service neutron] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:11:21.455948 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564cbfe7-bf75-4052-ba5d-69b0a80b1c09 service neutron] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:11:21.456227 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564cbfe7-bf75-4052-ba5d-69b0a80b1c09 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:11:21.466039 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564cbfe7-bf75-4052-ba5d-69b0a80b1c09 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:11:21.467479 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564cbfe7-bf75-4052-ba5d-69b0a80b1c09 service neutron] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:11:21.477071 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 776/1528] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:11:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 14:11:23.684523 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b555a4fe-d2b0-477d-b171-189d92ec35b7 None None] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:11:23.685142 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b555a4fe-d2b0-477d-b171-189d92ec35b7 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:11:23.685142 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b555a4fe-d2b0-477d-b171-189d92ec35b7 None None] PATH_INFO: `/` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:11:23.686468 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 753/1529] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 3 14:11:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 14:11:23.691851 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281315fb-733e-4229-a574-f2d7dfc25a76 None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:11:23.692304 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281315fb-733e-4229-a574-f2d7dfc25a76 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:11:23.692407 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281315fb-733e-4229-a574-f2d7dfc25a76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:11:23.712059 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-281315fb-733e-4229-a574-f2d7dfc25a76 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:11:23.713249 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-281315fb-733e-4229-a574-f2d7dfc25a76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:11:23.721243 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 777/1530] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 3 14:11:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:11:23.760301 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b555a4fe-d2b0-477d-b171-189d92ec35b7 None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:11:23.762677 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-b555a4fe-d2b0-477d-b171-189d92ec35b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:11:23.776227 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b555a4fe-d2b0-477d-b171-189d92ec35b7 None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:11:23.779982 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa888ece-e463-4de0-a540-be3453b55865 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '937bea4f355144b4a7ee11baabc3a4cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:11:23.780607 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa888ece-e463-4de0-a540-be3453b55865 service neutron] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:11:23.780885 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa888ece-e463-4de0-a540-be3453b55865 service neutron] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:11:23.781155 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa888ece-e463-4de0-a540-be3453b55865 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:11:23.790973 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa888ece-e463-4de0-a540-be3453b55865 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:11:23.792396 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa888ece-e463-4de0-a540-be3453b55865 service neutron] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:11:23.802220 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 754/1531] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:11:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 14:11:27.639221 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608f62f5-497a-40a7-9eab-05a31445b9b7 None None] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:11:27.639824 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608f62f5-497a-40a7-9eab-05a31445b9b7 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:11:27.639824 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608f62f5-497a-40a7-9eab-05a31445b9b7 None None] PATH_INFO: `/` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:11:27.641158 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 778/1532] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 3 14:11:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 14:11:27.647624 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2045b38c-0c8d-477b-aeef-ff6598b2e83a None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:11:27.648368 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2045b38c-0c8d-477b-aeef-ff6598b2e83a None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:11:27.648549 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2045b38c-0c8d-477b-aeef-ff6598b2e83a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:11:27.669382 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-2045b38c-0c8d-477b-aeef-ff6598b2e83a None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:11:27.670563 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-2045b38c-0c8d-477b-aeef-ff6598b2e83a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:11:27.679254 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 755/1533] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 3 14:11:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:11:27.954377 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608f62f5-497a-40a7-9eab-05a31445b9b7 None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:11:27.957362 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-608f62f5-497a-40a7-9eab-05a31445b9b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:11:28.023948 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608f62f5-497a-40a7-9eab-05a31445b9b7 None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:11:28.029111 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7980cb-2c7b-4ef7-82f9-e449c234ae2c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b014f4c7ba1414cb8a597f5bc4033f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:11:28.029790 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7980cb-2c7b-4ef7-82f9-e449c234ae2c service cinder] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:11:28.030091 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7980cb-2c7b-4ef7-82f9-e449c234ae2c service cinder] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:11:28.030360 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7980cb-2c7b-4ef7-82f9-e449c234ae2c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:11:28.040352 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7980cb-2c7b-4ef7-82f9-e449c234ae2c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:11:28.041827 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7980cb-2c7b-4ef7-82f9-e449c234ae2c service cinder] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:11:28.051548 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 779/1534] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:11:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 14:11:30.320475 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2181d0a6-1e80-471f-9ff7-491b3077f3e1 None None] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:11:30.321471 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2181d0a6-1e80-471f-9ff7-491b3077f3e1 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:11:30.321471 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2181d0a6-1e80-471f-9ff7-491b3077f3e1 None None] PATH_INFO: `/` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:11:30.323596 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 756/1535] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 3 14:11:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 14:11:30.331544 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d312e79-7698-4982-a085-93d71e463cbc None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:11:30.332027 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d312e79-7698-4982-a085-93d71e463cbc None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:11:30.332142 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d312e79-7698-4982-a085-93d71e463cbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:11:30.352075 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-7d312e79-7698-4982-a085-93d71e463cbc None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:11:30.353263 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-7d312e79-7698-4982-a085-93d71e463cbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:11:30.361594 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 780/1536] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 3 14:11:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 14:11:30.632253 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6268f211-6078-435b-a6b8-769cf1968ce1 None None] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:11:30.632572 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6268f211-6078-435b-a6b8-769cf1968ce1 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:11:30.632941 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6268f211-6078-435b-a6b8-769cf1968ce1 None None] PATH_INFO: `/` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:11:30.635164 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 757/1537] 10.222.0.36 () {54 vars in 963 bytes} [Tue May 3 14:11:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 14:11:30.642894 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5675d393-ef0d-424f-b88a-991f6655f264 None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:11:30.643342 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5675d393-ef0d-424f-b88a-991f6655f264 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:11:30.643622 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5675d393-ef0d-424f-b88a-991f6655f264 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:11:30.662195 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-5675d393-ef0d-424f-b88a-991f6655f264 None None] MFA Rules not processed for user `5b014f4c7ba1414cb8a597f5bc4033f7`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:11:30.663388 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-5675d393-ef0d-424f-b88a-991f6655f264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:11:30.670281 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 781/1538] 10.222.0.36 () {58 vars in 1060 bytes} [Tue May 3 14:11:30 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:11:30.678128 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6268f211-6078-435b-a6b8-769cf1968ce1 None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:11:30.690737 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6268f211-6078-435b-a6b8-769cf1968ce1 None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:11:30.695637 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8528e18-4c82-4ee4-ae1b-1ba01b56bf45 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b014f4c7ba1414cb8a597f5bc4033f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:11:30.696275 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8528e18-4c82-4ee4-ae1b-1ba01b56bf45 service cinder] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:11:30.696540 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8528e18-4c82-4ee4-ae1b-1ba01b56bf45 service cinder] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:11:30.696806 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8528e18-4c82-4ee4-ae1b-1ba01b56bf45 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:11:30.706548 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8528e18-4c82-4ee4-ae1b-1ba01b56bf45 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:11:30.707978 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8528e18-4c82-4ee4-ae1b-1ba01b56bf45 service cinder] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:11:30.718035 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 758/1539] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:11:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 14:13:01.014294 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa3888a-79da-48f1-abde-e194c23289c8 None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:01.014970 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa3888a-79da-48f1-abde-e194c23289c8 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:01.014970 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa3888a-79da-48f1-abde-e194c23289c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:01.040751 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-4aa3888a-79da-48f1-abde-e194c23289c8 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:13:01.048769 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-4aa3888a-79da-48f1-abde-e194c23289c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:13:01.071592 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 782/1540] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:13:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:13:01.081990 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ee3d19-29a3-4067-97db-383327810c34 None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:01.082627 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ee3d19-29a3-4067-97db-383327810c34 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:01.082627 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ee3d19-29a3-4067-97db-383327810c34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:01.110360 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-95ee3d19-29a3-4067-97db-383327810c34 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:13:01.111601 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-95ee3d19-29a3-4067-97db-383327810c34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:13:01.121786 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 759/1541] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:13:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:13:01.126607 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa3888a-79da-48f1-abde-e194c23289c8 None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:01.141824 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa3888a-79da-48f1-abde-e194c23289c8 None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:01.150020 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fa6fda-6562-4ba8-ba38-ae34a8d2d721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:01.151053 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fa6fda-6562-4ba8-ba38-ae34a8d2d721 admin admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:01.151336 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fa6fda-6562-4ba8-ba38-ae34a8d2d721 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:01.152315 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fa6fda-6562-4ba8-ba38-ae34a8d2d721 admin admin] PATH_INFO: `/v3/domains` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:01.153066 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fa6fda-6562-4ba8-ba38-ae34a8d2d721 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:13:01.153607 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fa6fda-6562-4ba8-ba38-ae34a8d2d721 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:01.155956 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fa6fda-6562-4ba8-ba38-ae34a8d2d721 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:01.172975 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 783/1542] 10.222.0.36 () {58 vars in 1152 bytes} [Tue May 3 14:13:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:13:01.181782 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ee3d19-29a3-4067-97db-383327810c34 None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:01.195076 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ee3d19-29a3-4067-97db-383327810c34 None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:01.200319 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a5413a-489d-4ab7-857c-a7f31c788e29 None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:01.200611 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a5413a-489d-4ab7-857c-a7f31c788e29 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:01.200890 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a5413a-489d-4ab7-857c-a7f31c788e29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:01.204185 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bd0afc-fef1-4254-aa3f-01c4f19edf5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:01.204869 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bd0afc-fef1-4254-aa3f-01c4f19edf5a admin admin] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:01.205151 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bd0afc-fef1-4254-aa3f-01c4f19edf5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:01.205452 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bd0afc-fef1-4254-aa3f-01c4f19edf5a admin admin] PATH_INFO: `/v3/projects` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:01.206157 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bd0afc-fef1-4254-aa3f-01c4f19edf5a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:01.208073 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bd0afc-fef1-4254-aa3f-01c4f19edf5a admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:01.232433 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-e5a5413a-489d-4ab7-857c-a7f31c788e29 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:13:01.233696 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-e5a5413a-489d-4ab7-857c-a7f31c788e29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:13:01.249754 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 784/1543] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:13:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:13:01.251159 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b193a29-f326-490b-8f68-91c1686d06b5 None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:01.251444 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b193a29-f326-490b-8f68-91c1686d06b5 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:01.251728 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b193a29-f326-490b-8f68-91c1686d06b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:01.269858 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 760/1544] 10.222.0.36 () {60 vars in 1152 bytes} [Tue May 3 14:13:01 2022] POST /identity/v3/projects => generated 355 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 14:13:01.271747 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ca04c5-529d-4785-8601-cd93e2035a12 None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:01.272309 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ca04c5-529d-4785-8601-cd93e2035a12 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:01.272650 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ca04c5-529d-4785-8601-cd93e2035a12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:01.278098 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-5b193a29-f326-490b-8f68-91c1686d06b5 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:13:01.280360 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-5b193a29-f326-490b-8f68-91c1686d06b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:13:01.310310 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-39ca04c5-529d-4785-8601-cd93e2035a12 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:13:01.312019 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-39ca04c5-529d-4785-8601-cd93e2035a12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:13:01.390250 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 785/1545] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:13:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:13:01.391693 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b193a29-f326-490b-8f68-91c1686d06b5 None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:01.408628 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b193a29-f326-490b-8f68-91c1686d06b5 None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:01.413882 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b122514d-3e15-4ea5-9b28-7eae9b178433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:01.414581 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b122514d-3e15-4ea5-9b28-7eae9b178433 admin admin] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:01.414859 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b122514d-3e15-4ea5-9b28-7eae9b178433 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:01.415131 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b122514d-3e15-4ea5-9b28-7eae9b178433 admin admin] PATH_INFO: `/v3/users` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:01.415995 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b122514d-3e15-4ea5-9b28-7eae9b178433 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:01.418450 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b122514d-3e15-4ea5-9b28-7eae9b178433 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:01.419394 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 761/1546] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:13:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 14:13:01.420485 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ce2996-e640-4ffa-9b41-d3de83aefb31 None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:01.420932 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ce2996-e640-4ffa-9b41-d3de83aefb31 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:01.421205 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ce2996-e640-4ffa-9b41-d3de83aefb31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:01.442946 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-e8ce2996-e640-4ffa-9b41-d3de83aefb31 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:13:01.446493 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 786/1547] 10.222.0.36 () {60 vars in 1143 bytes} [Tue May 3 14:13:01 2022] POST /identity/v3/users => generated 278 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 14:13:01.446695 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-e8ce2996-e640-4ffa-9b41-d3de83aefb31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:13:01.446793 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95a0c12-0337-460f-a6a8-c3a97daccd27 None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:01.446793 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95a0c12-0337-460f-a6a8-c3a97daccd27 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:01.446793 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95a0c12-0337-460f-a6a8-c3a97daccd27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:01.453324 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 762/1548] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:13:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:13:01.454679 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4162b1e4-2d7c-4f6b-a479-0c8e88ea6d8c None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:01.454949 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4162b1e4-2d7c-4f6b-a479-0c8e88ea6d8c None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:01.455222 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4162b1e4-2d7c-4f6b-a479-0c8e88ea6d8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:01.470447 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-d95a0c12-0337-460f-a6a8-c3a97daccd27 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:13:01.471653 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-d95a0c12-0337-460f-a6a8-c3a97daccd27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:13:01.479803 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-4162b1e4-2d7c-4f6b-a479-0c8e88ea6d8c None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:13:01.480460 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 787/1549] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:13:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:13:01.480958 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-4162b1e4-2d7c-4f6b-a479-0c8e88ea6d8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:13:01.485465 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35db2f27-482f-4f7a-9d8c-78843ee914a0 None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:01.485465 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35db2f27-482f-4f7a-9d8c-78843ee914a0 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:01.485465 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35db2f27-482f-4f7a-9d8c-78843ee914a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:01.495447 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 763/1550] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:13:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:13:01.497481 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2fce49-9c57-4eaf-aee4-99e1c7001311 None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:01.497946 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2fce49-9c57-4eaf-aee4-99e1c7001311 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:01.498451 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2fce49-9c57-4eaf-aee4-99e1c7001311 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:01.504353 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-35db2f27-482f-4f7a-9d8c-78843ee914a0 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:13:01.506017 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-35db2f27-482f-4f7a-9d8c-78843ee914a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:13:01.520603 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 788/1551] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:13:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:13:01.520603 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35db2f27-482f-4f7a-9d8c-78843ee914a0 None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:01.520887 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-4a2fce49-9c57-4eaf-aee4-99e1c7001311 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:13:01.520887 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-4a2fce49-9c57-4eaf-aee4-99e1c7001311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:13:01.526648 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35db2f27-482f-4f7a-9d8c-78843ee914a0 None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:01.528383 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 764/1552] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:13:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:13:01.529065 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2fce49-9c57-4eaf-aee4-99e1c7001311 None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:01.531913 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250f9719-0549-4550-ab44-e5e4450c4093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:01.532906 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250f9719-0549-4550-ab44-e5e4450c4093 admin admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:01.533406 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250f9719-0549-4550-ab44-e5e4450c4093 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:01.534097 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250f9719-0549-4550-ab44-e5e4450c4093 admin admin] PATH_INFO: `/v3/domains` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:01.535631 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250f9719-0549-4550-ab44-e5e4450c4093 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:13:01.536129 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250f9719-0549-4550-ab44-e5e4450c4093 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:01.538243 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250f9719-0549-4550-ab44-e5e4450c4093 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:01.539127 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2fce49-9c57-4eaf-aee4-99e1c7001311 None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:01.543864 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f3b793-01e6-4722-b2cd-80d70d22ddbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:01.544527 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f3b793-01e6-4722-b2cd-80d70d22ddbf admin admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:01.544808 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f3b793-01e6-4722-b2cd-80d70d22ddbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:01.545081 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f3b793-01e6-4722-b2cd-80d70d22ddbf admin admin] PATH_INFO: `/v3/roles` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:01.545835 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f3b793-01e6-4722-b2cd-80d70d22ddbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:01.547616 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f3b793-01e6-4722-b2cd-80d70d22ddbf admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:01.550928 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 789/1553] 10.222.0.36 () {58 vars in 1152 bytes} [Tue May 3 14:13:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:13:01.552181 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9e5826-7c99-4633-be69-5a753bb36d3e None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:01.552471 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9e5826-7c99-4633-be69-5a753bb36d3e None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:01.553057 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9e5826-7c99-4633-be69-5a753bb36d3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:01.560451 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 765/1554] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 3 14:13:01 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 14:13:01.560451 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515fea49-e6e1-4f6d-b72d-3eec3ec99a27 None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:01.560451 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515fea49-e6e1-4f6d-b72d-3eec3ec99a27 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:01.560451 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515fea49-e6e1-4f6d-b72d-3eec3ec99a27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:01.572419 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-9c9e5826-7c99-4633-be69-5a753bb36d3e None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:13:01.573659 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-9c9e5826-7c99-4633-be69-5a753bb36d3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:13:01.577047 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-515fea49-e6e1-4f6d-b72d-3eec3ec99a27 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:13:01.578629 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-515fea49-e6e1-4f6d-b72d-3eec3ec99a27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:13:01.581584 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 790/1555] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:13:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:13:01.582606 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42b2233-3698-485a-8853-069c46d09035 None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:01.582889 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42b2233-3698-485a-8853-069c46d09035 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:01.583160 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42b2233-3698-485a-8853-069c46d09035 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:01.590460 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 766/1556] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:13:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:13:01.591504 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf93979b-960d-44ac-b256-933b5e8f3a37 None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:01.591795 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf93979b-960d-44ac-b256-933b5e8f3a37 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:01.592071 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf93979b-960d-44ac-b256-933b5e8f3a37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:01.601138 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-a42b2233-3698-485a-8853-069c46d09035 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:13:01.602358 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-a42b2233-3698-485a-8853-069c46d09035 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:13:01.610557 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-bf93979b-960d-44ac-b256-933b5e8f3a37 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:13:01.610687 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 791/1557] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:13:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:13:01.611167 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42b2233-3698-485a-8853-069c46d09035 None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:01.611481 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-bf93979b-960d-44ac-b256-933b5e8f3a37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:13:01.620155 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 767/1558] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:13:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:13:01.621348 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c012a6-00e5-41d5-9b79-0cc976a0395f None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:01.621603 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c012a6-00e5-41d5-9b79-0cc976a0395f None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:01.621778 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42b2233-3698-485a-8853-069c46d09035 None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:01.621904 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c012a6-00e5-41d5-9b79-0cc976a0395f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:01.626553 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d00c484-7071-42c2-b7d7-17fc142e0926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:01.627202 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d00c484-7071-42c2-b7d7-17fc142e0926 admin admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:01.627483 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d00c484-7071-42c2-b7d7-17fc142e0926 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:01.627755 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d00c484-7071-42c2-b7d7-17fc142e0926 admin admin] PATH_INFO: `/v3/domains` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:01.628481 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d00c484-7071-42c2-b7d7-17fc142e0926 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:13:01.628972 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d00c484-7071-42c2-b7d7-17fc142e0926 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:01.630591 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d00c484-7071-42c2-b7d7-17fc142e0926 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:01.639311 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-e8c012a6-00e5-41d5-9b79-0cc976a0395f None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:13:01.640488 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-e8c012a6-00e5-41d5-9b79-0cc976a0395f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:13:01.642168 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 792/1559] 10.222.0.36 () {58 vars in 1152 bytes} [Tue May 3 14:13:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:13:01.642932 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d00c484-7071-42c2-b7d7-17fc142e0926 admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:01.648871 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 768/1560] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:13:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:13:01.649650 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c012a6-00e5-41d5-9b79-0cc976a0395f None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:01.657518 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d00c484-7071-42c2-b7d7-17fc142e0926 admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:01.659324 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c012a6-00e5-41d5-9b79-0cc976a0395f None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:01.662325 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc0ef47-152a-4a1a-9304-a43d06bd7b1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:01.662983 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc0ef47-152a-4a1a-9304-a43d06bd7b1e admin admin] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:01.663283 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc0ef47-152a-4a1a-9304-a43d06bd7b1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:01.663553 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc0ef47-152a-4a1a-9304-a43d06bd7b1e admin admin] PATH_INFO: `/v3/projects` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:01.663794 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba452bbc-2f16-4447-b815-4b20967a547c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:01.664246 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc0ef47-152a-4a1a-9304-a43d06bd7b1e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:01.664450 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba452bbc-2f16-4447-b815-4b20967a547c admin admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:01.664734 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba452bbc-2f16-4447-b815-4b20967a547c admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:01.665029 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba452bbc-2f16-4447-b815-4b20967a547c admin admin] PATH_INFO: `/v3/roles` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:01.665430 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: WARNING py.warnings [None req-cbc0ef47-152a-4a1a-9304-a43d06bd7b1e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 03 14:13:01.665430 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: warnings.warn(msg) May 03 14:13:01.665430 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: May 03 14:13:01.665831 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba452bbc-2f16-4447-b815-4b20967a547c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:01.667493 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba452bbc-2f16-4447-b815-4b20967a547c admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:01.668078 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc0ef47-152a-4a1a-9304-a43d06bd7b1e admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:01.678004 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 769/1561] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 3 14:13:01 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 14:13:01.678837 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba452bbc-2f16-4447-b815-4b20967a547c admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:01.688090 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba452bbc-2f16-4447-b815-4b20967a547c admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:01.692636 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de36450-4897-4a5e-bb46-b98258c28339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:01.693279 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de36450-4897-4a5e-bb46-b98258c28339 admin admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:01.693710 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de36450-4897-4a5e-bb46-b98258c28339 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:01.694042 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de36450-4897-4a5e-bb46-b98258c28339 admin admin] PATH_INFO: `/v3/domains` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:01.694757 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de36450-4897-4a5e-bb46-b98258c28339 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80012) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:13:01.694974 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de36450-4897-4a5e-bb46-b98258c28339 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:01.696027 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: WARNING py.warnings [None req-4de36450-4897-4a5e-bb46-b98258c28339 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 03 14:13:01.696027 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: warnings.warn(msg) May 03 14:13:01.696027 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: May 03 14:13:01.696956 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de36450-4897-4a5e-bb46-b98258c28339 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:01.704397 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 793/1562] 10.222.0.36 () {60 vars in 1152 bytes} [Tue May 3 14:13:01 2022] POST /identity/v3/projects => generated 377 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 14:13:01.705243 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc0ef47-152a-4a1a-9304-a43d06bd7b1e admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:01.709947 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 770/1563] 10.222.0.36 () {58 vars in 1152 bytes} [Tue May 3 14:13:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:13:01.710793 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de36450-4897-4a5e-bb46-b98258c28339 admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:01.720423 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de36450-4897-4a5e-bb46-b98258c28339 admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:01.768367 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc0ef47-152a-4a1a-9304-a43d06bd7b1e admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:01.773327 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3caa62-e1dd-48be-b195-0ee5fdbb9a10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:01.773934 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3caa62-e1dd-48be-b195-0ee5fdbb9a10 admin admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:01.774208 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3caa62-e1dd-48be-b195-0ee5fdbb9a10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:01.774476 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3caa62-e1dd-48be-b195-0ee5fdbb9a10 admin admin] PATH_INFO: `/v3/domains` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:01.775196 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3caa62-e1dd-48be-b195-0ee5fdbb9a10 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:13:01.775495 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3caa62-e1dd-48be-b195-0ee5fdbb9a10 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:01.776250 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d415f94-374f-49ae-a186-886583285c7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:01.776925 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d415f94-374f-49ae-a186-886583285c7a admin admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:01.777081 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3caa62-e1dd-48be-b195-0ee5fdbb9a10 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:01.777305 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d415f94-374f-49ae-a186-886583285c7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:01.777506 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d415f94-374f-49ae-a186-886583285c7a admin admin] PATH_INFO: `/v3/domains` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:01.778230 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d415f94-374f-49ae-a186-886583285c7a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80012) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:13:01.778545 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d415f94-374f-49ae-a186-886583285c7a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:01.780129 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d415f94-374f-49ae-a186-886583285c7a admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:01.789473 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 794/1564] 10.222.0.36 () {58 vars in 1152 bytes} [Tue May 3 14:13:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:13:01.790366 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3caa62-e1dd-48be-b195-0ee5fdbb9a10 admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:01.799374 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 771/1565] 10.222.0.36 () {58 vars in 1152 bytes} [Tue May 3 14:13:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:13:01.800226 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3caa62-e1dd-48be-b195-0ee5fdbb9a10 admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:01.800375 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d415f94-374f-49ae-a186-886583285c7a admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:01.804738 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5662583f-c6e3-4cc0-a4f7-c1a0d8be5b24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:01.805420 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5662583f-c6e3-4cc0-a4f7-c1a0d8be5b24 admin admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:01.805704 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5662583f-c6e3-4cc0-a4f7-c1a0d8be5b24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:01.805982 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5662583f-c6e3-4cc0-a4f7-c1a0d8be5b24 admin admin] PATH_INFO: `/v3/domains` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:01.806810 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5662583f-c6e3-4cc0-a4f7-c1a0d8be5b24 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:13:01.807117 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5662583f-c6e3-4cc0-a4f7-c1a0d8be5b24 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:01.808720 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5662583f-c6e3-4cc0-a4f7-c1a0d8be5b24 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:01.810068 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d415f94-374f-49ae-a186-886583285c7a admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:01.816065 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752fe5c1-d20d-4f44-9f7f-459bc3d336bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:01.816735 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752fe5c1-d20d-4f44-9f7f-459bc3d336bd admin admin] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:01.817016 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752fe5c1-d20d-4f44-9f7f-459bc3d336bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:01.817309 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752fe5c1-d20d-4f44-9f7f-459bc3d336bd admin admin] PATH_INFO: `/v3/projects` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:01.818004 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752fe5c1-d20d-4f44-9f7f-459bc3d336bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:01.819908 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752fe5c1-d20d-4f44-9f7f-459bc3d336bd admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:01.820790 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 795/1566] 10.222.0.36 () {58 vars in 1152 bytes} [Tue May 3 14:13:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:13:01.821865 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691f8e71-bfe6-4dc2-97e5-12accba51758 None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:01.822152 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691f8e71-bfe6-4dc2-97e5-12accba51758 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:01.822426 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691f8e71-bfe6-4dc2-97e5-12accba51758 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:01.840411 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-691f8e71-bfe6-4dc2-97e5-12accba51758 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:13:01.841727 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-691f8e71-bfe6-4dc2-97e5-12accba51758 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:13:01.849050 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 772/1567] 10.222.0.36 () {60 vars in 1152 bytes} [Tue May 3 14:13:01 2022] POST /identity/v3/projects => generated 393 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 14:13:01.850054 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752fe5c1-d20d-4f44-9f7f-459bc3d336bd admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:01.853822 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 796/1568] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:13:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:13:01.854661 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691f8e71-bfe6-4dc2-97e5-12accba51758 None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:01.864208 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691f8e71-bfe6-4dc2-97e5-12accba51758 None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:01.911529 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752fe5c1-d20d-4f44-9f7f-459bc3d336bd admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:01.916439 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c04be9-22db-4251-b4e5-9c08663c3a4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:01.917359 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c04be9-22db-4251-b4e5-9c08663c3a4b admin admin] REQUEST_METHOD: `PUT` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:01.917642 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c04be9-22db-4251-b4e5-9c08663c3a4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:01.917915 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c04be9-22db-4251-b4e5-9c08663c3a4b admin admin] PATH_INFO: `/v3/projects/d913f57aed9b45eb8357bd86e534a5c1/users/1c979ae89998466c89e40983a4fecf43/roles/441fdc11e95b47f4813f72610e39018b` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:01.920162 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f863dabe-54bb-4199-be25-ea06345f3e22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:01.920823 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f863dabe-54bb-4199-be25-ea06345f3e22 admin admin] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:01.921099 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f863dabe-54bb-4199-be25-ea06345f3e22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:01.921687 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f863dabe-54bb-4199-be25-ea06345f3e22 admin admin] PATH_INFO: `/v3/users` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:01.922397 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f863dabe-54bb-4199-be25-ea06345f3e22 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:01.924370 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f863dabe-54bb-4199-be25-ea06345f3e22 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:01.932039 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c04be9-22db-4251-b4e5-9c08663c3a4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d913f57aed9b45eb8357bd86e534a5c1, user_id=1c979ae89998466c89e40983a4fecf43, role_id=441fdc11e95b47f4813f72610e39018b)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:01.934694 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c04be9-22db-4251-b4e5-9c08663c3a4b admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:01.945720 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 797/1569] 10.222.0.36 () {60 vars in 1143 bytes} [Tue May 3 14:13:01 2022] POST /identity/v3/users => generated 289 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 14:13:01.946629 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f863dabe-54bb-4199-be25-ea06345f3e22 admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:01.951754 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 773/1570] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 3 14:13:01 2022] PUT /identity/v3/projects/d913f57aed9b45eb8357bd86e534a5c1/users/1c979ae89998466c89e40983a4fecf43/roles/441fdc11e95b47f4813f72610e39018b => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:13:01.952748 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c04be9-22db-4251-b4e5-9c08663c3a4b admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:01.965559 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f863dabe-54bb-4199-be25-ea06345f3e22 admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:02.014507 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c04be9-22db-4251-b4e5-9c08663c3a4b admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:02.019819 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14dfdb7-75f1-4f9c-9d09-e8703fe87915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:02.020484 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14dfdb7-75f1-4f9c-9d09-e8703fe87915 admin admin] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:02.020764 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14dfdb7-75f1-4f9c-9d09-e8703fe87915 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:02.021037 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14dfdb7-75f1-4f9c-9d09-e8703fe87915 admin admin] PATH_INFO: `/v3/projects` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:02.021689 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fe9ea9-fc9b-42ea-b5ce-3bd40fae15ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:02.022228 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14dfdb7-75f1-4f9c-9d09-e8703fe87915 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:02.022449 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fe9ea9-fc9b-42ea-b5ce-3bd40fae15ca admin admin] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:02.022731 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fe9ea9-fc9b-42ea-b5ce-3bd40fae15ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:02.022999 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fe9ea9-fc9b-42ea-b5ce-3bd40fae15ca admin admin] PATH_INFO: `/v3/projects` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:02.023717 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fe9ea9-fc9b-42ea-b5ce-3bd40fae15ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:02.023844 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14dfdb7-75f1-4f9c-9d09-e8703fe87915 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:02.025587 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fe9ea9-fc9b-42ea-b5ce-3bd40fae15ca admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:02.056584 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 798/1571] 10.222.0.36 () {60 vars in 1152 bytes} [Tue May 3 14:13:01 2022] POST /identity/v3/projects => generated 385 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 14:13:02.062085 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 774/1572] 10.222.0.36 () {60 vars in 1152 bytes} [Tue May 3 14:13:01 2022] POST /identity/v3/projects => generated 367 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 14:13:02.062308 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fe9ea9-fc9b-42ea-b5ce-3bd40fae15ca admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:02.062405 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14dfdb7-75f1-4f9c-9d09-e8703fe87915 admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:02.121509 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fe9ea9-fc9b-42ea-b5ce-3bd40fae15ca admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:02.122219 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14dfdb7-75f1-4f9c-9d09-e8703fe87915 admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:02.126642 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d08472-7a0a-4c53-a43a-4f19f382f18e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:02.126945 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c3a225-8455-4baf-bb1e-4eee863a47af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:02.127335 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d08472-7a0a-4c53-a43a-4f19f382f18e admin admin] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:02.127593 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c3a225-8455-4baf-bb1e-4eee863a47af admin admin] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:02.127714 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d08472-7a0a-4c53-a43a-4f19f382f18e admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:02.127865 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c3a225-8455-4baf-bb1e-4eee863a47af admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:02.127974 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d08472-7a0a-4c53-a43a-4f19f382f18e admin admin] PATH_INFO: `/v3/projects` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:02.128138 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c3a225-8455-4baf-bb1e-4eee863a47af admin admin] PATH_INFO: `/v3/projects` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:02.128579 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d08472-7a0a-4c53-a43a-4f19f382f18e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:02.128807 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c3a225-8455-4baf-bb1e-4eee863a47af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:02.130532 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d08472-7a0a-4c53-a43a-4f19f382f18e admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:02.130718 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c3a225-8455-4baf-bb1e-4eee863a47af admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:02.157934 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 799/1573] 10.222.0.36 () {60 vars in 1152 bytes} [Tue May 3 14:13:02 2022] POST /identity/v3/projects => generated 405 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 14:13:02.158991 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d08472-7a0a-4c53-a43a-4f19f382f18e admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:02.160289 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 775/1574] 10.222.0.36 () {60 vars in 1152 bytes} [Tue May 3 14:13:02 2022] POST /identity/v3/projects => generated 387 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 14:13:02.161332 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c3a225-8455-4baf-bb1e-4eee863a47af admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:02.219537 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c3a225-8455-4baf-bb1e-4eee863a47af admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:02.219821 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d08472-7a0a-4c53-a43a-4f19f382f18e admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:02.224546 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627f2a14-7287-453c-add5-ee905aa6a11f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:02.224718 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be9eceb-945d-4251-9885-458af365f7a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:02.225199 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627f2a14-7287-453c-add5-ee905aa6a11f admin admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:02.225344 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be9eceb-945d-4251-9885-458af365f7a1 admin admin] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:02.225506 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627f2a14-7287-453c-add5-ee905aa6a11f admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:02.225618 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be9eceb-945d-4251-9885-458af365f7a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:02.225774 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627f2a14-7287-453c-add5-ee905aa6a11f admin admin] PATH_INFO: `/v3/domains` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:02.225882 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be9eceb-945d-4251-9885-458af365f7a1 admin admin] PATH_INFO: `/v3/users` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:02.226485 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627f2a14-7287-453c-add5-ee905aa6a11f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80012) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:13:02.226592 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be9eceb-945d-4251-9885-458af365f7a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:02.226786 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627f2a14-7287-453c-add5-ee905aa6a11f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:02.228373 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627f2a14-7287-453c-add5-ee905aa6a11f admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:02.228533 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be9eceb-945d-4251-9885-458af365f7a1 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:02.243021 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 776/1575] 10.222.0.36 () {58 vars in 1152 bytes} [Tue May 3 14:13:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:13:02.244087 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627f2a14-7287-453c-add5-ee905aa6a11f admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:02.250533 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 800/1576] 10.222.0.36 () {60 vars in 1143 bytes} [Tue May 3 14:13:02 2022] POST /identity/v3/users => generated 297 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 14:13:02.251801 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d66df0-9d90-47e5-9c9e-bbbe38713c4a None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:02.252086 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d66df0-9d90-47e5-9c9e-bbbe38713c4a None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:02.252376 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d66df0-9d90-47e5-9c9e-bbbe38713c4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:02.257888 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627f2a14-7287-453c-add5-ee905aa6a11f admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:02.262724 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5542e9ac-0b0a-4483-be95-86ec65280d8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:02.263380 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5542e9ac-0b0a-4483-be95-86ec65280d8d admin admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:02.263659 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5542e9ac-0b0a-4483-be95-86ec65280d8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:02.263929 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5542e9ac-0b0a-4483-be95-86ec65280d8d admin admin] PATH_INFO: `/v3/roles` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:02.264793 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5542e9ac-0b0a-4483-be95-86ec65280d8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:02.266407 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5542e9ac-0b0a-4483-be95-86ec65280d8d admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:02.279281 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 777/1577] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 3 14:13:02 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 14:13:02.280070 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5542e9ac-0b0a-4483-be95-86ec65280d8d admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:02.282821 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-a8d66df0-9d90-47e5-9c9e-bbbe38713c4a None None] MFA Rules not processed for user `1c979ae89998466c89e40983a4fecf43`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:13:02.284164 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-a8d66df0-9d90-47e5-9c9e-bbbe38713c4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:13:02.291009 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5542e9ac-0b0a-4483-be95-86ec65280d8d admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:02.295538 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f5ddce-a618-4085-9a5b-147f8d40a0a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:02.296186 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f5ddce-a618-4085-9a5b-147f8d40a0a1 admin admin] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:02.296514 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f5ddce-a618-4085-9a5b-147f8d40a0a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:02.296790 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f5ddce-a618-4085-9a5b-147f8d40a0a1 admin admin] PATH_INFO: `/v3/users` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:02.297495 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f5ddce-a618-4085-9a5b-147f8d40a0a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:02.298524 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: WARNING py.warnings [None req-30f5ddce-a618-4085-9a5b-147f8d40a0a1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 03 14:13:02.298524 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: warnings.warn(msg) May 03 14:13:02.298524 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: May 03 14:13:02.299704 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f5ddce-a618-4085-9a5b-147f8d40a0a1 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:02.319180 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 778/1578] 10.222.0.36 () {60 vars in 1143 bytes} [Tue May 3 14:13:02 2022] POST /identity/v3/users => generated 293 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 14:13:02.320107 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f5ddce-a618-4085-9a5b-147f8d40a0a1 admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:02.330785 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f5ddce-a618-4085-9a5b-147f8d40a0a1 admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:02.336870 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fa24a2-5f94-4e55-8369-ac6b1fc96ff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:02.337584 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fa24a2-5f94-4e55-8369-ac6b1fc96ff0 admin admin] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:02.337859 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fa24a2-5f94-4e55-8369-ac6b1fc96ff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:02.338129 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fa24a2-5f94-4e55-8369-ac6b1fc96ff0 admin admin] PATH_INFO: `/v3/users` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:02.338782 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fa24a2-5f94-4e55-8369-ac6b1fc96ff0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:02.340743 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fa24a2-5f94-4e55-8369-ac6b1fc96ff0 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:02.351708 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 801/1579] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:13:02 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:13:02.352928 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d66df0-9d90-47e5-9c9e-bbbe38713c4a None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:02.366116 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 779/1580] 10.222.0.36 () {60 vars in 1143 bytes} [Tue May 3 14:13:02 2022] POST /identity/v3/users => generated 284 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 14:13:02.366116 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fa24a2-5f94-4e55-8369-ac6b1fc96ff0 admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:02.366383 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d66df0-9d90-47e5-9c9e-bbbe38713c4a None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:02.369496 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2251168-4c12-4240-ad13-9ac4599863fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:02.370165 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2251168-4c12-4240-ad13-9ac4599863fb admin admin] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:02.370765 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2251168-4c12-4240-ad13-9ac4599863fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:02.370897 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2251168-4c12-4240-ad13-9ac4599863fb admin admin] PATH_INFO: `/v3/users` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:02.371541 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2251168-4c12-4240-ad13-9ac4599863fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:02.373574 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2251168-4c12-4240-ad13-9ac4599863fb admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:02.378184 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fa24a2-5f94-4e55-8369-ac6b1fc96ff0 admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:02.383070 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80e2bab-810d-4a63-b1da-29ac5b23875b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:02.383746 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80e2bab-810d-4a63-b1da-29ac5b23875b admin admin] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:02.384052 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80e2bab-810d-4a63-b1da-29ac5b23875b admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:02.384303 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80e2bab-810d-4a63-b1da-29ac5b23875b admin admin] PATH_INFO: `/v3/users` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:02.384990 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80e2bab-810d-4a63-b1da-29ac5b23875b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:02.387083 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80e2bab-810d-4a63-b1da-29ac5b23875b admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:02.393150 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 802/1581] 10.222.0.36 () {60 vars in 1143 bytes} [Tue May 3 14:13:02 2022] POST /identity/v3/users => generated 294 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 14:13:02.394020 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2251168-4c12-4240-ad13-9ac4599863fb admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:02.403965 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2251168-4c12-4240-ad13-9ac4599863fb admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:02.408493 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 780/1582] 10.222.0.36 () {60 vars in 1143 bytes} [Tue May 3 14:13:02 2022] POST /identity/v3/users => generated 303 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 14:13:02.409341 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80e2bab-810d-4a63-b1da-29ac5b23875b admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:02.409594 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8de2d51-fd87-4f1a-ac4c-483de18d4763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:02.410327 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8de2d51-fd87-4f1a-ac4c-483de18d4763 admin admin] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:02.410671 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8de2d51-fd87-4f1a-ac4c-483de18d4763 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:02.411003 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8de2d51-fd87-4f1a-ac4c-483de18d4763 admin admin] PATH_INFO: `/v3/projects` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:02.411748 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8de2d51-fd87-4f1a-ac4c-483de18d4763 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:02.413692 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8de2d51-fd87-4f1a-ac4c-483de18d4763 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:02.419123 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80e2bab-810d-4a63-b1da-29ac5b23875b admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:02.424523 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a930e5d2-fff8-49dc-9e88-0facb0082fdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:02.425075 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a930e5d2-fff8-49dc-9e88-0facb0082fdf admin admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:02.425366 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a930e5d2-fff8-49dc-9e88-0facb0082fdf admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:02.425667 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a930e5d2-fff8-49dc-9e88-0facb0082fdf admin admin] PATH_INFO: `/v3/roles` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:02.426377 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a930e5d2-fff8-49dc-9e88-0facb0082fdf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:02.427977 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a930e5d2-fff8-49dc-9e88-0facb0082fdf admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:02.440167 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 781/1583] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 3 14:13:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 14:13:02.440326 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 803/1584] 10.222.0.36 () {60 vars in 1152 bytes} [Tue May 3 14:13:02 2022] POST /identity/v3/projects => generated 373 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 14:13:02.441141 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8de2d51-fd87-4f1a-ac4c-483de18d4763 admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:02.446360 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a930e5d2-fff8-49dc-9e88-0facb0082fdf admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:02.456705 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a930e5d2-fff8-49dc-9e88-0facb0082fdf admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:02.500713 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8de2d51-fd87-4f1a-ac4c-483de18d4763 admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:02.506472 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70349b2-bab3-476f-bb73-c47b7941368a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:02.507169 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70349b2-bab3-476f-bb73-c47b7941368a admin admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:02.507454 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70349b2-bab3-476f-bb73-c47b7941368a admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:02.507729 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70349b2-bab3-476f-bb73-c47b7941368a admin admin] PATH_INFO: `/v3/roles` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:02.508459 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70349b2-bab3-476f-bb73-c47b7941368a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:02.510109 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70349b2-bab3-476f-bb73-c47b7941368a admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:02.511607 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d4b2ab-106e-4878-b2aa-908e7b6ffc73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:02.512274 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d4b2ab-106e-4878-b2aa-908e7b6ffc73 admin admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:02.512554 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d4b2ab-106e-4878-b2aa-908e7b6ffc73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:02.512824 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d4b2ab-106e-4878-b2aa-908e7b6ffc73 admin admin] PATH_INFO: `/v3/roles` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:02.513572 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d4b2ab-106e-4878-b2aa-908e7b6ffc73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:02.515170 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d4b2ab-106e-4878-b2aa-908e7b6ffc73 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:02.520384 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 804/1585] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 3 14:13:02 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 14:13:02.521159 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70349b2-bab3-476f-bb73-c47b7941368a admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:02.525952 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 782/1586] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 3 14:13:02 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 14:13:02.526887 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d4b2ab-106e-4878-b2aa-908e7b6ffc73 admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:02.530482 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70349b2-bab3-476f-bb73-c47b7941368a admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:02.535763 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f803fed-66e9-4aeb-a8c7-a88ce381295a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:02.536404 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f803fed-66e9-4aeb-a8c7-a88ce381295a admin admin] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:02.536692 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f803fed-66e9-4aeb-a8c7-a88ce381295a admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:02.536850 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d4b2ab-106e-4878-b2aa-908e7b6ffc73 admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:02.536954 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f803fed-66e9-4aeb-a8c7-a88ce381295a admin admin] PATH_INFO: `/v3/projects` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:02.537687 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f803fed-66e9-4aeb-a8c7-a88ce381295a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:02.539615 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f803fed-66e9-4aeb-a8c7-a88ce381295a admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:02.541613 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9878c717-3ff3-4869-8715-56eb97a2753a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:02.542251 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9878c717-3ff3-4869-8715-56eb97a2753a admin admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:02.542530 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9878c717-3ff3-4869-8715-56eb97a2753a admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:02.542805 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9878c717-3ff3-4869-8715-56eb97a2753a admin admin] PATH_INFO: `/v3/roles` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:02.543512 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9878c717-3ff3-4869-8715-56eb97a2753a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:02.545064 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9878c717-3ff3-4869-8715-56eb97a2753a admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:02.555018 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 783/1587] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 3 14:13:02 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 14:13:02.555921 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9878c717-3ff3-4869-8715-56eb97a2753a admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:02.565694 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9878c717-3ff3-4869-8715-56eb97a2753a admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:02.569455 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 805/1588] 10.222.0.36 () {60 vars in 1152 bytes} [Tue May 3 14:13:02 2022] POST /identity/v3/projects => generated 357 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 14:13:02.570364 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f803fed-66e9-4aeb-a8c7-a88ce381295a admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:02.573397 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e590ae-743a-42d8-8e64-13a01f7efdef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:02.574162 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e590ae-743a-42d8-8e64-13a01f7efdef admin admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:02.574531 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e590ae-743a-42d8-8e64-13a01f7efdef admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:02.574850 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e590ae-743a-42d8-8e64-13a01f7efdef admin admin] PATH_INFO: `/v3/roles` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:02.575561 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e590ae-743a-42d8-8e64-13a01f7efdef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:02.577148 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e590ae-743a-42d8-8e64-13a01f7efdef admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:02.588595 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 784/1589] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 3 14:13:02 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 14:13:02.589529 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e590ae-743a-42d8-8e64-13a01f7efdef admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:02.599598 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e590ae-743a-42d8-8e64-13a01f7efdef admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:02.633653 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f803fed-66e9-4aeb-a8c7-a88ce381295a admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:02.638295 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a23cc22-5082-4ada-864d-785b177d9b2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:02.638967 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a23cc22-5082-4ada-864d-785b177d9b2b admin admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:02.639246 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a23cc22-5082-4ada-864d-785b177d9b2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:02.639506 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a23cc22-5082-4ada-864d-785b177d9b2b admin admin] PATH_INFO: `/v3/roles` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:02.640430 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a23cc22-5082-4ada-864d-785b177d9b2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:02.642198 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a23cc22-5082-4ada-864d-785b177d9b2b admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:02.651819 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 806/1590] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 3 14:13:02 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 14:13:02.652588 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a23cc22-5082-4ada-864d-785b177d9b2b admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:02.658794 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30380b11-80df-4ee5-92ae-c59992378945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:02.659471 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30380b11-80df-4ee5-92ae-c59992378945 admin admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:02.659749 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30380b11-80df-4ee5-92ae-c59992378945 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:02.660024 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30380b11-80df-4ee5-92ae-c59992378945 admin admin] PATH_INFO: `/v3/roles` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:02.660747 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30380b11-80df-4ee5-92ae-c59992378945 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:02.662441 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30380b11-80df-4ee5-92ae-c59992378945 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:02.664143 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a23cc22-5082-4ada-864d-785b177d9b2b admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:02.668609 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929e1aee-24de-4ab1-bf9e-a5f28f3fda38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:02.669255 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929e1aee-24de-4ab1-bf9e-a5f28f3fda38 admin admin] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:02.669570 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929e1aee-24de-4ab1-bf9e-a5f28f3fda38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:02.669844 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929e1aee-24de-4ab1-bf9e-a5f28f3fda38 admin admin] PATH_INFO: `/v3/users` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:02.670524 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929e1aee-24de-4ab1-bf9e-a5f28f3fda38 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:02.672381 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 785/1591] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 3 14:13:02 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 14:13:02.673339 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30380b11-80df-4ee5-92ae-c59992378945 admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:02.674303 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929e1aee-24de-4ab1-bf9e-a5f28f3fda38 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:02.682756 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30380b11-80df-4ee5-92ae-c59992378945 admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:02.688090 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814a24b9-664d-4055-b56e-7477c41c8d75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:02.688858 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814a24b9-664d-4055-b56e-7477c41c8d75 admin admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:02.689166 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814a24b9-664d-4055-b56e-7477c41c8d75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:02.689503 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814a24b9-664d-4055-b56e-7477c41c8d75 admin admin] PATH_INFO: `/v3/roles` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:02.690231 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814a24b9-664d-4055-b56e-7477c41c8d75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:02.691844 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814a24b9-664d-4055-b56e-7477c41c8d75 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:02.695863 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 807/1592] 10.222.0.36 () {60 vars in 1143 bytes} [Tue May 3 14:13:02 2022] POST /identity/v3/users => generated 287 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 14:13:02.696729 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929e1aee-24de-4ab1-bf9e-a5f28f3fda38 admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:02.704496 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 786/1593] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 3 14:13:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 14:13:02.705196 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814a24b9-664d-4055-b56e-7477c41c8d75 admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:02.706264 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929e1aee-24de-4ab1-bf9e-a5f28f3fda38 admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:02.711026 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58de83a6-d0b1-404a-adcd-30ad1e7a7a5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:02.712209 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58de83a6-d0b1-404a-adcd-30ad1e7a7a5d admin admin] REQUEST_METHOD: `PUT` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:02.712484 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58de83a6-d0b1-404a-adcd-30ad1e7a7a5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:02.712756 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58de83a6-d0b1-404a-adcd-30ad1e7a7a5d admin admin] PATH_INFO: `/v3/projects/831ebb047e5b4805875d2606cb8e08c0/users/d337d68a44de4d4290e70e4200bdba83/roles/441fdc11e95b47f4813f72610e39018b` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:02.715198 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814a24b9-664d-4055-b56e-7477c41c8d75 admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:02.720767 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1b6310-0788-4bea-9f73-7561b96f0804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:02.721718 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1b6310-0788-4bea-9f73-7561b96f0804 admin admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:02.722109 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1b6310-0788-4bea-9f73-7561b96f0804 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:02.722489 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1b6310-0788-4bea-9f73-7561b96f0804 admin admin] PATH_INFO: `/v3/roles` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:02.723429 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1b6310-0788-4bea-9f73-7561b96f0804 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:02.725395 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1b6310-0788-4bea-9f73-7561b96f0804 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:02.727994 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58de83a6-d0b1-404a-adcd-30ad1e7a7a5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=831ebb047e5b4805875d2606cb8e08c0, user_id=d337d68a44de4d4290e70e4200bdba83, role_id=441fdc11e95b47f4813f72610e39018b)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:02.729023 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: WARNING py.warnings [None req-58de83a6-d0b1-404a-adcd-30ad1e7a7a5d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 03 14:13:02.729023 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: warnings.warn(msg) May 03 14:13:02.729023 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: May 03 14:13:02.730961 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58de83a6-d0b1-404a-adcd-30ad1e7a7a5d admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:02.736449 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 787/1594] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 3 14:13:02 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 14:13:02.737418 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1b6310-0788-4bea-9f73-7561b96f0804 admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:02.745928 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 808/1595] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 3 14:13:02 2022] PUT /identity/v3/projects/831ebb047e5b4805875d2606cb8e08c0/users/d337d68a44de4d4290e70e4200bdba83/roles/441fdc11e95b47f4813f72610e39018b => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:13:02.746797 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58de83a6-d0b1-404a-adcd-30ad1e7a7a5d admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:02.747300 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1b6310-0788-4bea-9f73-7561b96f0804 admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:02.801134 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23c8852-6f89-49e0-beb8-c13f95a09e2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:02.801871 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23c8852-6f89-49e0-beb8-c13f95a09e2d admin admin] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:02.802176 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23c8852-6f89-49e0-beb8-c13f95a09e2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:02.802451 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23c8852-6f89-49e0-beb8-c13f95a09e2d admin admin] PATH_INFO: `/v3/users` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:02.803169 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23c8852-6f89-49e0-beb8-c13f95a09e2d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:02.804616 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58de83a6-d0b1-404a-adcd-30ad1e7a7a5d admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:02.805098 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23c8852-6f89-49e0-beb8-c13f95a09e2d admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:02.809096 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1225b12f-89ec-4165-a1ea-2aaacdeeae52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:02.809792 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1225b12f-89ec-4165-a1ea-2aaacdeeae52 admin admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:02.810072 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1225b12f-89ec-4165-a1ea-2aaacdeeae52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:02.810348 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1225b12f-89ec-4165-a1ea-2aaacdeeae52 admin admin] PATH_INFO: `/v3/roles` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:02.811091 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1225b12f-89ec-4165-a1ea-2aaacdeeae52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:02.812833 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1225b12f-89ec-4165-a1ea-2aaacdeeae52 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:02.822859 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 809/1596] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 3 14:13:02 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 14:13:02.823726 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1225b12f-89ec-4165-a1ea-2aaacdeeae52 admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:02.827968 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 788/1597] 10.222.0.36 () {60 vars in 1143 bytes} [Tue May 3 14:13:02 2022] POST /identity/v3/users => generated 285 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 14:13:02.827968 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23c8852-6f89-49e0-beb8-c13f95a09e2d admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:02.833706 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1225b12f-89ec-4165-a1ea-2aaacdeeae52 admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:02.837402 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23c8852-6f89-49e0-beb8-c13f95a09e2d admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:02.838695 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907ce834-a2a9-4597-953a-fa55870fb9fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:02.839341 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907ce834-a2a9-4597-953a-fa55870fb9fc admin admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:02.839617 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907ce834-a2a9-4597-953a-fa55870fb9fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:02.839882 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907ce834-a2a9-4597-953a-fa55870fb9fc admin admin] PATH_INFO: `/v3/roles` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:02.840590 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907ce834-a2a9-4597-953a-fa55870fb9fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:02.842240 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446e7526-1941-4acb-9bc2-35f3229483b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:02.842407 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907ce834-a2a9-4597-953a-fa55870fb9fc admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:02.843145 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446e7526-1941-4acb-9bc2-35f3229483b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:02.843427 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446e7526-1941-4acb-9bc2-35f3229483b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:02.843692 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446e7526-1941-4acb-9bc2-35f3229483b3 admin admin] PATH_INFO: `/v3/projects/4e31890e50da4bcab23b81eee1c9a2d7/users/b67e152bc8e94244bce87e63c3b33747/roles/441fdc11e95b47f4813f72610e39018b` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:02.852311 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 810/1598] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 3 14:13:02 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 14:13:02.853098 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907ce834-a2a9-4597-953a-fa55870fb9fc admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:02.857848 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446e7526-1941-4acb-9bc2-35f3229483b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e31890e50da4bcab23b81eee1c9a2d7, user_id=b67e152bc8e94244bce87e63c3b33747, role_id=441fdc11e95b47f4813f72610e39018b)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:02.860582 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446e7526-1941-4acb-9bc2-35f3229483b3 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:02.862179 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907ce834-a2a9-4597-953a-fa55870fb9fc admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:02.867580 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff9ed06-d553-4792-8de9-beb97204edb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:02.868302 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff9ed06-d553-4792-8de9-beb97204edb3 admin admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:02.868576 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff9ed06-d553-4792-8de9-beb97204edb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:02.868847 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff9ed06-d553-4792-8de9-beb97204edb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:02.869615 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff9ed06-d553-4792-8de9-beb97204edb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:02.871562 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff9ed06-d553-4792-8de9-beb97204edb3 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:02.875265 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 789/1599] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 3 14:13:02 2022] PUT /identity/v3/projects/4e31890e50da4bcab23b81eee1c9a2d7/users/b67e152bc8e94244bce87e63c3b33747/roles/441fdc11e95b47f4813f72610e39018b => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:13:02.878361 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446e7526-1941-4acb-9bc2-35f3229483b3 admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:02.882386 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 811/1600] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 3 14:13:02 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 14:13:02.883018 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff9ed06-d553-4792-8de9-beb97204edb3 admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:02.892891 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff9ed06-d553-4792-8de9-beb97204edb3 admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:02.936467 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446e7526-1941-4acb-9bc2-35f3229483b3 admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:02.941330 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d7c795-3b3f-462a-85ae-fa4e27705ae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:02.942230 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d7c795-3b3f-462a-85ae-fa4e27705ae6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:02.942509 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d7c795-3b3f-462a-85ae-fa4e27705ae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:02.942787 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d7c795-3b3f-462a-85ae-fa4e27705ae6 admin admin] PATH_INFO: `/v3/projects/453906a2a829425aac1abdfad7b441d6/users/38de7546d3524382b4589def32732e6e/roles/441fdc11e95b47f4813f72610e39018b` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:02.948884 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3469a55-fccd-46f9-bbca-be231d902dac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:02.949803 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3469a55-fccd-46f9-bbca-be231d902dac admin admin] REQUEST_METHOD: `PUT` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:02.950075 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3469a55-fccd-46f9-bbca-be231d902dac admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:02.950336 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3469a55-fccd-46f9-bbca-be231d902dac admin admin] PATH_INFO: `/v3/projects/63ccbdc980a8425199bd529b12de44d1/users/399094e4f18248428119577c4ba1fc8c/roles/441fdc11e95b47f4813f72610e39018b` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:02.957091 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d7c795-3b3f-462a-85ae-fa4e27705ae6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=453906a2a829425aac1abdfad7b441d6, user_id=38de7546d3524382b4589def32732e6e, role_id=441fdc11e95b47f4813f72610e39018b)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:02.959771 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d7c795-3b3f-462a-85ae-fa4e27705ae6 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:02.965051 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3469a55-fccd-46f9-bbca-be231d902dac admin admin] RBAC: Authorizing `identity:create_grant(project_id=63ccbdc980a8425199bd529b12de44d1, user_id=399094e4f18248428119577c4ba1fc8c, role_id=441fdc11e95b47f4813f72610e39018b)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:02.967711 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3469a55-fccd-46f9-bbca-be231d902dac admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:02.974839 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 790/1601] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 3 14:13:02 2022] PUT /identity/v3/projects/453906a2a829425aac1abdfad7b441d6/users/38de7546d3524382b4589def32732e6e/roles/441fdc11e95b47f4813f72610e39018b => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:13:02.976082 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e0d5cc-2981-4bce-aca3-7619242b91d4 None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:02.976368 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e0d5cc-2981-4bce-aca3-7619242b91d4 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:02.976639 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e0d5cc-2981-4bce-aca3-7619242b91d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:02.980851 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 812/1602] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 3 14:13:02 2022] PUT /identity/v3/projects/63ccbdc980a8425199bd529b12de44d1/users/399094e4f18248428119577c4ba1fc8c/roles/441fdc11e95b47f4813f72610e39018b => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:13:02.981740 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3469a55-fccd-46f9-bbca-be231d902dac admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:02.993693 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-a5e0d5cc-2981-4bce-aca3-7619242b91d4 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:13:02.994888 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-a5e0d5cc-2981-4bce-aca3-7619242b91d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:13:03.051278 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3469a55-fccd-46f9-bbca-be231d902dac admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:03.054605 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 791/1603] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:13:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:13:03.055439 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e0d5cc-2981-4bce-aca3-7619242b91d4 None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:03.056389 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afc98cb-f0b9-44e8-b695-f9ac570e27e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:03.057424 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afc98cb-f0b9-44e8-b695-f9ac570e27e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:03.057894 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afc98cb-f0b9-44e8-b695-f9ac570e27e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:03.058262 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afc98cb-f0b9-44e8-b695-f9ac570e27e8 admin admin] PATH_INFO: `/v3/projects/8a5fa41c00a84a80ac2b2c0cc1ef74d8/users/93f81a3015ce4e70a69b5d91c279b37b/roles/441fdc11e95b47f4813f72610e39018b` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:03.064533 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e0d5cc-2981-4bce-aca3-7619242b91d4 None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:03.072845 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ee4f84-1889-4487-bf54-82f225e80393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:03.073571 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ee4f84-1889-4487-bf54-82f225e80393 admin admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:03.073857 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ee4f84-1889-4487-bf54-82f225e80393 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:03.074043 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afc98cb-f0b9-44e8-b695-f9ac570e27e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a5fa41c00a84a80ac2b2c0cc1ef74d8, user_id=93f81a3015ce4e70a69b5d91c279b37b, role_id=441fdc11e95b47f4813f72610e39018b)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:03.074150 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ee4f84-1889-4487-bf54-82f225e80393 admin admin] PATH_INFO: `/v3/roles` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:03.074992 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ee4f84-1889-4487-bf54-82f225e80393 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:03.076585 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ee4f84-1889-4487-bf54-82f225e80393 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:03.076767 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afc98cb-f0b9-44e8-b695-f9ac570e27e8 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:03.091986 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 792/1604] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 3 14:13:03 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 14:13:03.091986 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ee4f84-1889-4487-bf54-82f225e80393 admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:03.092283 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 813/1605] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 3 14:13:02 2022] PUT /identity/v3/projects/8a5fa41c00a84a80ac2b2c0cc1ef74d8/users/93f81a3015ce4e70a69b5d91c279b37b/roles/441fdc11e95b47f4813f72610e39018b => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:13:03.092728 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b866078-6a1b-4c46-b34c-66d9aa540080 None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:03.093010 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b866078-6a1b-4c46-b34c-66d9aa540080 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:03.093449 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b866078-6a1b-4c46-b34c-66d9aa540080 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:03.099539 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ee4f84-1889-4487-bf54-82f225e80393 admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:03.110255 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-4b866078-6a1b-4c46-b34c-66d9aa540080 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:13:03.111490 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-4b866078-6a1b-4c46-b34c-66d9aa540080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:13:03.152865 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1a89e2-2fd1-441d-bf08-12739c917609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:03.153798 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1a89e2-2fd1-441d-bf08-12739c917609 admin admin] REQUEST_METHOD: `PUT` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:03.154075 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1a89e2-2fd1-441d-bf08-12739c917609 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:03.154347 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1a89e2-2fd1-441d-bf08-12739c917609 admin admin] PATH_INFO: `/v3/projects/dca1498874d44f4dbe57ccb1e6723ade/users/0094cb27ea3d4097ad256dfea03bf050/roles/441fdc11e95b47f4813f72610e39018b` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:03.167185 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 814/1606] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:13:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:13:03.167802 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b866078-6a1b-4c46-b34c-66d9aa540080 None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:03.172413 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1a89e2-2fd1-441d-bf08-12739c917609 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dca1498874d44f4dbe57ccb1e6723ade, user_id=0094cb27ea3d4097ad256dfea03bf050, role_id=441fdc11e95b47f4813f72610e39018b)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:03.175271 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1a89e2-2fd1-441d-bf08-12739c917609 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:03.177388 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b866078-6a1b-4c46-b34c-66d9aa540080 None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:03.184661 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45641832-a603-4fd2-add1-dc1ecd2b6602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:03.185437 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45641832-a603-4fd2-add1-dc1ecd2b6602 admin admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:03.185790 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45641832-a603-4fd2-add1-dc1ecd2b6602 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:03.186075 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45641832-a603-4fd2-add1-dc1ecd2b6602 admin admin] PATH_INFO: `/v3/roles` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:03.187039 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45641832-a603-4fd2-add1-dc1ecd2b6602 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:03.188615 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45641832-a603-4fd2-add1-dc1ecd2b6602 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:03.200707 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 793/1607] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 3 14:13:03 2022] PUT /identity/v3/projects/dca1498874d44f4dbe57ccb1e6723ade/users/0094cb27ea3d4097ad256dfea03bf050/roles/441fdc11e95b47f4813f72610e39018b => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:13:03.200707 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9500fec3-e918-43ef-99b9-ecc96a98e1bd None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:03.200707 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9500fec3-e918-43ef-99b9-ecc96a98e1bd None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:03.200707 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9500fec3-e918-43ef-99b9-ecc96a98e1bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:03.206143 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 815/1608] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 3 14:13:03 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 14:13:03.209711 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-9500fec3-e918-43ef-99b9-ecc96a98e1bd None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:13:03.210460 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e881a9d1-b2ab-41e7-8ee9-9e90c19716d2 None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:03.210747 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e881a9d1-b2ab-41e7-8ee9-9e90c19716d2 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:03.210887 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-9500fec3-e918-43ef-99b9-ecc96a98e1bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:13:03.211018 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e881a9d1-b2ab-41e7-8ee9-9e90c19716d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:03.237944 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-e881a9d1-b2ab-41e7-8ee9-9e90c19716d2 None None] MFA Rules not processed for user `399094e4f18248428119577c4ba1fc8c`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:13:03.239181 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-e881a9d1-b2ab-41e7-8ee9-9e90c19716d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:13:03.269425 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 794/1609] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:13:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:13:03.270269 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9500fec3-e918-43ef-99b9-ecc96a98e1bd None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:03.302076 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 816/1610] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:13:03 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:13:03.303134 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e881a9d1-b2ab-41e7-8ee9-9e90c19716d2 None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:03.314875 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e881a9d1-b2ab-41e7-8ee9-9e90c19716d2 None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:03.320082 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65727e54-dc93-418b-9eed-252ea18610b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:03.321040 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65727e54-dc93-418b-9eed-252ea18610b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:03.321343 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65727e54-dc93-418b-9eed-252ea18610b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:03.321622 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65727e54-dc93-418b-9eed-252ea18610b3 admin admin] PATH_INFO: `/v3/projects/97be4e4cab2c4d0c887c5da3c0c54234/users/10bb7dc29b1149b8b72f16c10d4b605b/roles/36abe9b50fd8479c86c4f8f70fd85aa3` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:03.328925 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9500fec3-e918-43ef-99b9-ecc96a98e1bd None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:03.333191 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e37a7d-0eab-4654-b243-9ce6a34f3dd4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '937bea4f355144b4a7ee11baabc3a4cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:03.333916 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e37a7d-0eab-4654-b243-9ce6a34f3dd4 service neutron] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:03.334196 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e37a7d-0eab-4654-b243-9ce6a34f3dd4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:03.334467 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e37a7d-0eab-4654-b243-9ce6a34f3dd4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:03.340131 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65727e54-dc93-418b-9eed-252ea18610b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=97be4e4cab2c4d0c887c5da3c0c54234, user_id=10bb7dc29b1149b8b72f16c10d4b605b, role_id=36abe9b50fd8479c86c4f8f70fd85aa3)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:03.342822 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65727e54-dc93-418b-9eed-252ea18610b3 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:03.344831 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e37a7d-0eab-4654-b243-9ce6a34f3dd4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:03.346284 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e37a7d-0eab-4654-b243-9ce6a34f3dd4 service neutron] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:03.356365 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 795/1611] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:13:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 14:13:03.356845 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 817/1612] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 3 14:13:03 2022] PUT /identity/v3/projects/97be4e4cab2c4d0c887c5da3c0c54234/users/10bb7dc29b1149b8b72f16c10d4b605b/roles/36abe9b50fd8479c86c4f8f70fd85aa3 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:13:03.362470 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65727e54-dc93-418b-9eed-252ea18610b3 admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:03.362775 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97f736f-1617-4fa7-8f4b-c9388897d032 None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:03.363063 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97f736f-1617-4fa7-8f4b-c9388897d032 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:03.363339 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97f736f-1617-4fa7-8f4b-c9388897d032 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:03.381607 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-e97f736f-1617-4fa7-8f4b-c9388897d032 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:13:03.383074 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-e97f736f-1617-4fa7-8f4b-c9388897d032 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:13:03.421461 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65727e54-dc93-418b-9eed-252ea18610b3 admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:03.425301 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d36ee25-9604-4fb3-a7a4-878fa225fc7e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '937bea4f355144b4a7ee11baabc3a4cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:03.425957 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d36ee25-9604-4fb3-a7a4-878fa225fc7e service neutron] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:03.426237 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d36ee25-9604-4fb3-a7a4-878fa225fc7e service neutron] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:03.426507 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d36ee25-9604-4fb3-a7a4-878fa225fc7e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:03.443812 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 796/1613] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:13:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:13:03.445509 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49357a83-bea9-483c-84ff-8399e7442aac None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:03.445953 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49357a83-bea9-483c-84ff-8399e7442aac None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:03.447114 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49357a83-bea9-483c-84ff-8399e7442aac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:03.476093 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-49357a83-bea9-483c-84ff-8399e7442aac None None] MFA Rules not processed for user `0094cb27ea3d4097ad256dfea03bf050`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:13:03.477314 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-49357a83-bea9-483c-84ff-8399e7442aac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:13:03.498362 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d36ee25-9604-4fb3-a7a4-878fa225fc7e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:03.500197 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d36ee25-9604-4fb3-a7a4-878fa225fc7e service neutron] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:03.510251 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 818/1614] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:13:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 14:13:03.511076 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d36ee25-9604-4fb3-a7a4-878fa225fc7e service neutron] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:03.520266 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d36ee25-9604-4fb3-a7a4-878fa225fc7e service neutron] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:03.526083 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b74e64-68d2-4316-a5ab-2dca2689bd97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:03.527140 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b74e64-68d2-4316-a5ab-2dca2689bd97 admin admin] REQUEST_METHOD: `PUT` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:03.527512 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b74e64-68d2-4316-a5ab-2dca2689bd97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:03.528093 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b74e64-68d2-4316-a5ab-2dca2689bd97 admin admin] PATH_INFO: `/v3/projects/3fda8c97a88d4d7e9fb152212d1c4266/users/e38e673a94684692a37e4ba20838193b/roles/441fdc11e95b47f4813f72610e39018b` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:03.545649 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b74e64-68d2-4316-a5ab-2dca2689bd97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3fda8c97a88d4d7e9fb152212d1c4266, user_id=e38e673a94684692a37e4ba20838193b, role_id=441fdc11e95b47f4813f72610e39018b)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:03.548413 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 797/1615] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:13:03 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:13:03.549178 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49357a83-bea9-483c-84ff-8399e7442aac None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:03.549339 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b74e64-68d2-4316-a5ab-2dca2689bd97 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:03.559936 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49357a83-bea9-483c-84ff-8399e7442aac None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:03.566626 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 819/1616] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 3 14:13:03 2022] PUT /identity/v3/projects/3fda8c97a88d4d7e9fb152212d1c4266/users/e38e673a94684692a37e4ba20838193b/roles/441fdc11e95b47f4813f72610e39018b => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:13:03.567751 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b74e64-68d2-4316-a5ab-2dca2689bd97 admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:03.628804 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a15915-edbb-49e3-9e17-7a5f829109ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '937bea4f355144b4a7ee11baabc3a4cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:03.629568 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a15915-edbb-49e3-9e17-7a5f829109ed service neutron] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:03.629849 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a15915-edbb-49e3-9e17-7a5f829109ed service neutron] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:03.630123 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a15915-edbb-49e3-9e17-7a5f829109ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:03.652009 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b74e64-68d2-4316-a5ab-2dca2689bd97 admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:03.656954 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c117f9f-51f8-4c39-9ff9-65221ea15252 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b014f4c7ba1414cb8a597f5bc4033f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:03.657763 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c117f9f-51f8-4c39-9ff9-65221ea15252 service cinder] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:03.658043 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c117f9f-51f8-4c39-9ff9-65221ea15252 service cinder] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:03.658316 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c117f9f-51f8-4c39-9ff9-65221ea15252 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:03.706568 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a15915-edbb-49e3-9e17-7a5f829109ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:03.708007 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a15915-edbb-49e3-9e17-7a5f829109ed service neutron] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:03.723019 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 798/1617] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:13:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 14:13:03.724168 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a15915-edbb-49e3-9e17-7a5f829109ed service neutron] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:03.734916 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a15915-edbb-49e3-9e17-7a5f829109ed service neutron] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:03.740069 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7af333b-be63-42a8-bb10-ad56ac2fe0a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:03.740892 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7af333b-be63-42a8-bb10-ad56ac2fe0a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:03.741185 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7af333b-be63-42a8-bb10-ad56ac2fe0a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:03.741586 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7af333b-be63-42a8-bb10-ad56ac2fe0a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:03.742321 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7af333b-be63-42a8-bb10-ad56ac2fe0a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:03.743927 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7af333b-be63-42a8-bb10-ad56ac2fe0a5 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:03.754057 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c117f9f-51f8-4c39-9ff9-65221ea15252 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:03.756381 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 799/1618] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 3 14:13:03 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 14:13:03.757159 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c117f9f-51f8-4c39-9ff9-65221ea15252 service cinder] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:03.757601 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7af333b-be63-42a8-bb10-ad56ac2fe0a5 admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:03.770836 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7af333b-be63-42a8-bb10-ad56ac2fe0a5 admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:03.778729 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732c72d5-ac38-404d-a4e1-8202b4a6a999 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '937bea4f355144b4a7ee11baabc3a4cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:03.779671 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732c72d5-ac38-404d-a4e1-8202b4a6a999 service neutron] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:03.779955 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732c72d5-ac38-404d-a4e1-8202b4a6a999 service neutron] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:03.780504 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732c72d5-ac38-404d-a4e1-8202b4a6a999 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:03.783633 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 820/1619] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:13:03 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 14:13:03.784886 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c117f9f-51f8-4c39-9ff9-65221ea15252 service cinder] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:03.796141 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732c72d5-ac38-404d-a4e1-8202b4a6a999 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:03.799438 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732c72d5-ac38-404d-a4e1-8202b4a6a999 service neutron] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:03.799900 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c117f9f-51f8-4c39-9ff9-65221ea15252 service cinder] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:03.808639 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403fc478-7361-4d02-99eb-104cd6cc4c12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:03.809586 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403fc478-7361-4d02-99eb-104cd6cc4c12 admin admin] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:03.810021 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403fc478-7361-4d02-99eb-104cd6cc4c12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:03.810316 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403fc478-7361-4d02-99eb-104cd6cc4c12 admin admin] PATH_INFO: `/v3/projects` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:03.811085 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403fc478-7361-4d02-99eb-104cd6cc4c12 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:03.812955 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 800/1620] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:13:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 14:13:03.813931 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403fc478-7361-4d02-99eb-104cd6cc4c12 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:03.814476 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8bce26-91aa-445a-81b5-5e0063b3af5f None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:03.814774 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8bce26-91aa-445a-81b5-5e0063b3af5f None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:03.815057 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8bce26-91aa-445a-81b5-5e0063b3af5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:03.848587 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-6c8bce26-91aa-445a-81b5-5e0063b3af5f None None] MFA Rules not processed for user `e38e673a94684692a37e4ba20838193b`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:13:03.850143 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-6c8bce26-91aa-445a-81b5-5e0063b3af5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:13:03.858937 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 821/1621] 10.222.0.36 () {60 vars in 1152 bytes} [Tue May 3 14:13:03 2022] POST /identity/v3/projects => generated 403 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 14:13:03.862689 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403fc478-7361-4d02-99eb-104cd6cc4c12 admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:03.946447 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403fc478-7361-4d02-99eb-104cd6cc4c12 admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:03.948893 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 801/1622] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:13:03 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:13:03.950013 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8bce26-91aa-445a-81b5-5e0063b3af5f None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:03.965135 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8bce26-91aa-445a-81b5-5e0063b3af5f None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:03.972921 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ff6a2e-d568-4017-8430-ac723e79bca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:03.973371 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415c0c2f-ef6b-4342-8300-52f360d9ac65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:03.974416 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415c0c2f-ef6b-4342-8300-52f360d9ac65 admin admin] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:03.974749 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ff6a2e-d568-4017-8430-ac723e79bca9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:03.974867 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415c0c2f-ef6b-4342-8300-52f360d9ac65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:03.975293 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ff6a2e-d568-4017-8430-ac723e79bca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:03.975584 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415c0c2f-ef6b-4342-8300-52f360d9ac65 admin admin] PATH_INFO: `/v3/users` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:03.975899 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ff6a2e-d568-4017-8430-ac723e79bca9 admin admin] PATH_INFO: `/v3/projects/97be4e4cab2c4d0c887c5da3c0c54234/users/10bb7dc29b1149b8b72f16c10d4b605b/roles/36abe9b50fd8479c86c4f8f70fd85aa3` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:03.976547 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415c0c2f-ef6b-4342-8300-52f360d9ac65 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:03.978805 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ff6a2e-d568-4017-8430-ac723e79bca9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=97be4e4cab2c4d0c887c5da3c0c54234, user_id=10bb7dc29b1149b8b72f16c10d4b605b, role_id=36abe9b50fd8479c86c4f8f70fd85aa3)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:03.979357 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415c0c2f-ef6b-4342-8300-52f360d9ac65 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:03.981877 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ff6a2e-d568-4017-8430-ac723e79bca9 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:03.998394 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 822/1623] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 3 14:13:03 2022] PUT /identity/v3/projects/97be4e4cab2c4d0c887c5da3c0c54234/users/10bb7dc29b1149b8b72f16c10d4b605b/roles/36abe9b50fd8479c86c4f8f70fd85aa3 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:13:04.001035 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43867e0-46cd-48b2-a0cd-55335410705a None None] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:04.002051 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43867e0-46cd-48b2-a0cd-55335410705a None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:04.002558 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43867e0-46cd-48b2-a0cd-55335410705a None None] PATH_INFO: `/` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:04.004337 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 823/1624] 10.222.0.36 () {54 vars in 960 bytes} [Tue May 3 14:13:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 14:13:04.009970 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79e18f6-08a5-41e3-8ea2-8a32aaece534 None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:04.010825 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79e18f6-08a5-41e3-8ea2-8a32aaece534 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:04.017437 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79e18f6-08a5-41e3-8ea2-8a32aaece534 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:04.030995 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 802/1625] 10.222.0.36 () {60 vars in 1143 bytes} [Tue May 3 14:13:03 2022] POST /identity/v3/users => generated 308 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 14:13:04.034810 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c6bae5-b11d-412b-9f36-91d34dbb0380 None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:04.035606 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c6bae5-b11d-412b-9f36-91d34dbb0380 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:04.035912 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c6bae5-b11d-412b-9f36-91d34dbb0380 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:04.064320 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-d79e18f6-08a5-41e3-8ea2-8a32aaece534 None None] MFA Rules not processed for user `10bb7dc29b1149b8b72f16c10d4b605b`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:13:04.067610 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-d79e18f6-08a5-41e3-8ea2-8a32aaece534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:13:04.080930 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-82c6bae5-b11d-412b-9f36-91d34dbb0380 None None] MFA Rules not processed for user `63489e658c094a2598a2ac62159d2fda`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:13:04.083599 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-82c6bae5-b11d-412b-9f36-91d34dbb0380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:13:04.165247 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 824/1626] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:13:04 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 14:13:04.166253 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79e18f6-08a5-41e3-8ea2-8a32aaece534 None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:04.247185 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79e18f6-08a5-41e3-8ea2-8a32aaece534 None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:04.256348 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0240979-2fb1-4aab-8182-bd3bc000a05e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:04.257247 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0240979-2fb1-4aab-8182-bd3bc000a05e admin admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:04.258031 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0240979-2fb1-4aab-8182-bd3bc000a05e admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:04.258510 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0240979-2fb1-4aab-8182-bd3bc000a05e admin admin] PATH_INFO: `/v3/roles` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:04.259530 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0240979-2fb1-4aab-8182-bd3bc000a05e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:04.261928 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0240979-2fb1-4aab-8182-bd3bc000a05e admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:04.273016 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 803/1627] 10.222.0.36 () {58 vars in 1057 bytes} [Tue May 3 14:13:04 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:13:04.275511 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c6bae5-b11d-412b-9f36-91d34dbb0380 None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:04.280384 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 825/1628] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 3 14:13:04 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 14:13:04.281940 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0240979-2fb1-4aab-8182-bd3bc000a05e admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:04.293117 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0240979-2fb1-4aab-8182-bd3bc000a05e admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:04.298548 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930f020e-a60e-4ac5-951d-d8aa361edc7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:04.299636 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930f020e-a60e-4ac5-951d-d8aa361edc7f admin admin] REQUEST_METHOD: `PUT` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:04.300098 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930f020e-a60e-4ac5-951d-d8aa361edc7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:04.300748 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930f020e-a60e-4ac5-951d-d8aa361edc7f admin admin] PATH_INFO: `/v3/projects/b7b5cf1a747d4fd181e32f3389a8b9e9/users/54bda02efdba4ca398943e2e0371d644/roles/36abe9b50fd8479c86c4f8f70fd85aa3` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:04.319928 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930f020e-a60e-4ac5-951d-d8aa361edc7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7b5cf1a747d4fd181e32f3389a8b9e9, user_id=54bda02efdba4ca398943e2e0371d644, role_id=36abe9b50fd8479c86c4f8f70fd85aa3)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:04.337716 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930f020e-a60e-4ac5-951d-d8aa361edc7f admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:04.363554 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 826/1629] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 3 14:13:04 2022] PUT /identity/v3/projects/b7b5cf1a747d4fd181e32f3389a8b9e9/users/54bda02efdba4ca398943e2e0371d644/roles/36abe9b50fd8479c86c4f8f70fd85aa3 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:13:04.366101 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930f020e-a60e-4ac5-951d-d8aa361edc7f admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:04.452515 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c6bae5-b11d-412b-9f36-91d34dbb0380 None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:04.535586 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930f020e-a60e-4ac5-951d-d8aa361edc7f admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:04.552801 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60d68f1-3137-46f1-b483-dbe9ece288f5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63489e658c094a2598a2ac62159d2fda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:04.553262 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60d68f1-3137-46f1-b483-dbe9ece288f5 service nova] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:04.553619 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60d68f1-3137-46f1-b483-dbe9ece288f5 service nova] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:04.553934 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60d68f1-3137-46f1-b483-dbe9ece288f5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:04.566308 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc0e309-8465-4a96-aef6-5eabfe65f395 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b014f4c7ba1414cb8a597f5bc4033f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:04.567303 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc0e309-8465-4a96-aef6-5eabfe65f395 service cinder] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:04.567757 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc0e309-8465-4a96-aef6-5eabfe65f395 service cinder] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:04.568240 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc0e309-8465-4a96-aef6-5eabfe65f395 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:04.715940 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60d68f1-3137-46f1-b483-dbe9ece288f5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:04.718777 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60d68f1-3137-46f1-b483-dbe9ece288f5 service nova] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:04.743464 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 827/1630] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:13:04 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 14:13:04.744570 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60d68f1-3137-46f1-b483-dbe9ece288f5 service nova] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:04.750195 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc0e309-8465-4a96-aef6-5eabfe65f395 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:04.751638 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc0e309-8465-4a96-aef6-5eabfe65f395 service cinder] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:04.798530 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 804/1631] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:13:04 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 518 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 14:13:04.902295 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60d68f1-3137-46f1-b483-dbe9ece288f5 service nova] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:04.912773 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007e547c-c736-4573-b9e5-9e88dc59dfd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:04.913491 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007e547c-c736-4573-b9e5-9e88dc59dfd6 admin admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:04.914009 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007e547c-c736-4573-b9e5-9e88dc59dfd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:04.914288 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007e547c-c736-4573-b9e5-9e88dc59dfd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:04.915037 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007e547c-c736-4573-b9e5-9e88dc59dfd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:04.920470 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007e547c-c736-4573-b9e5-9e88dc59dfd6 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:04.953135 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 828/1632] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 3 14:13:04 2022] GET /identity/v3/roles => generated 1420 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 14:13:04.957487 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc0e309-8465-4a96-aef6-5eabfe65f395 service cinder] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:04.973007 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc0e309-8465-4a96-aef6-5eabfe65f395 service cinder] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:04.991579 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c520c2-0ee2-4090-a826-091c2dc17507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:04.993832 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c520c2-0ee2-4090-a826-091c2dc17507 admin admin] REQUEST_METHOD: `PUT` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:04.994124 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c520c2-0ee2-4090-a826-091c2dc17507 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:04.994406 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c520c2-0ee2-4090-a826-091c2dc17507 admin admin] PATH_INFO: `/v3/projects/b7b5cf1a747d4fd181e32f3389a8b9e9/users/54bda02efdba4ca398943e2e0371d644/roles/36abe9b50fd8479c86c4f8f70fd85aa3` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:05.001488 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c520c2-0ee2-4090-a826-091c2dc17507 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7b5cf1a747d4fd181e32f3389a8b9e9, user_id=54bda02efdba4ca398943e2e0371d644, role_id=36abe9b50fd8479c86c4f8f70fd85aa3)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:05.003416 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007e547c-c736-4573-b9e5-9e88dc59dfd6 admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:05.015243 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c520c2-0ee2-4090-a826-091c2dc17507 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:05.017544 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007e547c-c736-4573-b9e5-9e88dc59dfd6 admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:05.025270 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0153bb-667f-4a4f-bf55-37453394e6aa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b014f4c7ba1414cb8a597f5bc4033f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:05.025956 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0153bb-667f-4a4f-bf55-37453394e6aa service cinder] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:05.026236 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0153bb-667f-4a4f-bf55-37453394e6aa service cinder] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:05.026510 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0153bb-667f-4a4f-bf55-37453394e6aa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:05.053316 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 805/1633] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 3 14:13:04 2022] PUT /identity/v3/projects/b7b5cf1a747d4fd181e32f3389a8b9e9/users/54bda02efdba4ca398943e2e0371d644/roles/36abe9b50fd8479c86c4f8f70fd85aa3 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:13:05.057230 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007e549d-ace8-473d-81f1-9201d9176ea4 None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:05.057230 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007e549d-ace8-473d-81f1-9201d9176ea4 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:05.057230 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007e549d-ace8-473d-81f1-9201d9176ea4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:05.118024 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-007e549d-ace8-473d-81f1-9201d9176ea4 None None] MFA Rules not processed for user `54bda02efdba4ca398943e2e0371d644`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:13:05.119580 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-007e549d-ace8-473d-81f1-9201d9176ea4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:13:05.161937 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0153bb-667f-4a4f-bf55-37453394e6aa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:05.163651 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0153bb-667f-4a4f-bf55-37453394e6aa service cinder] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:05.196486 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 829/1634] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:13:05 2022] GET /identity/v3/auth/tokens => generated 3222 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 03 14:13:05.235768 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 806/1635] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:13:05 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:13:05.248316 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0153bb-667f-4a4f-bf55-37453394e6aa service cinder] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:05.263040 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0153bb-667f-4a4f-bf55-37453394e6aa service cinder] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:05.434794 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f409c49-a70d-421c-8567-6bc171539528 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b014f4c7ba1414cb8a597f5bc4033f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:05.434794 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f409c49-a70d-421c-8567-6bc171539528 service cinder] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:05.436565 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f409c49-a70d-421c-8567-6bc171539528 service cinder] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:05.437634 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f409c49-a70d-421c-8567-6bc171539528 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:05.463021 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f409c49-a70d-421c-8567-6bc171539528 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:05.464786 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f409c49-a70d-421c-8567-6bc171539528 service cinder] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:05.496955 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 830/1636] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:13:05 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 14:13:05.520586 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab498a3f-5d7d-4512-b302-19551e8da0e3 None None] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:05.522783 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab498a3f-5d7d-4512-b302-19551e8da0e3 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:05.523845 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab498a3f-5d7d-4512-b302-19551e8da0e3 None None] PATH_INFO: `/` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:05.526187 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 807/1637] 10.222.0.36 () {54 vars in 960 bytes} [Tue May 3 14:13:05 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 14:13:05.535470 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ac077d-f12d-4fd1-be2d-9e045bd2caad None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:05.536133 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ac077d-f12d-4fd1-be2d-9e045bd2caad None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:05.536807 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ac077d-f12d-4fd1-be2d-9e045bd2caad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:05.563639 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-83ac077d-f12d-4fd1-be2d-9e045bd2caad None None] MFA Rules not processed for user `63489e658c094a2598a2ac62159d2fda`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:13:05.565565 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-83ac077d-f12d-4fd1-be2d-9e045bd2caad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:13:05.605435 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc910f5-1131-459c-a8f8-215f802e546b None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:05.605994 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc910f5-1131-459c-a8f8-215f802e546b None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:05.606408 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc910f5-1131-459c-a8f8-215f802e546b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:05.668482 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-2cc910f5-1131-459c-a8f8-215f802e546b None None] MFA Rules not processed for user `d337d68a44de4d4290e70e4200bdba83`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:13:05.673859 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-2cc910f5-1131-459c-a8f8-215f802e546b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:13:05.747110 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 831/1638] 10.222.0.36 () {58 vars in 1057 bytes} [Tue May 3 14:13:05 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:13:05.751799 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd439338-09fc-4823-881b-16626901cacf None None] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:05.752083 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd439338-09fc-4823-881b-16626901cacf None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:05.752395 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd439338-09fc-4823-881b-16626901cacf None None] PATH_INFO: `/` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:05.759722 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 832/1639] 10.222.0.36 () {54 vars in 912 bytes} [Tue May 3 14:13:05 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 14:13:05.761878 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff93317e-3fde-4f6d-bb78-0f4298c65b8b None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:05.762174 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff93317e-3fde-4f6d-bb78-0f4298c65b8b None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:05.762428 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff93317e-3fde-4f6d-bb78-0f4298c65b8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:05.813586 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-ff93317e-3fde-4f6d-bb78-0f4298c65b8b None None] MFA Rules not processed for user `63489e658c094a2598a2ac62159d2fda`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:13:05.814791 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-ff93317e-3fde-4f6d-bb78-0f4298c65b8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:13:05.841774 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 833/1640] 10.222.0.36 () {58 vars in 1009 bytes} [Tue May 3 14:13:05 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:13:05.842663 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff93317e-3fde-4f6d-bb78-0f4298c65b8b None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:05.848710 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 808/1641] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:13:05 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 14:13:05.856791 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc910f5-1131-459c-a8f8-215f802e546b None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:05.868288 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc910f5-1131-459c-a8f8-215f802e546b None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:05.873041 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85d80c9-1de3-455d-bd08-504f1dbc2327 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b014f4c7ba1414cb8a597f5bc4033f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:05.874409 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85d80c9-1de3-455d-bd08-504f1dbc2327 service cinder] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:05.875037 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85d80c9-1de3-455d-bd08-504f1dbc2327 service cinder] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:05.875492 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85d80c9-1de3-455d-bd08-504f1dbc2327 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:05.892662 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85d80c9-1de3-455d-bd08-504f1dbc2327 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:05.894312 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85d80c9-1de3-455d-bd08-504f1dbc2327 service cinder] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:05.913449 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 809/1642] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:13:05 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 03 14:13:05.926879 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa49f9e1-7861-48dc-a011-c83ada3df192 None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:05.927929 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa49f9e1-7861-48dc-a011-c83ada3df192 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:05.930809 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa49f9e1-7861-48dc-a011-c83ada3df192 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:05.969186 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff93317e-3fde-4f6d-bb78-0f4298c65b8b None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:05.981185 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13455eb8-611b-4ee7-9392-416d42213ed1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:05.982436 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13455eb8-611b-4ee7-9392-416d42213ed1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:05.983007 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-fa49f9e1-7861-48dc-a011-c83ada3df192 None None] MFA Rules not processed for user `d337d68a44de4d4290e70e4200bdba83`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:13:05.989258 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13455eb8-611b-4ee7-9392-416d42213ed1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:05.989258 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13455eb8-611b-4ee7-9392-416d42213ed1 admin admin] PATH_INFO: `/v3/users/0094cb27ea3d4097ad256dfea03bf050` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:05.989723 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-fa49f9e1-7861-48dc-a011-c83ada3df192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:13:05.989825 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13455eb8-611b-4ee7-9392-416d42213ed1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0094cb27ea3d4097ad256dfea03bf050)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:05.990098 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: WARNING py.warnings [None req-13455eb8-611b-4ee7-9392-416d42213ed1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 03 14:13:05.990098 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: warnings.warn(msg) May 03 14:13:05.990098 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: May 03 14:13:05.993684 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13455eb8-611b-4ee7-9392-416d42213ed1 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:06.002527 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 810/1643] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:13:05 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:13:06.016940 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa49f9e1-7861-48dc-a011-c83ada3df192 None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:06.042356 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa49f9e1-7861-48dc-a011-c83ada3df192 None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:06.059302 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a00c9a-7cec-4a4a-a888-a97aa05bd11a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63489e658c094a2598a2ac62159d2fda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:06.060088 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a00c9a-7cec-4a4a-a888-a97aa05bd11a service nova] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:06.061137 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a00c9a-7cec-4a4a-a888-a97aa05bd11a service nova] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:06.061653 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a00c9a-7cec-4a4a-a888-a97aa05bd11a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:06.078584 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a00c9a-7cec-4a4a-a888-a97aa05bd11a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:06.080368 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a00c9a-7cec-4a4a-a888-a97aa05bd11a service nova] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:06.103875 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 811/1644] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:13:06 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 03 14:13:06.105244 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1273d7-222a-465f-b08a-f8818462fc5b None None] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:06.107405 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1273d7-222a-465f-b08a-f8818462fc5b None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:06.107857 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1273d7-222a-465f-b08a-f8818462fc5b None None] PATH_INFO: `/` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:06.111104 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 812/1645] 10.222.0.36 () {54 vars in 912 bytes} [Tue May 3 14:13:06 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 14:13:06.116938 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ff478b-9a41-4293-9578-fe47d64c3933 None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:06.117232 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ff478b-9a41-4293-9578-fe47d64c3933 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:06.117760 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ff478b-9a41-4293-9578-fe47d64c3933 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:06.154570 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-06ff478b-9a41-4293-9578-fe47d64c3933 None None] MFA Rules not processed for user `63489e658c094a2598a2ac62159d2fda`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:13:06.155910 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-06ff478b-9a41-4293-9578-fe47d64c3933 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:13:06.167061 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-13455eb8-611b-4ee7-9392-416d42213ed1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0094cb27ea3d4097ad256dfea03bf050'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:06.167689 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 813/1646] 10.222.0.36 () {58 vars in 1009 bytes} [Tue May 3 14:13:06 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 14:13:06.194869 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ff478b-9a41-4293-9578-fe47d64c3933 None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:06.196245 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-13455eb8-611b-4ee7-9392-416d42213ed1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0094cb27ea3d4097ad256dfea03bf050'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:06.198022 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-13455eb8-611b-4ee7-9392-416d42213ed1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0094cb27ea3d4097ad256dfea03bf050'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:06.218696 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-13455eb8-611b-4ee7-9392-416d42213ed1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0094cb27ea3d4097ad256dfea03bf050'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:06.219546 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-13455eb8-611b-4ee7-9392-416d42213ed1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0094cb27ea3d4097ad256dfea03bf050'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:06.237842 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ff478b-9a41-4293-9578-fe47d64c3933 None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:06.250870 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df7b73d-6085-46d8-82f8-c3c277ee42a2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b014f4c7ba1414cb8a597f5bc4033f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:06.252479 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df7b73d-6085-46d8-82f8-c3c277ee42a2 service cinder] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:06.254777 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df7b73d-6085-46d8-82f8-c3c277ee42a2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:06.256680 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df7b73d-6085-46d8-82f8-c3c277ee42a2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:06.263698 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-6df7b73d-6085-46d8-82f8-c3c277ee42a2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:13:06.280100 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 834/1647] 10.222.0.36 () {58 vars in 1223 bytes} [Tue May 3 14:13:05 2022] DELETE /identity/v3/users/0094cb27ea3d4097ad256dfea03bf050 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:13:06.285779 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e142d9c-f7cb-4829-b5f7-50757d4ca6c3 None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:06.286210 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e142d9c-f7cb-4829-b5f7-50757d4ca6c3 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:06.286341 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e142d9c-f7cb-4829-b5f7-50757d4ca6c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:06.321089 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df7b73d-6085-46d8-82f8-c3c277ee42a2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:06.322649 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df7b73d-6085-46d8-82f8-c3c277ee42a2 service cinder] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:06.326743 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-2e142d9c-f7cb-4829-b5f7-50757d4ca6c3 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:13:06.329631 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-2e142d9c-f7cb-4829-b5f7-50757d4ca6c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:13:06.347116 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 814/1648] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:13:06 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 14:13:06.421058 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 835/1649] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:13:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:13:06.459652 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df7b73d-6085-46d8-82f8-c3c277ee42a2 service cinder] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:06.461670 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-6df7b73d-6085-46d8-82f8-c3c277ee42a2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:13:06.559412 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df7b73d-6085-46d8-82f8-c3c277ee42a2 service cinder] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:06.591952 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e142d9c-f7cb-4829-b5f7-50757d4ca6c3 None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:06.593774 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-2e142d9c-f7cb-4829-b5f7-50757d4ca6c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:13:06.618256 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4e6593-0022-4b6d-9682-c95b936f2c23 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '937bea4f355144b4a7ee11baabc3a4cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:06.619001 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4e6593-0022-4b6d-9682-c95b936f2c23 service neutron] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:06.619351 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4e6593-0022-4b6d-9682-c95b936f2c23 service neutron] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:06.619712 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4e6593-0022-4b6d-9682-c95b936f2c23 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:06.625528 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e142d9c-f7cb-4829-b5f7-50757d4ca6c3 None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:06.635734 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4e6593-0022-4b6d-9682-c95b936f2c23 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:06.637647 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4e6593-0022-4b6d-9682-c95b936f2c23 service neutron] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:06.637791 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee458b02-5710-49c8-b134-b7cbd2d0fdb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:06.642079 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee458b02-5710-49c8-b134-b7cbd2d0fdb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:06.642366 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee458b02-5710-49c8-b134-b7cbd2d0fdb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:06.644052 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee458b02-5710-49c8-b134-b7cbd2d0fdb7 admin admin] PATH_INFO: `/v3/users/e38e673a94684692a37e4ba20838193b` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:06.646839 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee458b02-5710-49c8-b134-b7cbd2d0fdb7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e38e673a94684692a37e4ba20838193b)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:06.651911 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 815/1650] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:13:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 03 14:13:06.652567 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee458b02-5710-49c8-b134-b7cbd2d0fdb7 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:06.755286 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-ee458b02-5710-49c8-b134-b7cbd2d0fdb7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e38e673a94684692a37e4ba20838193b'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:06.770319 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-ee458b02-5710-49c8-b134-b7cbd2d0fdb7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e38e673a94684692a37e4ba20838193b'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:06.772231 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-ee458b02-5710-49c8-b134-b7cbd2d0fdb7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e38e673a94684692a37e4ba20838193b'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:06.789759 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-ee458b02-5710-49c8-b134-b7cbd2d0fdb7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e38e673a94684692a37e4ba20838193b'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:06.790643 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-ee458b02-5710-49c8-b134-b7cbd2d0fdb7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e38e673a94684692a37e4ba20838193b'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:06.824770 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 836/1651] 10.222.0.36 () {58 vars in 1223 bytes} [Tue May 3 14:13:06 2022] DELETE /identity/v3/users/e38e673a94684692a37e4ba20838193b => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:13:06.829565 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32d960e-d856-4494-aac6-f143d46c7e88 None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:06.830452 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32d960e-d856-4494-aac6-f143d46c7e88 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:06.830738 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32d960e-d856-4494-aac6-f143d46c7e88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:06.886585 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-f32d960e-d856-4494-aac6-f143d46c7e88 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:13:06.889389 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-f32d960e-d856-4494-aac6-f143d46c7e88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:13:07.041984 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 816/1652] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:13:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:13:07.111141 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee458b02-5710-49c8-b134-b7cbd2d0fdb7 admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:07.111141 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-ee458b02-5710-49c8-b134-b7cbd2d0fdb7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:13:07.228941 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee458b02-5710-49c8-b134-b7cbd2d0fdb7 admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:07.239248 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34aa6d35-7e44-48ca-8a67-30c521f48ba3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '937bea4f355144b4a7ee11baabc3a4cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:07.239925 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aa6d35-7e44-48ca-8a67-30c521f48ba3 service neutron] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:07.240208 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aa6d35-7e44-48ca-8a67-30c521f48ba3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:07.240485 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aa6d35-7e44-48ca-8a67-30c521f48ba3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:07.251956 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34aa6d35-7e44-48ca-8a67-30c521f48ba3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:07.254160 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34aa6d35-7e44-48ca-8a67-30c521f48ba3 service neutron] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:07.282978 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5bb195-47a9-47a4-8367-c98e80842be6 None None] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:07.283378 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5bb195-47a9-47a4-8367-c98e80842be6 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:07.283784 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5bb195-47a9-47a4-8367-c98e80842be6 None None] PATH_INFO: `/` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:07.285768 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 817/1653] 10.222.0.36 () {54 vars in 912 bytes} [Tue May 3 14:13:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 14:13:07.292237 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 837/1654] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:13:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 14:13:07.299340 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071dfb77-8a0b-4803-b5ef-6d5111cf4f33 None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:07.299856 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071dfb77-8a0b-4803-b5ef-6d5111cf4f33 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:07.300230 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071dfb77-8a0b-4803-b5ef-6d5111cf4f33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:07.357026 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-071dfb77-8a0b-4803-b5ef-6d5111cf4f33 None None] MFA Rules not processed for user `937bea4f355144b4a7ee11baabc3a4cb`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:13:07.358724 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-071dfb77-8a0b-4803-b5ef-6d5111cf4f33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:13:07.373124 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 818/1655] 10.222.0.36 () {58 vars in 1009 bytes} [Tue May 3 14:13:07 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:13:07.417685 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34aa6d35-7e44-48ca-8a67-30c521f48ba3 service neutron] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:07.445790 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34aa6d35-7e44-48ca-8a67-30c521f48ba3 service neutron] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:07.465930 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47710627-965d-4513-abca-4b4e5365a48d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '937bea4f355144b4a7ee11baabc3a4cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:07.467628 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47710627-965d-4513-abca-4b4e5365a48d service neutron] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:07.468666 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47710627-965d-4513-abca-4b4e5365a48d service neutron] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:07.469031 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47710627-965d-4513-abca-4b4e5365a48d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:07.487649 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47710627-965d-4513-abca-4b4e5365a48d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:07.490763 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47710627-965d-4513-abca-4b4e5365a48d service neutron] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:07.523955 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 838/1656] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:13:07 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 14:13:07.623692 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071dfb77-8a0b-4803-b5ef-6d5111cf4f33 None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:07.626847 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-071dfb77-8a0b-4803-b5ef-6d5111cf4f33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:13:07.651285 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071dfb77-8a0b-4803-b5ef-6d5111cf4f33 None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:07.666032 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007061b8-1a9b-42ac-acc2-d3ba61e3922a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:07.666674 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007061b8-1a9b-42ac-acc2-d3ba61e3922a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:07.666948 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007061b8-1a9b-42ac-acc2-d3ba61e3922a admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:07.667214 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007061b8-1a9b-42ac-acc2-d3ba61e3922a admin admin] PATH_INFO: `/v3/projects/dca1498874d44f4dbe57ccb1e6723ade` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:07.668824 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007061b8-1a9b-42ac-acc2-d3ba61e3922a admin admin] RBAC: Authorizing `identity:delete_project(project_id=dca1498874d44f4dbe57ccb1e6723ade)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:07.669888 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: WARNING py.warnings [None req-007061b8-1a9b-42ac-acc2-d3ba61e3922a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 03 14:13:07.669888 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: warnings.warn(msg) May 03 14:13:07.669888 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: May 03 14:13:07.671346 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007061b8-1a9b-42ac-acc2-d3ba61e3922a admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:07.839931 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-007061b8-1a9b-42ac-acc2-d3ba61e3922a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dca1498874d44f4dbe57ccb1e6723ade', 'request_id': 'req-007061b8-1a9b-42ac-acc2-d3ba61e3922a'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:07.870941 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-007061b8-1a9b-42ac-acc2-d3ba61e3922a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dca1498874d44f4dbe57ccb1e6723ade', 'request_id': 'req-007061b8-1a9b-42ac-acc2-d3ba61e3922a'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:07.879455 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-007061b8-1a9b-42ac-acc2-d3ba61e3922a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dca1498874d44f4dbe57ccb1e6723ade', 'request_id': 'req-007061b8-1a9b-42ac-acc2-d3ba61e3922a'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:07.909667 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-007061b8-1a9b-42ac-acc2-d3ba61e3922a admin admin] The token cache is being invalidate because project dca1498874d44f4dbe57ccb1e6723ade was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80012) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 14:13:07.910826 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-007061b8-1a9b-42ac-acc2-d3ba61e3922a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:07.911810 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-007061b8-1a9b-42ac-acc2-d3ba61e3922a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:07.915755 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 819/1657] 10.222.0.36 () {58 vars in 1232 bytes} [Tue May 3 14:13:07 2022] DELETE /identity/v3/projects/dca1498874d44f4dbe57ccb1e6723ade => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:13:07.922887 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47710627-965d-4513-abca-4b4e5365a48d service neutron] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:07.937403 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47710627-965d-4513-abca-4b4e5365a48d service neutron] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:08.039996 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b745d9-cca2-4dac-b79e-12d7a7c7bf97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:08.041148 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b745d9-cca2-4dac-b79e-12d7a7c7bf97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:08.041628 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b745d9-cca2-4dac-b79e-12d7a7c7bf97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:08.042093 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b745d9-cca2-4dac-b79e-12d7a7c7bf97 admin admin] PATH_INFO: `/v3/users/54bda02efdba4ca398943e2e0371d644` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:08.048053 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b745d9-cca2-4dac-b79e-12d7a7c7bf97 admin admin] RBAC: Authorizing `identity:delete_user(user_id=54bda02efdba4ca398943e2e0371d644)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:08.050937 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b745d9-cca2-4dac-b79e-12d7a7c7bf97 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:08.139291 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-51b745d9-cca2-4dac-b79e-12d7a7c7bf97 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54bda02efdba4ca398943e2e0371d644'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:08.156562 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-51b745d9-cca2-4dac-b79e-12d7a7c7bf97 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54bda02efdba4ca398943e2e0371d644'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:08.157485 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-51b745d9-cca2-4dac-b79e-12d7a7c7bf97 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54bda02efdba4ca398943e2e0371d644'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:08.181981 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-51b745d9-cca2-4dac-b79e-12d7a7c7bf97 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54bda02efdba4ca398943e2e0371d644'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:08.182758 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-51b745d9-cca2-4dac-b79e-12d7a7c7bf97 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54bda02efdba4ca398943e2e0371d644'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:08.216717 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 839/1658] 10.222.0.36 () {58 vars in 1223 bytes} [Tue May 3 14:13:07 2022] DELETE /identity/v3/users/54bda02efdba4ca398943e2e0371d644 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:13:08.559837 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007061b8-1a9b-42ac-acc2-d3ba61e3922a admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:08.563061 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-007061b8-1a9b-42ac-acc2-d3ba61e3922a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:13:08.600692 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007061b8-1a9b-42ac-acc2-d3ba61e3922a admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:08.754840 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869caef2-400c-4534-bb01-99dad0b31131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:08.756498 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b708a520-dbca-47cf-b41f-60ae89314ac7 None None] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:08.756940 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b708a520-dbca-47cf-b41f-60ae89314ac7 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:08.757077 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b708a520-dbca-47cf-b41f-60ae89314ac7 None None] PATH_INFO: `/` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:08.757464 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869caef2-400c-4534-bb01-99dad0b31131 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:08.759312 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 840/1659] 10.222.0.36 () {54 vars in 960 bytes} [Tue May 3 14:13:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 14:13:08.762601 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869caef2-400c-4534-bb01-99dad0b31131 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:08.763131 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869caef2-400c-4534-bb01-99dad0b31131 admin admin] PATH_INFO: `/v3/projects/3fda8c97a88d4d7e9fb152212d1c4266` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:08.765887 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869caef2-400c-4534-bb01-99dad0b31131 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3fda8c97a88d4d7e9fb152212d1c4266)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:08.770272 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fe2c5e-6c16-4e57-bf9b-bb547dce9865 None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:08.770272 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fe2c5e-6c16-4e57-bf9b-bb547dce9865 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:08.770494 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fe2c5e-6c16-4e57-bf9b-bb547dce9865 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:08.770585 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869caef2-400c-4534-bb01-99dad0b31131 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:08.818360 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-b2fe2c5e-6c16-4e57-bf9b-bb547dce9865 None None] MFA Rules not processed for user `164c7f36acf644e9bf93f158e876e9e3`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:13:08.819684 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-b2fe2c5e-6c16-4e57-bf9b-bb547dce9865 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:13:08.917752 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-869caef2-400c-4534-bb01-99dad0b31131 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3fda8c97a88d4d7e9fb152212d1c4266', 'request_id': 'req-869caef2-400c-4534-bb01-99dad0b31131'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:08.927690 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-869caef2-400c-4534-bb01-99dad0b31131 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3fda8c97a88d4d7e9fb152212d1c4266', 'request_id': 'req-869caef2-400c-4534-bb01-99dad0b31131'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:08.942049 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-869caef2-400c-4534-bb01-99dad0b31131 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3fda8c97a88d4d7e9fb152212d1c4266', 'request_id': 'req-869caef2-400c-4534-bb01-99dad0b31131'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:08.967187 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-869caef2-400c-4534-bb01-99dad0b31131 admin admin] The token cache is being invalidate because project 3fda8c97a88d4d7e9fb152212d1c4266 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80012) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 14:13:08.967478 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-869caef2-400c-4534-bb01-99dad0b31131 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:08.970456 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-869caef2-400c-4534-bb01-99dad0b31131 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:08.972825 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 820/1660] 10.222.0.36 () {58 vars in 1232 bytes} [Tue May 3 14:13:08 2022] DELETE /identity/v3/projects/3fda8c97a88d4d7e9fb152212d1c4266 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:13:08.977870 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3539f17-30ca-42d4-8206-0e22ceeb868a None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:08.978397 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3539f17-30ca-42d4-8206-0e22ceeb868a None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:08.978898 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3539f17-30ca-42d4-8206-0e22ceeb868a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:09.041108 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-c3539f17-30ca-42d4-8206-0e22ceeb868a None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:13:09.044754 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-c3539f17-30ca-42d4-8206-0e22ceeb868a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:13:09.085504 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 841/1661] 10.222.0.36 () {58 vars in 1057 bytes} [Tue May 3 14:13:08 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 14:13:09.086511 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fe2c5e-6c16-4e57-bf9b-bb547dce9865 None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:09.102231 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-b2fe2c5e-6c16-4e57-bf9b-bb547dce9865 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:13:09.161584 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fe2c5e-6c16-4e57-bf9b-bb547dce9865 None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:09.227631 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 821/1662] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:13:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:13:09.229966 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3539f17-30ca-42d4-8206-0e22ceeb868a None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:09.352378 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3539f17-30ca-42d4-8206-0e22ceeb868a None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:09.367832 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50888824-d3cb-4659-b399-d8723d4ad360 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '164c7f36acf644e9bf93f158e876e9e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:09.369433 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50888824-d3cb-4659-b399-d8723d4ad360 service placement] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:09.370646 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50888824-d3cb-4659-b399-d8723d4ad360 service placement] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:09.371059 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50888824-d3cb-4659-b399-d8723d4ad360 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:09.376386 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-50888824-d3cb-4659-b399-d8723d4ad360 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:13:09.414144 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50888824-d3cb-4659-b399-d8723d4ad360 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:09.416203 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50888824-d3cb-4659-b399-d8723d4ad360 service placement] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:09.455452 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 822/1663] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:13:09 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 14:13:09.458956 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a5a2fa-e66d-458c-b660-55454c4a56a5 None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:09.460716 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a5a2fa-e66d-458c-b660-55454c4a56a5 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:09.461070 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a5a2fa-e66d-458c-b660-55454c4a56a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:09.524791 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21384e61-9e9f-4575-b3a3-7fd74a6c98c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:09.524940 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-b2a5a2fa-e66d-458c-b660-55454c4a56a5 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:13:09.525642 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21384e61-9e9f-4575-b3a3-7fd74a6c98c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:09.525923 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21384e61-9e9f-4575-b3a3-7fd74a6c98c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:09.526195 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21384e61-9e9f-4575-b3a3-7fd74a6c98c5 admin admin] PATH_INFO: `/v3/projects/b7b5cf1a747d4fd181e32f3389a8b9e9` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:09.530357 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-b2a5a2fa-e66d-458c-b660-55454c4a56a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:13:09.531507 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21384e61-9e9f-4575-b3a3-7fd74a6c98c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7b5cf1a747d4fd181e32f3389a8b9e9)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:09.533720 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21384e61-9e9f-4575-b3a3-7fd74a6c98c5 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:09.563913 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 823/1664] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:13:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:13:09.569744 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a5a2fa-e66d-458c-b660-55454c4a56a5 None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:09.607546 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a5a2fa-e66d-458c-b660-55454c4a56a5 None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:09.624999 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ba9db9-0cfe-4c9a-a262-bcaec895183b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:09.626168 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ba9db9-0cfe-4c9a-a262-bcaec895183b admin admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:09.629884 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ba9db9-0cfe-4c9a-a262-bcaec895183b admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:09.630399 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ba9db9-0cfe-4c9a-a262-bcaec895183b admin admin] PATH_INFO: `/v3/domains` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:09.631805 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ba9db9-0cfe-4c9a-a262-bcaec895183b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80012) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:13:09.635766 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ba9db9-0cfe-4c9a-a262-bcaec895183b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:09.642793 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ba9db9-0cfe-4c9a-a262-bcaec895183b admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:09.695330 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 824/1665] 10.222.0.36 () {58 vars in 1152 bytes} [Tue May 3 14:13:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:13:09.696925 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ba9db9-0cfe-4c9a-a262-bcaec895183b admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:09.711993 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ba9db9-0cfe-4c9a-a262-bcaec895183b admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:09.718373 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-21384e61-9e9f-4575-b3a3-7fd74a6c98c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7b5cf1a747d4fd181e32f3389a8b9e9', 'request_id': 'req-21384e61-9e9f-4575-b3a3-7fd74a6c98c5'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:09.729163 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-21384e61-9e9f-4575-b3a3-7fd74a6c98c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7b5cf1a747d4fd181e32f3389a8b9e9', 'request_id': 'req-21384e61-9e9f-4575-b3a3-7fd74a6c98c5'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:09.742899 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-21384e61-9e9f-4575-b3a3-7fd74a6c98c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7b5cf1a747d4fd181e32f3389a8b9e9', 'request_id': 'req-21384e61-9e9f-4575-b3a3-7fd74a6c98c5'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:09.786485 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-21384e61-9e9f-4575-b3a3-7fd74a6c98c5 admin admin] The token cache is being invalidate because project b7b5cf1a747d4fd181e32f3389a8b9e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80013) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 14:13:09.787197 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-21384e61-9e9f-4575-b3a3-7fd74a6c98c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:09.792271 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-21384e61-9e9f-4575-b3a3-7fd74a6c98c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:09.802168 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 842/1666] 10.222.0.36 () {58 vars in 1232 bytes} [Tue May 3 14:13:09 2022] DELETE /identity/v3/projects/b7b5cf1a747d4fd181e32f3389a8b9e9 => generated 0 bytes in 713 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:13:09.809896 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28a1fb1-5328-477d-b97f-f9e4870b2ede None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:09.810584 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28a1fb1-5328-477d-b97f-f9e4870b2ede None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:09.811086 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28a1fb1-5328-477d-b97f-f9e4870b2ede None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:09.845153 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3faca6-0399-4a33-80dc-243bb5cc00a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:09.845956 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3faca6-0399-4a33-80dc-243bb5cc00a4 admin admin] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:09.846155 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3faca6-0399-4a33-80dc-243bb5cc00a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:09.846420 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3faca6-0399-4a33-80dc-243bb5cc00a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:09.847122 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3faca6-0399-4a33-80dc-243bb5cc00a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:09.850945 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3faca6-0399-4a33-80dc-243bb5cc00a4 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:09.879081 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-a28a1fb1-5328-477d-b97f-f9e4870b2ede None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:13:09.880828 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-a28a1fb1-5328-477d-b97f-f9e4870b2ede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:13:09.892744 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 843/1667] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:13:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:13:09.935450 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb525e55-587b-4f7e-b4bf-c8cd4003259c None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:09.935450 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb525e55-587b-4f7e-b4bf-c8cd4003259c None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:09.935450 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb525e55-587b-4f7e-b4bf-c8cd4003259c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:09.935918 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 825/1668] 10.222.0.36 () {60 vars in 1152 bytes} [Tue May 3 14:13:09 2022] POST /identity/v3/projects => generated 367 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 14:13:09.935918 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3faca6-0399-4a33-80dc-243bb5cc00a4 admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:09.935918 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-fc3faca6-0399-4a33-80dc-243bb5cc00a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:13:10.012859 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-eb525e55-587b-4f7e-b4bf-c8cd4003259c None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:13:10.025980 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-eb525e55-587b-4f7e-b4bf-c8cd4003259c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:13:10.096176 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3faca6-0399-4a33-80dc-243bb5cc00a4 admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:10.115082 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6df937-a13c-471f-8c73-13bd9ef7a178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:10.115621 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6df937-a13c-471f-8c73-13bd9ef7a178 admin admin] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:10.115790 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6df937-a13c-471f-8c73-13bd9ef7a178 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:10.116026 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6df937-a13c-471f-8c73-13bd9ef7a178 admin admin] PATH_INFO: `/v3/users` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:10.116735 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6df937-a13c-471f-8c73-13bd9ef7a178 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:10.127153 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6df937-a13c-471f-8c73-13bd9ef7a178 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:10.198748 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 826/1669] 10.222.0.36 () {60 vars in 1143 bytes} [Tue May 3 14:13:09 2022] POST /identity/v3/users => generated 284 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 14:13:10.203900 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6df937-a13c-471f-8c73-13bd9ef7a178 admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:10.224945 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6df937-a13c-471f-8c73-13bd9ef7a178 admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:10.242131 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b595322a-211c-4d4a-a867-f2d3d33eb054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:10.243094 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b595322a-211c-4d4a-a867-f2d3d33eb054 admin admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:10.243591 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b595322a-211c-4d4a-a867-f2d3d33eb054 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:10.244605 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b595322a-211c-4d4a-a867-f2d3d33eb054 admin admin] PATH_INFO: `/v3/roles` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:10.245569 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b595322a-211c-4d4a-a867-f2d3d33eb054 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:10.259002 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b595322a-211c-4d4a-a867-f2d3d33eb054 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:10.280805 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 844/1670] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:13:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 370 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:13:10.290839 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb525e55-587b-4f7e-b4bf-c8cd4003259c None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:10.308838 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb525e55-587b-4f7e-b4bf-c8cd4003259c None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:10.318452 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 827/1671] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 3 14:13:10 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 14:13:10.321330 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b595322a-211c-4d4a-a867-f2d3d33eb054 admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:10.322697 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0291e7-0ef5-4379-b146-a85eb98c2c0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:10.323579 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0291e7-0ef5-4379-b146-a85eb98c2c0f admin admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:10.324141 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0291e7-0ef5-4379-b146-a85eb98c2c0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:10.324683 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0291e7-0ef5-4379-b146-a85eb98c2c0f admin admin] PATH_INFO: `/v3/domains` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:10.327723 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0291e7-0ef5-4379-b146-a85eb98c2c0f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:13:10.328250 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0291e7-0ef5-4379-b146-a85eb98c2c0f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:10.334990 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0291e7-0ef5-4379-b146-a85eb98c2c0f admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:10.360012 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b595322a-211c-4d4a-a867-f2d3d33eb054 admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:10.368310 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 845/1672] 10.222.0.36 () {58 vars in 1152 bytes} [Tue May 3 14:13:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 14:13:10.370388 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19e2186-f950-403c-bea5-783e44cda492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:10.370783 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0291e7-0ef5-4379-b146-a85eb98c2c0f admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:10.372959 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19e2186-f950-403c-bea5-783e44cda492 admin admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:10.374467 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19e2186-f950-403c-bea5-783e44cda492 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:10.385345 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19e2186-f950-403c-bea5-783e44cda492 admin admin] PATH_INFO: `/v3/roles` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:10.385345 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19e2186-f950-403c-bea5-783e44cda492 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:10.385345 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19e2186-f950-403c-bea5-783e44cda492 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:10.403545 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0291e7-0ef5-4379-b146-a85eb98c2c0f admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:10.422466 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d46622d-c29b-4142-8630-161beb8c677d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:10.425240 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 828/1673] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 3 14:13:10 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 14:13:10.426395 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19e2186-f950-403c-bea5-783e44cda492 admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:10.428947 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d46622d-c29b-4142-8630-161beb8c677d admin admin] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:10.433441 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d46622d-c29b-4142-8630-161beb8c677d admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:10.433810 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d46622d-c29b-4142-8630-161beb8c677d admin admin] PATH_INFO: `/v3/projects` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:10.434611 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d46622d-c29b-4142-8630-161beb8c677d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:10.439027 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d46622d-c29b-4142-8630-161beb8c677d admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:10.444403 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19e2186-f950-403c-bea5-783e44cda492 admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:10.455446 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa4e2c2-02ca-400b-baf7-e0ee7c1db5ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:10.456812 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa4e2c2-02ca-400b-baf7-e0ee7c1db5ca admin admin] REQUEST_METHOD: `PUT` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:10.457198 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa4e2c2-02ca-400b-baf7-e0ee7c1db5ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:10.457595 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa4e2c2-02ca-400b-baf7-e0ee7c1db5ca admin admin] PATH_INFO: `/v3/projects/160cc3d05844420e90b47380a0381e67/users/5b9e4931ab03429eb98883201f5c8737/roles/441fdc11e95b47f4813f72610e39018b` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:10.507969 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 846/1674] 10.222.0.36 () {60 vars in 1152 bytes} [Tue May 3 14:13:10 2022] POST /identity/v3/projects => generated 373 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 14:13:10.511857 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d46622d-c29b-4142-8630-161beb8c677d admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:10.632479 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d46622d-c29b-4142-8630-161beb8c677d admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:10.638313 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaf9309-86b5-4d38-a978-9ecb09e0ef3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:10.639286 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaf9309-86b5-4d38-a978-9ecb09e0ef3d admin admin] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:10.640133 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaf9309-86b5-4d38-a978-9ecb09e0ef3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:10.640736 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaf9309-86b5-4d38-a978-9ecb09e0ef3d admin admin] PATH_INFO: `/v3/users` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:10.641656 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aaf9309-86b5-4d38-a978-9ecb09e0ef3d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:10.643869 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aaf9309-86b5-4d38-a978-9ecb09e0ef3d admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:10.734721 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 847/1675] 10.222.0.36 () {60 vars in 1143 bytes} [Tue May 3 14:13:10 2022] POST /identity/v3/users => generated 287 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 14:13:10.737381 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaf9309-86b5-4d38-a978-9ecb09e0ef3d admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:10.769341 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa4e2c2-02ca-400b-baf7-e0ee7c1db5ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=160cc3d05844420e90b47380a0381e67, user_id=5b9e4931ab03429eb98883201f5c8737, role_id=441fdc11e95b47f4813f72610e39018b)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:10.777946 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa4e2c2-02ca-400b-baf7-e0ee7c1db5ca admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:10.778787 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaf9309-86b5-4d38-a978-9ecb09e0ef3d admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:10.803581 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d35b24-a1e5-4e7d-8aa6-e856ea8f582d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:10.806447 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d35b24-a1e5-4e7d-8aa6-e856ea8f582d admin admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:10.806754 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d35b24-a1e5-4e7d-8aa6-e856ea8f582d admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:10.807358 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d35b24-a1e5-4e7d-8aa6-e856ea8f582d admin admin] PATH_INFO: `/v3/roles` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:10.809193 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d35b24-a1e5-4e7d-8aa6-e856ea8f582d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:10.813404 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d35b24-a1e5-4e7d-8aa6-e856ea8f582d admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:10.838496 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 829/1676] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 3 14:13:10 2022] PUT /identity/v3/projects/160cc3d05844420e90b47380a0381e67/users/5b9e4931ab03429eb98883201f5c8737/roles/441fdc11e95b47f4813f72610e39018b => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:13:10.850503 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065e3ee3-1bc0-4cd0-881f-6b3830b718e8 None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:10.851705 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065e3ee3-1bc0-4cd0-881f-6b3830b718e8 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:10.852181 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065e3ee3-1bc0-4cd0-881f-6b3830b718e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:10.860676 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 848/1677] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 3 14:13:10 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 14:13:10.876616 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d35b24-a1e5-4e7d-8aa6-e856ea8f582d admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:10.909402 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d35b24-a1e5-4e7d-8aa6-e856ea8f582d admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:10.948630 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-065e3ee3-1bc0-4cd0-881f-6b3830b718e8 None None] MFA Rules not processed for user `5b9e4931ab03429eb98883201f5c8737`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:13:10.950166 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-065e3ee3-1bc0-4cd0-881f-6b3830b718e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:13:11.070360 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a0384d-f86b-4e83-ba9c-2eb7939b00bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:11.077262 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a0384d-f86b-4e83-ba9c-2eb7939b00bd admin admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:11.079051 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a0384d-f86b-4e83-ba9c-2eb7939b00bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:11.079480 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a0384d-f86b-4e83-ba9c-2eb7939b00bd admin admin] PATH_INFO: `/v3/roles` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:11.089339 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a0384d-f86b-4e83-ba9c-2eb7939b00bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:11.091621 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a0384d-f86b-4e83-ba9c-2eb7939b00bd admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:11.155189 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 849/1678] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 3 14:13:10 2022] GET /identity/v3/roles => generated 1420 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 14:13:11.157235 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a0384d-f86b-4e83-ba9c-2eb7939b00bd admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:11.157463 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 830/1679] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:13:10 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:13:11.158540 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065e3ee3-1bc0-4cd0-881f-6b3830b718e8 None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:11.169842 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a0384d-f86b-4e83-ba9c-2eb7939b00bd admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:11.186084 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87854298-e7ae-4062-b538-92b4e8a5fe46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:11.186793 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065e3ee3-1bc0-4cd0-881f-6b3830b718e8 None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:11.187409 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87854298-e7ae-4062-b538-92b4e8a5fe46 admin admin] REQUEST_METHOD: `PUT` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:11.187639 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87854298-e7ae-4062-b538-92b4e8a5fe46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:11.187915 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87854298-e7ae-4062-b538-92b4e8a5fe46 admin admin] PATH_INFO: `/v3/projects/5cefa0e767c8424dbe114d8f6fcda1f0/users/82a0b2f133d6479c9a09ac56320aea1b/roles/441fdc11e95b47f4813f72610e39018b` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:11.206170 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac9832c-7c33-4c7f-94e1-ccd580edb39b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:11.207630 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac9832c-7c33-4c7f-94e1-ccd580edb39b admin admin] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:11.207917 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac9832c-7c33-4c7f-94e1-ccd580edb39b admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:11.208201 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac9832c-7c33-4c7f-94e1-ccd580edb39b admin admin] PATH_INFO: `/v3/projects` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:11.208934 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac9832c-7c33-4c7f-94e1-ccd580edb39b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:11.215374 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac9832c-7c33-4c7f-94e1-ccd580edb39b admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:11.250240 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87854298-e7ae-4062-b538-92b4e8a5fe46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5cefa0e767c8424dbe114d8f6fcda1f0, user_id=82a0b2f133d6479c9a09ac56320aea1b, role_id=441fdc11e95b47f4813f72610e39018b)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:11.256411 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87854298-e7ae-4062-b538-92b4e8a5fe46 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:11.294472 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 831/1681] 10.222.0.36 () {60 vars in 1152 bytes} [Tue May 3 14:13:11 2022] POST /identity/v3/projects => generated 363 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 14:13:11.299826 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 850/1681] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 3 14:13:11 2022] PUT /identity/v3/projects/5cefa0e767c8424dbe114d8f6fcda1f0/users/82a0b2f133d6479c9a09ac56320aea1b/roles/441fdc11e95b47f4813f72610e39018b => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 14:13:11.300908 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac9832c-7c33-4c7f-94e1-ccd580edb39b admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:11.304317 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e36da9-ee5e-44fd-8f8d-1972e99357e1 None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:11.304632 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e36da9-ee5e-44fd-8f8d-1972e99357e1 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:11.310174 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e36da9-ee5e-44fd-8f8d-1972e99357e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:11.415330 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-e2e36da9-ee5e-44fd-8f8d-1972e99357e1 None None] MFA Rules not processed for user `82a0b2f133d6479c9a09ac56320aea1b`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:13:11.419494 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-e2e36da9-ee5e-44fd-8f8d-1972e99357e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:13:11.545855 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac9832c-7c33-4c7f-94e1-ccd580edb39b admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:11.571541 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59e819b-e981-4425-b89f-c4bdcee565ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:11.572245 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59e819b-e981-4425-b89f-c4bdcee565ae admin admin] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:11.572532 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59e819b-e981-4425-b89f-c4bdcee565ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:11.581162 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59e819b-e981-4425-b89f-c4bdcee565ae admin admin] PATH_INFO: `/v3/users` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:11.582294 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59e819b-e981-4425-b89f-c4bdcee565ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:11.586008 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59e819b-e981-4425-b89f-c4bdcee565ae admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:11.638029 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 851/1682] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:13:11 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 338 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:13:11.644866 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e36da9-ee5e-44fd-8f8d-1972e99357e1 None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:11.657664 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 832/1683] 10.222.0.36 () {60 vars in 1143 bytes} [Tue May 3 14:13:11 2022] POST /identity/v3/users => generated 288 bytes in 357 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 14:13:11.661886 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59e819b-e981-4425-b89f-c4bdcee565ae admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:11.702411 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59e819b-e981-4425-b89f-c4bdcee565ae admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:11.704555 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e36da9-ee5e-44fd-8f8d-1972e99357e1 None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:11.727208 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87548ee-4c02-465d-af9e-e0f170d80ae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:11.729639 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87548ee-4c02-465d-af9e-e0f170d80ae1 admin admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:11.734258 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb4af5b-07f5-49d9-8add-e25925580a80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:11.734629 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87548ee-4c02-465d-af9e-e0f170d80ae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:11.735435 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87548ee-4c02-465d-af9e-e0f170d80ae1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:11.736388 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87548ee-4c02-465d-af9e-e0f170d80ae1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:11.738447 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb4af5b-07f5-49d9-8add-e25925580a80 admin admin] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:11.740118 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb4af5b-07f5-49d9-8add-e25925580a80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:11.740494 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb4af5b-07f5-49d9-8add-e25925580a80 admin admin] PATH_INFO: `/v3/projects` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:11.745200 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87548ee-4c02-465d-af9e-e0f170d80ae1 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:11.746495 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb4af5b-07f5-49d9-8add-e25925580a80 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:11.750853 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb4af5b-07f5-49d9-8add-e25925580a80 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:11.784057 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 833/1684] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 3 14:13:11 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 14:13:11.787207 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87548ee-4c02-465d-af9e-e0f170d80ae1 admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:11.822685 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87548ee-4c02-465d-af9e-e0f170d80ae1 admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:11.840519 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df24c65d-a4b4-4a77-850f-a4122c1088e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:11.844695 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df24c65d-a4b4-4a77-850f-a4122c1088e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:11.847583 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df24c65d-a4b4-4a77-850f-a4122c1088e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:11.847903 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df24c65d-a4b4-4a77-850f-a4122c1088e9 admin admin] PATH_INFO: `/v3/projects/b8d5f7f6a4b24de0bea994e4e004082c/users/513501326f6c4af798288586b8018857/roles/36abe9b50fd8479c86c4f8f70fd85aa3` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:11.848834 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 852/1685] 10.222.0.36 () {60 vars in 1152 bytes} [Tue May 3 14:13:11 2022] POST /identity/v3/projects => generated 371 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 14:13:11.850360 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb4af5b-07f5-49d9-8add-e25925580a80 admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:11.904737 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df24c65d-a4b4-4a77-850f-a4122c1088e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8d5f7f6a4b24de0bea994e4e004082c, user_id=513501326f6c4af798288586b8018857, role_id=36abe9b50fd8479c86c4f8f70fd85aa3)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:11.911527 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df24c65d-a4b4-4a77-850f-a4122c1088e9 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:11.946741 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 834/1686] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 3 14:13:11 2022] PUT /identity/v3/projects/b8d5f7f6a4b24de0bea994e4e004082c/users/513501326f6c4af798288586b8018857/roles/36abe9b50fd8479c86c4f8f70fd85aa3 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:13:11.956188 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df24c65d-a4b4-4a77-850f-a4122c1088e9 admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:12.044101 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb4af5b-07f5-49d9-8add-e25925580a80 admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:12.147986 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df24c65d-a4b4-4a77-850f-a4122c1088e9 admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:12.173531 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2110ed51-80e5-4161-9bed-d1999c66c893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:12.174831 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2110ed51-80e5-4161-9bed-d1999c66c893 admin admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:12.175296 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2110ed51-80e5-4161-9bed-d1999c66c893 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:12.175730 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2110ed51-80e5-4161-9bed-d1999c66c893 admin admin] PATH_INFO: `/v3/roles` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:12.177199 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2110ed51-80e5-4161-9bed-d1999c66c893 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:12.180676 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2110ed51-80e5-4161-9bed-d1999c66c893 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:12.209612 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58516789-4ed3-46b7-b5a6-ca5480198bb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:12.209612 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58516789-4ed3-46b7-b5a6-ca5480198bb8 admin admin] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:12.209612 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58516789-4ed3-46b7-b5a6-ca5480198bb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:12.209612 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58516789-4ed3-46b7-b5a6-ca5480198bb8 admin admin] PATH_INFO: `/v3/users` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:12.209965 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58516789-4ed3-46b7-b5a6-ca5480198bb8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:12.210939 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 835/1687] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 3 14:13:11 2022] GET /identity/v3/roles => generated 1420 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 14:13:12.212297 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2110ed51-80e5-4161-9bed-d1999c66c893 admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:12.214752 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58516789-4ed3-46b7-b5a6-ca5480198bb8 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:12.223354 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2110ed51-80e5-4161-9bed-d1999c66c893 admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:12.228799 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffb18d2-d5d2-4747-9e67-63cbbf3c010c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:12.230057 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffb18d2-d5d2-4747-9e67-63cbbf3c010c admin admin] REQUEST_METHOD: `PUT` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:12.230599 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffb18d2-d5d2-4747-9e67-63cbbf3c010c admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:12.231126 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffb18d2-d5d2-4747-9e67-63cbbf3c010c admin admin] PATH_INFO: `/v3/projects/b8d5f7f6a4b24de0bea994e4e004082c/users/513501326f6c4af798288586b8018857/roles/36abe9b50fd8479c86c4f8f70fd85aa3` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:12.233414 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffb18d2-d5d2-4747-9e67-63cbbf3c010c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8d5f7f6a4b24de0bea994e4e004082c, user_id=513501326f6c4af798288586b8018857, role_id=36abe9b50fd8479c86c4f8f70fd85aa3)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:12.236627 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffb18d2-d5d2-4747-9e67-63cbbf3c010c admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:12.264676 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 853/1689] 10.222.0.36 () {60 vars in 1143 bytes} [Tue May 3 14:13:11 2022] POST /identity/v3/users => generated 292 bytes in 412 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 14:13:12.264849 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 836/1689] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 3 14:13:12 2022] PUT /identity/v3/projects/b8d5f7f6a4b24de0bea994e4e004082c/users/513501326f6c4af798288586b8018857/roles/36abe9b50fd8479c86c4f8f70fd85aa3 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:13:12.264849 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffb18d2-d5d2-4747-9e67-63cbbf3c010c admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:12.265004 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e8023e-4307-44ea-bca7-a5143398f16f None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:12.265590 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e8023e-4307-44ea-bca7-a5143398f16f None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:12.265934 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e8023e-4307-44ea-bca7-a5143398f16f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:12.355448 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-99e8023e-4307-44ea-bca7-a5143398f16f None None] MFA Rules not processed for user `513501326f6c4af798288586b8018857`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:13:12.360879 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-99e8023e-4307-44ea-bca7-a5143398f16f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:13:12.448850 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffb18d2-d5d2-4747-9e67-63cbbf3c010c admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:12.465678 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519ee1bc-e11f-4bd3-a7ca-63cec60eee61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:12.468546 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519ee1bc-e11f-4bd3-a7ca-63cec60eee61 admin admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:12.470244 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519ee1bc-e11f-4bd3-a7ca-63cec60eee61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:12.474055 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519ee1bc-e11f-4bd3-a7ca-63cec60eee61 admin admin] PATH_INFO: `/v3/roles` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:12.474954 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519ee1bc-e11f-4bd3-a7ca-63cec60eee61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:12.480437 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519ee1bc-e11f-4bd3-a7ca-63cec60eee61 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:12.509424 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 837/1690] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 3 14:13:12 2022] GET /identity/v3/roles => generated 1420 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 14:13:12.512447 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519ee1bc-e11f-4bd3-a7ca-63cec60eee61 admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:12.560821 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519ee1bc-e11f-4bd3-a7ca-63cec60eee61 admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:12.580258 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97eeafc8-479a-4b0c-94e5-796a32280f36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:12.581325 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eeafc8-479a-4b0c-94e5-796a32280f36 admin admin] REQUEST_METHOD: `PUT` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:12.581689 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eeafc8-479a-4b0c-94e5-796a32280f36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:12.583664 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eeafc8-479a-4b0c-94e5-796a32280f36 admin admin] PATH_INFO: `/v3/projects/f44a0c0337b84fedb428590ee3dbd981/users/0ebd7d31f3a342f59399312fb52a2067/roles/36abe9b50fd8479c86c4f8f70fd85aa3` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:12.602640 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 854/1691] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:13:12 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 339 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:13:12.608480 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e8023e-4307-44ea-bca7-a5143398f16f None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:12.611836 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-99e8023e-4307-44ea-bca7-a5143398f16f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:13:12.657356 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97eeafc8-479a-4b0c-94e5-796a32280f36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f44a0c0337b84fedb428590ee3dbd981, user_id=0ebd7d31f3a342f59399312fb52a2067, role_id=36abe9b50fd8479c86c4f8f70fd85aa3)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:12.659894 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97eeafc8-479a-4b0c-94e5-796a32280f36 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:12.720159 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 838/1692] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 3 14:13:12 2022] PUT /identity/v3/projects/f44a0c0337b84fedb428590ee3dbd981/users/0ebd7d31f3a342f59399312fb52a2067/roles/36abe9b50fd8479c86c4f8f70fd85aa3 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:13:12.721270 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97eeafc8-479a-4b0c-94e5-796a32280f36 admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:12.805693 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e8023e-4307-44ea-bca7-a5143398f16f None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:12.893377 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97eeafc8-479a-4b0c-94e5-796a32280f36 admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:12.927316 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd7938d-5113-4a63-b5c9-f99931af32ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:12.928003 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd7938d-5113-4a63-b5c9-f99931af32ea admin admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:12.928277 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd7938d-5113-4a63-b5c9-f99931af32ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:12.928555 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd7938d-5113-4a63-b5c9-f99931af32ea admin admin] PATH_INFO: `/v3/roles` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:12.929703 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd7938d-5113-4a63-b5c9-f99931af32ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:12.930931 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd7938d-5113-4a63-b5c9-f99931af32ea admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:12.959638 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 839/1693] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 3 14:13:12 2022] GET /identity/v3/roles => generated 1420 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 14:13:12.960751 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd7938d-5113-4a63-b5c9-f99931af32ea admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:12.979269 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd7938d-5113-4a63-b5c9-f99931af32ea admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:12.996748 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8e41b7-dbb9-4367-9a72-2501280adfc8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b014f4c7ba1414cb8a597f5bc4033f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:12.997442 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8e41b7-dbb9-4367-9a72-2501280adfc8 service cinder] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:12.997724 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8e41b7-dbb9-4367-9a72-2501280adfc8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:12.998008 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8e41b7-dbb9-4367-9a72-2501280adfc8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:12.999431 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73317fc-a8d3-4416-b81b-4a4d2e059500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:13.000398 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73317fc-a8d3-4416-b81b-4a4d2e059500 admin admin] REQUEST_METHOD: `PUT` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:13.000675 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73317fc-a8d3-4416-b81b-4a4d2e059500 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:13.000950 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73317fc-a8d3-4416-b81b-4a4d2e059500 admin admin] PATH_INFO: `/v3/projects/f44a0c0337b84fedb428590ee3dbd981/users/0ebd7d31f3a342f59399312fb52a2067/roles/36abe9b50fd8479c86c4f8f70fd85aa3` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:13.004444 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73317fc-a8d3-4416-b81b-4a4d2e059500 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f44a0c0337b84fedb428590ee3dbd981, user_id=0ebd7d31f3a342f59399312fb52a2067, role_id=36abe9b50fd8479c86c4f8f70fd85aa3)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:13.007235 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73317fc-a8d3-4416-b81b-4a4d2e059500 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:13.066741 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 840/1694] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 3 14:13:12 2022] PUT /identity/v3/projects/f44a0c0337b84fedb428590ee3dbd981/users/0ebd7d31f3a342f59399312fb52a2067/roles/36abe9b50fd8479c86c4f8f70fd85aa3 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 14:13:13.080705 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dd5345-fde4-4d15-90e6-9f41c2434b0d None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:13.081055 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dd5345-fde4-4d15-90e6-9f41c2434b0d None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:13.081263 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dd5345-fde4-4d15-90e6-9f41c2434b0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:13.151913 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-64dd5345-fde4-4d15-90e6-9f41c2434b0d None None] MFA Rules not processed for user `0ebd7d31f3a342f59399312fb52a2067`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:13:13.153330 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-64dd5345-fde4-4d15-90e6-9f41c2434b0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:13:13.191787 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8e41b7-dbb9-4367-9a72-2501280adfc8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:13.200093 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8e41b7-dbb9-4367-9a72-2501280adfc8 service cinder] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:13.257621 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 855/1695] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:13:12 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 648 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 03 14:13:13.335968 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8e41b7-dbb9-4367-9a72-2501280adfc8 service cinder] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:13.346830 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8e41b7-dbb9-4367-9a72-2501280adfc8 service cinder] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:13.373046 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 841/1696] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:13:13 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 14:13:13.500026 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0affe392-c568-48ba-b9c7-1dd471c2c977 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b014f4c7ba1414cb8a597f5bc4033f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:13.500870 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0affe392-c568-48ba-b9c7-1dd471c2c977 service cinder] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:13.501218 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0affe392-c568-48ba-b9c7-1dd471c2c977 service cinder] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:13.501583 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0affe392-c568-48ba-b9c7-1dd471c2c977 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:13.542492 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dd5345-fde4-4d15-90e6-9f41c2434b0d None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:13.543485 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-64dd5345-fde4-4d15-90e6-9f41c2434b0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:13:13.572181 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dd5345-fde4-4d15-90e6-9f41c2434b0d None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:13.588955 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bde0aa4-e3ce-4335-8143-6b0074d66fe7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b014f4c7ba1414cb8a597f5bc4033f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:13.589853 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bde0aa4-e3ce-4335-8143-6b0074d66fe7 service cinder] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:13.590332 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bde0aa4-e3ce-4335-8143-6b0074d66fe7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:13.594937 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bde0aa4-e3ce-4335-8143-6b0074d66fe7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:13.617445 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bde0aa4-e3ce-4335-8143-6b0074d66fe7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:13.619299 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bde0aa4-e3ce-4335-8143-6b0074d66fe7 service cinder] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:13.645150 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 842/1697] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:13:13 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 03 14:13:13.653106 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0affe392-c568-48ba-b9c7-1dd471c2c977 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:13.654582 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0affe392-c568-48ba-b9c7-1dd471c2c977 service cinder] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:13.678178 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdc9131-3d70-402a-b7ae-04c1caaa15a6 None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:13.678466 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdc9131-3d70-402a-b7ae-04c1caaa15a6 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:13.678747 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdc9131-3d70-402a-b7ae-04c1caaa15a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:13.694412 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 856/1698] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:13:13 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 14:13:13.712423 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-fbdc9131-3d70-402a-b7ae-04c1caaa15a6 None None] MFA Rules not processed for user `dec39ff0b6544a738e5aae06e9a8cb38`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:13:13.714329 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-fbdc9131-3d70-402a-b7ae-04c1caaa15a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:13:13.816372 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 843/1699] 10.222.0.36 () {58 vars in 1009 bytes} [Tue May 3 14:13:13 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 14:13:14.136862 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0affe392-c568-48ba-b9c7-1dd471c2c977 service cinder] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:14.139566 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-0affe392-c568-48ba-b9c7-1dd471c2c977 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:13:14.442567 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0affe392-c568-48ba-b9c7-1dd471c2c977 service cinder] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:14.470023 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbff06c-55d3-430f-9b61-96216e4a7a04 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1180e29180d44418390cf22d3e0bd6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:14.470707 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbff06c-55d3-430f-9b61-96216e4a7a04 service swift] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:14.471034 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbff06c-55d3-430f-9b61-96216e4a7a04 service swift] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:14.471250 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbff06c-55d3-430f-9b61-96216e4a7a04 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:14.496439 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbff06c-55d3-430f-9b61-96216e4a7a04 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:14.498556 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbff06c-55d3-430f-9b61-96216e4a7a04 service swift] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:14.515540 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 857/1700] 10.222.0.36 () {60 vars in 1384 bytes} [Tue May 3 14:13:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 03 14:13:15.343825 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdc9131-3d70-402a-b7ae-04c1caaa15a6 None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:15.552928 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdc9131-3d70-402a-b7ae-04c1caaa15a6 None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:15.558389 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b3b3e2-ba02-4d9c-a0ea-9698e9d42b4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:15.559622 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b3b3e2-ba02-4d9c-a0ea-9698e9d42b4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:15.560410 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b3b3e2-ba02-4d9c-a0ea-9698e9d42b4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:15.560929 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b3b3e2-ba02-4d9c-a0ea-9698e9d42b4a admin admin] PATH_INFO: `/v3/users/82a0b2f133d6479c9a09ac56320aea1b` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:15.562763 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b3b3e2-ba02-4d9c-a0ea-9698e9d42b4a admin admin] RBAC: Authorizing `identity:delete_user(user_id=82a0b2f133d6479c9a09ac56320aea1b)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:15.565033 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b3b3e2-ba02-4d9c-a0ea-9698e9d42b4a admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:15.677959 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-e3b3b3e2-ba02-4d9c-a0ea-9698e9d42b4a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82a0b2f133d6479c9a09ac56320aea1b'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:15.692921 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-e3b3b3e2-ba02-4d9c-a0ea-9698e9d42b4a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82a0b2f133d6479c9a09ac56320aea1b'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:15.694788 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-e3b3b3e2-ba02-4d9c-a0ea-9698e9d42b4a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82a0b2f133d6479c9a09ac56320aea1b'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:15.724197 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-e3b3b3e2-ba02-4d9c-a0ea-9698e9d42b4a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82a0b2f133d6479c9a09ac56320aea1b'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:15.725197 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-e3b3b3e2-ba02-4d9c-a0ea-9698e9d42b4a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82a0b2f133d6479c9a09ac56320aea1b'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:15.754584 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 844/1701] 10.222.0.36 () {58 vars in 1223 bytes} [Tue May 3 14:13:15 2022] DELETE /identity/v3/users/82a0b2f133d6479c9a09ac56320aea1b => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:13:15.756452 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab26db3-c324-43b2-8530-3960a085ce63 None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:15.757414 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab26db3-c324-43b2-8530-3960a085ce63 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:15.757832 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab26db3-c324-43b2-8530-3960a085ce63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:15.802542 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-eab26db3-c324-43b2-8530-3960a085ce63 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:13:15.803787 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-eab26db3-c324-43b2-8530-3960a085ce63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:13:16.084820 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 858/1702] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:13:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:13:16.198041 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b3b3e2-ba02-4d9c-a0ea-9698e9d42b4a admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:16.200893 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-e3b3b3e2-ba02-4d9c-a0ea-9698e9d42b4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:13:16.384977 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b3b3e2-ba02-4d9c-a0ea-9698e9d42b4a admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:16.400760 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae99d9cc-95f6-4be7-86f6-7494226c5587 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '937bea4f355144b4a7ee11baabc3a4cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:16.400760 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae99d9cc-95f6-4be7-86f6-7494226c5587 service neutron] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:16.400760 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae99d9cc-95f6-4be7-86f6-7494226c5587 service neutron] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:16.401192 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae99d9cc-95f6-4be7-86f6-7494226c5587 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:16.436508 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae99d9cc-95f6-4be7-86f6-7494226c5587 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:16.438074 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae99d9cc-95f6-4be7-86f6-7494226c5587 service neutron] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:16.480509 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 845/1703] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:13:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 14:13:17.173242 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab26db3-c324-43b2-8530-3960a085ce63 None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:17.173830 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-eab26db3-c324-43b2-8530-3960a085ce63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:13:17.195299 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab26db3-c324-43b2-8530-3960a085ce63 None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:17.222841 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dcbe89-6ff1-487d-8c2d-2866cb3f8113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:17.223966 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dcbe89-6ff1-487d-8c2d-2866cb3f8113 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:17.224448 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dcbe89-6ff1-487d-8c2d-2866cb3f8113 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:17.224959 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dcbe89-6ff1-487d-8c2d-2866cb3f8113 admin admin] PATH_INFO: `/v3/users/399094e4f18248428119577c4ba1fc8c` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:17.227395 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dcbe89-6ff1-487d-8c2d-2866cb3f8113 admin admin] RBAC: Authorizing `identity:delete_user(user_id=399094e4f18248428119577c4ba1fc8c)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:17.230196 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dcbe89-6ff1-487d-8c2d-2866cb3f8113 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:17.384520 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-34dcbe89-6ff1-487d-8c2d-2866cb3f8113 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '399094e4f18248428119577c4ba1fc8c'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:17.417178 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-34dcbe89-6ff1-487d-8c2d-2866cb3f8113 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '399094e4f18248428119577c4ba1fc8c'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:17.420545 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-34dcbe89-6ff1-487d-8c2d-2866cb3f8113 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '399094e4f18248428119577c4ba1fc8c'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:17.441470 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-34dcbe89-6ff1-487d-8c2d-2866cb3f8113 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '399094e4f18248428119577c4ba1fc8c'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:17.442908 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-34dcbe89-6ff1-487d-8c2d-2866cb3f8113 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '399094e4f18248428119577c4ba1fc8c'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:17.547251 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 859/1704] 10.222.0.36 () {58 vars in 1223 bytes} [Tue May 3 14:13:17 2022] DELETE /identity/v3/users/399094e4f18248428119577c4ba1fc8c => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:13:17.552052 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a138b15-12c3-4299-b3c5-88bd1829a9c8 None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:17.552590 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a138b15-12c3-4299-b3c5-88bd1829a9c8 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:17.552694 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a138b15-12c3-4299-b3c5-88bd1829a9c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:17.601898 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-9a138b15-12c3-4299-b3c5-88bd1829a9c8 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:13:17.611408 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-9a138b15-12c3-4299-b3c5-88bd1829a9c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:13:17.845752 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 846/1705] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:13:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:13:17.902224 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dcbe89-6ff1-487d-8c2d-2866cb3f8113 admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:17.903985 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-34dcbe89-6ff1-487d-8c2d-2866cb3f8113 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:13:18.148049 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dcbe89-6ff1-487d-8c2d-2866cb3f8113 admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:18.163163 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdac3fd-5fe4-4a08-bc56-3644efd0cd8d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '937bea4f355144b4a7ee11baabc3a4cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:18.167441 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdac3fd-5fe4-4a08-bc56-3644efd0cd8d service neutron] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:18.168980 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdac3fd-5fe4-4a08-bc56-3644efd0cd8d service neutron] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:18.171160 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdac3fd-5fe4-4a08-bc56-3644efd0cd8d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:18.191110 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dea7ec-784c-4023-9a5c-8b608dc0fd5e None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:18.191390 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dea7ec-784c-4023-9a5c-8b608dc0fd5e None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:18.191672 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dea7ec-784c-4023-9a5c-8b608dc0fd5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:18.214822 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdac3fd-5fe4-4a08-bc56-3644efd0cd8d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:18.222030 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdac3fd-5fe4-4a08-bc56-3644efd0cd8d service neutron] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:18.243729 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-43dea7ec-784c-4023-9a5c-8b608dc0fd5e None None] MFA Rules not processed for user `937bea4f355144b4a7ee11baabc3a4cb`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:13:18.245204 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-43dea7ec-784c-4023-9a5c-8b608dc0fd5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:13:18.274660 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 860/1706] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:13:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 14:13:18.288498 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 847/1707] 10.222.0.26 () {58 vars in 1015 bytes} [Tue May 3 14:13:18 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:13:18.340153 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdac3fd-5fe4-4a08-bc56-3644efd0cd8d service neutron] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:18.342523 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-cfdac3fd-5fe4-4a08-bc56-3644efd0cd8d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:13:18.376179 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdac3fd-5fe4-4a08-bc56-3644efd0cd8d service neutron] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:18.399965 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b14d23a-efa6-4860-89f6-43861c05118f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '937bea4f355144b4a7ee11baabc3a4cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:18.403140 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b14d23a-efa6-4860-89f6-43861c05118f service neutron] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:18.403813 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b14d23a-efa6-4860-89f6-43861c05118f service neutron] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:18.404248 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b14d23a-efa6-4860-89f6-43861c05118f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:18.421544 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b14d23a-efa6-4860-89f6-43861c05118f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:18.426426 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b14d23a-efa6-4860-89f6-43861c05118f service neutron] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:18.463501 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 861/1708] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:13:18 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 14:13:18.895849 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c479ed12-7993-42f4-92b1-44d485b2cea6 None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:18.896904 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c479ed12-7993-42f4-92b1-44d485b2cea6 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:18.897763 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c479ed12-7993-42f4-92b1-44d485b2cea6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:18.933595 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b14d23a-efa6-4860-89f6-43861c05118f service neutron] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:18.935620 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-6b14d23a-efa6-4860-89f6-43861c05118f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:13:18.992124 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b14d23a-efa6-4860-89f6-43861c05118f service neutron] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:18.994627 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-c479ed12-7993-42f4-92b1-44d485b2cea6 None None] MFA Rules not processed for user `b67e152bc8e94244bce87e63c3b33747`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:13:18.996125 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-c479ed12-7993-42f4-92b1-44d485b2cea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:13:19.015570 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baef8756-e5f1-4b3c-b398-408210065160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:19.018012 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baef8756-e5f1-4b3c-b398-408210065160 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:19.018347 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baef8756-e5f1-4b3c-b398-408210065160 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:19.018793 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baef8756-e5f1-4b3c-b398-408210065160 admin admin] PATH_INFO: `/v3/projects/5cefa0e767c8424dbe114d8f6fcda1f0` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:19.027126 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baef8756-e5f1-4b3c-b398-408210065160 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5cefa0e767c8424dbe114d8f6fcda1f0)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:19.033950 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baef8756-e5f1-4b3c-b398-408210065160 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:19.206660 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-baef8756-e5f1-4b3c-b398-408210065160 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5cefa0e767c8424dbe114d8f6fcda1f0', 'request_id': 'req-baef8756-e5f1-4b3c-b398-408210065160'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:19.223308 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-baef8756-e5f1-4b3c-b398-408210065160 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5cefa0e767c8424dbe114d8f6fcda1f0', 'request_id': 'req-baef8756-e5f1-4b3c-b398-408210065160'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:19.255425 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-baef8756-e5f1-4b3c-b398-408210065160 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5cefa0e767c8424dbe114d8f6fcda1f0', 'request_id': 'req-baef8756-e5f1-4b3c-b398-408210065160'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:19.302095 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-baef8756-e5f1-4b3c-b398-408210065160 admin admin] The token cache is being invalidate because project 5cefa0e767c8424dbe114d8f6fcda1f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80013) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 14:13:19.302449 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-baef8756-e5f1-4b3c-b398-408210065160 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:19.305564 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-baef8756-e5f1-4b3c-b398-408210065160 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:19.318766 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 862/1709] 10.222.0.36 () {58 vars in 1232 bytes} [Tue May 3 14:13:18 2022] DELETE /identity/v3/projects/5cefa0e767c8424dbe114d8f6fcda1f0 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:13:19.323563 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baef8756-e5f1-4b3c-b398-408210065160 admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:19.328084 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-baef8756-e5f1-4b3c-b398-408210065160 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:13:19.375688 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 848/1710] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:13:18 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 480 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:13:19.381939 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1045ea78-09ca-4c59-b5d7-849c77737c83 None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:19.383567 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1045ea78-09ca-4c59-b5d7-849c77737c83 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:19.384699 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1045ea78-09ca-4c59-b5d7-849c77737c83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:19.468839 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-1045ea78-09ca-4c59-b5d7-849c77737c83 None None] MFA Rules not processed for user `b67e152bc8e94244bce87e63c3b33747`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:13:19.476228 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-1045ea78-09ca-4c59-b5d7-849c77737c83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:13:19.652563 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baef8756-e5f1-4b3c-b398-408210065160 admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:19.674989 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aee8f87-ef43-4f5b-8884-c56d632fdbf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:19.675996 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aee8f87-ef43-4f5b-8884-c56d632fdbf4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:19.676273 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aee8f87-ef43-4f5b-8884-c56d632fdbf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:19.676546 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aee8f87-ef43-4f5b-8884-c56d632fdbf4 admin admin] PATH_INFO: `/v3/users/0ebd7d31f3a342f59399312fb52a2067` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:19.678198 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aee8f87-ef43-4f5b-8884-c56d632fdbf4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ebd7d31f3a342f59399312fb52a2067)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:19.687218 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aee8f87-ef43-4f5b-8884-c56d632fdbf4 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:19.708655 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 849/1711] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:13:19 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 332 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:13:19.709892 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1045ea78-09ca-4c59-b5d7-849c77737c83 None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:19.715076 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-1045ea78-09ca-4c59-b5d7-849c77737c83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:13:19.762105 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1045ea78-09ca-4c59-b5d7-849c77737c83 None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:19.776235 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bdc95a-be9e-4732-a215-d29615b7707a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:19.779801 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bdc95a-be9e-4732-a215-d29615b7707a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:19.780314 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bdc95a-be9e-4732-a215-d29615b7707a admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:19.780724 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bdc95a-be9e-4732-a215-d29615b7707a admin admin] PATH_INFO: `/v3/users/5b9e4931ab03429eb98883201f5c8737` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:19.783612 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bdc95a-be9e-4732-a215-d29615b7707a admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b9e4931ab03429eb98883201f5c8737)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:19.789455 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bdc95a-be9e-4732-a215-d29615b7707a admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:19.900735 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-1aee8f87-ef43-4f5b-8884-c56d632fdbf4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ebd7d31f3a342f59399312fb52a2067'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:19.941992 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-02bdc95a-be9e-4732-a215-d29615b7707a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b9e4931ab03429eb98883201f5c8737'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:19.942581 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-1aee8f87-ef43-4f5b-8884-c56d632fdbf4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ebd7d31f3a342f59399312fb52a2067'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:19.942951 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-1aee8f87-ef43-4f5b-8884-c56d632fdbf4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ebd7d31f3a342f59399312fb52a2067'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:19.966907 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-1aee8f87-ef43-4f5b-8884-c56d632fdbf4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ebd7d31f3a342f59399312fb52a2067'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:19.968055 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-1aee8f87-ef43-4f5b-8884-c56d632fdbf4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ebd7d31f3a342f59399312fb52a2067'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:19.968183 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-02bdc95a-be9e-4732-a215-d29615b7707a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b9e4931ab03429eb98883201f5c8737'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:19.970149 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-02bdc95a-be9e-4732-a215-d29615b7707a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b9e4931ab03429eb98883201f5c8737'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:20.011291 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-02bdc95a-be9e-4732-a215-d29615b7707a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b9e4931ab03429eb98883201f5c8737'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:20.013789 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-02bdc95a-be9e-4732-a215-d29615b7707a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b9e4931ab03429eb98883201f5c8737'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:20.045281 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 863/1712] 10.222.0.36 () {58 vars in 1223 bytes} [Tue May 3 14:13:19 2022] DELETE /identity/v3/users/0ebd7d31f3a342f59399312fb52a2067 => generated 0 bytes in 720 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:13:20.047411 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aee8f87-ef43-4f5b-8884-c56d632fdbf4 admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:20.053112 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 850/1713] 10.222.0.36 () {58 vars in 1223 bytes} [Tue May 3 14:13:19 2022] DELETE /identity/v3/users/5b9e4931ab03429eb98883201f5c8737 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:13:20.058255 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-1aee8f87-ef43-4f5b-8884-c56d632fdbf4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:13:20.065656 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d5187a-d029-450d-ab67-f129fa33d853 None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:20.065656 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d5187a-d029-450d-ab67-f129fa33d853 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:20.065656 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d5187a-d029-450d-ab67-f129fa33d853 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:20.171073 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-65d5187a-d029-450d-ab67-f129fa33d853 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:13:20.172613 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-65d5187a-d029-450d-ab67-f129fa33d853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:13:20.309483 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aee8f87-ef43-4f5b-8884-c56d632fdbf4 admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:20.362467 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 851/1714] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:13:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:13:20.448350 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6063255-0636-4f5d-87be-7ab05c3a9840 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63489e658c094a2598a2ac62159d2fda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:20.451192 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6063255-0636-4f5d-87be-7ab05c3a9840 service nova] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:20.451632 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6063255-0636-4f5d-87be-7ab05c3a9840 service nova] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:20.452499 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6063255-0636-4f5d-87be-7ab05c3a9840 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:20.455859 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d5187a-d029-450d-ab67-f129fa33d853 None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:20.457256 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-65d5187a-d029-450d-ab67-f129fa33d853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:13:20.457989 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-a6063255-0636-4f5d-87be-7ab05c3a9840 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:13:20.619436 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6063255-0636-4f5d-87be-7ab05c3a9840 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:20.621838 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d5187a-d029-450d-ab67-f129fa33d853 None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:20.634304 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6063255-0636-4f5d-87be-7ab05c3a9840 service nova] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:20.639270 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e676eac8-9218-4c54-943f-c5bbfb638501 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '937bea4f355144b4a7ee11baabc3a4cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:20.640039 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e676eac8-9218-4c54-943f-c5bbfb638501 service neutron] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:20.640329 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e676eac8-9218-4c54-943f-c5bbfb638501 service neutron] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:20.640609 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e676eac8-9218-4c54-943f-c5bbfb638501 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:20.671537 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e676eac8-9218-4c54-943f-c5bbfb638501 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:20.673016 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e676eac8-9218-4c54-943f-c5bbfb638501 service neutron] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:20.694984 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 864/1715] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:13:20 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 648 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 14:13:20.739663 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 852/1716] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:13:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 03 14:13:21.228072 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6063255-0636-4f5d-87be-7ab05c3a9840 service nova] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:21.229664 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-a6063255-0636-4f5d-87be-7ab05c3a9840 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:13:21.262337 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6063255-0636-4f5d-87be-7ab05c3a9840 service nova] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:21.287720 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d0a8de-8b07-443b-bcda-c84c3522e2cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:21.288621 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d0a8de-8b07-443b-bcda-c84c3522e2cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:21.288900 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d0a8de-8b07-443b-bcda-c84c3522e2cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:21.289173 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d0a8de-8b07-443b-bcda-c84c3522e2cc admin admin] PATH_INFO: `/v3/projects/63ccbdc980a8425199bd529b12de44d1` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:21.296205 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d0a8de-8b07-443b-bcda-c84c3522e2cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=63ccbdc980a8425199bd529b12de44d1)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:21.298663 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d0a8de-8b07-443b-bcda-c84c3522e2cc admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:21.456863 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-26d0a8de-8b07-443b-bcda-c84c3522e2cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63ccbdc980a8425199bd529b12de44d1', 'request_id': 'req-26d0a8de-8b07-443b-bcda-c84c3522e2cc'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:21.483307 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-26d0a8de-8b07-443b-bcda-c84c3522e2cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63ccbdc980a8425199bd529b12de44d1', 'request_id': 'req-26d0a8de-8b07-443b-bcda-c84c3522e2cc'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:21.500358 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-26d0a8de-8b07-443b-bcda-c84c3522e2cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63ccbdc980a8425199bd529b12de44d1', 'request_id': 'req-26d0a8de-8b07-443b-bcda-c84c3522e2cc'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:21.544845 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-26d0a8de-8b07-443b-bcda-c84c3522e2cc admin admin] The token cache is being invalidate because project 63ccbdc980a8425199bd529b12de44d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80013) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 14:13:21.547649 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-26d0a8de-8b07-443b-bcda-c84c3522e2cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:21.549158 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-26d0a8de-8b07-443b-bcda-c84c3522e2cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:21.567052 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 865/1717] 10.222.0.36 () {58 vars in 1232 bytes} [Tue May 3 14:13:21 2022] DELETE /identity/v3/projects/63ccbdc980a8425199bd529b12de44d1 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:13:21.569057 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1454d8ad-4805-497c-9786-ec730cfdbf3a None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:21.569580 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1454d8ad-4805-497c-9786-ec730cfdbf3a None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:21.569762 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1454d8ad-4805-497c-9786-ec730cfdbf3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:21.649118 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-1454d8ad-4805-497c-9786-ec730cfdbf3a None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:13:21.650447 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-1454d8ad-4805-497c-9786-ec730cfdbf3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:13:21.826401 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 853/1718] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:13:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:13:21.835539 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32043370-503c-48c5-856d-748404c0e0c2 None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:21.835907 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32043370-503c-48c5-856d-748404c0e0c2 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:21.836973 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32043370-503c-48c5-856d-748404c0e0c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:21.899112 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-32043370-503c-48c5-856d-748404c0e0c2 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:13:21.903938 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-32043370-503c-48c5-856d-748404c0e0c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:13:21.928828 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 866/1719] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:13:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:13:21.933056 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1454d8ad-4805-497c-9786-ec730cfdbf3a None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:21.943652 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1454d8ad-4805-497c-9786-ec730cfdbf3a None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:21.961440 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fb1ddd-46a5-4f1a-babb-d908780bda63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:21.962110 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fb1ddd-46a5-4f1a-babb-d908780bda63 admin admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:21.962390 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fb1ddd-46a5-4f1a-babb-d908780bda63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:21.962657 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fb1ddd-46a5-4f1a-babb-d908780bda63 admin admin] PATH_INFO: `/v3/domains` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:21.963396 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fb1ddd-46a5-4f1a-babb-d908780bda63 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80012) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:13:21.963695 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fb1ddd-46a5-4f1a-babb-d908780bda63 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:21.965334 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fb1ddd-46a5-4f1a-babb-d908780bda63 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:22.031920 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 854/1720] 10.222.0.36 () {58 vars in 1152 bytes} [Tue May 3 14:13:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:13:22.033224 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32043370-503c-48c5-856d-748404c0e0c2 None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:22.048617 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32043370-503c-48c5-856d-748404c0e0c2 None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:22.054726 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d86b4d-79bf-419f-9d09-29eaf9f5c5eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:22.055526 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d86b4d-79bf-419f-9d09-29eaf9f5c5eb admin admin] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:22.055906 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d86b4d-79bf-419f-9d09-29eaf9f5c5eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:22.056295 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d86b4d-79bf-419f-9d09-29eaf9f5c5eb admin admin] PATH_INFO: `/v3/projects` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:22.057091 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d86b4d-79bf-419f-9d09-29eaf9f5c5eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:22.066190 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d86b4d-79bf-419f-9d09-29eaf9f5c5eb admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:22.173734 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 867/1721] 10.222.0.36 () {60 vars in 1152 bytes} [Tue May 3 14:13:22 2022] POST /identity/v3/projects => generated 405 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 14:13:22.176491 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fb1ddd-46a5-4f1a-babb-d908780bda63 admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:22.202532 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fb1ddd-46a5-4f1a-babb-d908780bda63 admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:22.426500 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab43eee8-04ec-41bd-bec0-e6223232dd1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:22.428908 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab43eee8-04ec-41bd-bec0-e6223232dd1a admin admin] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:22.429215 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab43eee8-04ec-41bd-bec0-e6223232dd1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:22.429522 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab43eee8-04ec-41bd-bec0-e6223232dd1a admin admin] PATH_INFO: `/v3/users` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:22.432440 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab43eee8-04ec-41bd-bec0-e6223232dd1a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:22.437529 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab43eee8-04ec-41bd-bec0-e6223232dd1a admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:22.496950 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 855/1722] 10.222.0.36 () {60 vars in 1143 bytes} [Tue May 3 14:13:22 2022] POST /identity/v3/users => generated 303 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 14:13:22.502096 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d86b4d-79bf-419f-9d09-29eaf9f5c5eb admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:22.517015 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d86b4d-79bf-419f-9d09-29eaf9f5c5eb admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:22.539002 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363b547e-5b5f-489a-b135-51cb7108f7fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:22.543054 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363b547e-5b5f-489a-b135-51cb7108f7fc admin admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:22.543310 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363b547e-5b5f-489a-b135-51cb7108f7fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:22.543575 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363b547e-5b5f-489a-b135-51cb7108f7fc admin admin] PATH_INFO: `/v3/roles` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:22.549703 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363b547e-5b5f-489a-b135-51cb7108f7fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:22.553248 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363b547e-5b5f-489a-b135-51cb7108f7fc admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:22.585760 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 868/1723] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 3 14:13:22 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 14:13:22.590149 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab43eee8-04ec-41bd-bec0-e6223232dd1a admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:22.610017 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab43eee8-04ec-41bd-bec0-e6223232dd1a admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:22.639337 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5079d7-6360-4ba7-8cf6-034d85b22ebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:22.641116 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5079d7-6360-4ba7-8cf6-034d85b22ebb admin admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:22.646010 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5079d7-6360-4ba7-8cf6-034d85b22ebb admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:22.646576 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5079d7-6360-4ba7-8cf6-034d85b22ebb admin admin] PATH_INFO: `/v3/roles` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:22.647569 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5079d7-6360-4ba7-8cf6-034d85b22ebb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:22.654580 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5079d7-6360-4ba7-8cf6-034d85b22ebb admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:22.685892 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 856/1724] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 3 14:13:22 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 14:13:22.690282 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363b547e-5b5f-489a-b135-51cb7108f7fc admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:22.703907 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363b547e-5b5f-489a-b135-51cb7108f7fc admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:22.721098 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0699dc4-963f-41c2-865d-deaa84a1401c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:22.722093 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0699dc4-963f-41c2-865d-deaa84a1401c admin admin] REQUEST_METHOD: `PUT` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:22.722519 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0699dc4-963f-41c2-865d-deaa84a1401c admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:22.722682 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0699dc4-963f-41c2-865d-deaa84a1401c admin admin] PATH_INFO: `/v3/projects/b93d213e2ffb496a965faffef1768a56/users/a0a71649ac834217a2ec646508adc4c7/roles/441fdc11e95b47f4813f72610e39018b` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:22.773743 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0699dc4-963f-41c2-865d-deaa84a1401c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b93d213e2ffb496a965faffef1768a56, user_id=a0a71649ac834217a2ec646508adc4c7, role_id=441fdc11e95b47f4813f72610e39018b)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:22.787014 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0699dc4-963f-41c2-865d-deaa84a1401c admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:22.831967 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 869/1725] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 3 14:13:22 2022] PUT /identity/v3/projects/b93d213e2ffb496a965faffef1768a56/users/a0a71649ac834217a2ec646508adc4c7/roles/441fdc11e95b47f4813f72610e39018b => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 14:13:22.833482 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64465ed4-8d15-4a81-84a4-a259515dc93b None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:22.834567 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64465ed4-8d15-4a81-84a4-a259515dc93b None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:22.835091 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64465ed4-8d15-4a81-84a4-a259515dc93b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:22.892717 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0699dc4-963f-41c2-865d-deaa84a1401c admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:22.895251 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-d0699dc4-963f-41c2-865d-deaa84a1401c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:13:22.903240 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-64465ed4-8d15-4a81-84a4-a259515dc93b None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:13:22.905221 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-64465ed4-8d15-4a81-84a4-a259515dc93b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:13:23.192722 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0699dc4-963f-41c2-865d-deaa84a1401c admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:23.222477 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 857/1726] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:13:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 390 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 14:13:23.226951 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f68a892-4359-4d37-bed5-bfb41f55a62e None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:23.228489 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1092abc0-2ebc-4cb2-8989-2741ab7862df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:23.229034 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f68a892-4359-4d37-bed5-bfb41f55a62e None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:23.229947 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1092abc0-2ebc-4cb2-8989-2741ab7862df admin admin] REQUEST_METHOD: `DELETE` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:23.231210 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1092abc0-2ebc-4cb2-8989-2741ab7862df admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:23.231589 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1092abc0-2ebc-4cb2-8989-2741ab7862df admin admin] PATH_INFO: `/v3/projects/160cc3d05844420e90b47380a0381e67` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:23.234981 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f68a892-4359-4d37-bed5-bfb41f55a62e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:23.247810 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1092abc0-2ebc-4cb2-8989-2741ab7862df admin admin] RBAC: Authorizing `identity:delete_project(project_id=160cc3d05844420e90b47380a0381e67)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:23.267629 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1092abc0-2ebc-4cb2-8989-2741ab7862df admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:23.341436 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-5f68a892-4359-4d37-bed5-bfb41f55a62e None None] MFA Rules not processed for user `93f81a3015ce4e70a69b5d91c279b37b`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:13:23.342846 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-5f68a892-4359-4d37-bed5-bfb41f55a62e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:13:23.412056 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-1092abc0-2ebc-4cb2-8989-2741ab7862df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '160cc3d05844420e90b47380a0381e67', 'request_id': 'req-1092abc0-2ebc-4cb2-8989-2741ab7862df'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:23.429915 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-1092abc0-2ebc-4cb2-8989-2741ab7862df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '160cc3d05844420e90b47380a0381e67', 'request_id': 'req-1092abc0-2ebc-4cb2-8989-2741ab7862df'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:23.466019 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-1092abc0-2ebc-4cb2-8989-2741ab7862df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '160cc3d05844420e90b47380a0381e67', 'request_id': 'req-1092abc0-2ebc-4cb2-8989-2741ab7862df'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:23.519850 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-1092abc0-2ebc-4cb2-8989-2741ab7862df admin admin] The token cache is being invalidate because project 160cc3d05844420e90b47380a0381e67 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80013) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 14:13:23.520449 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-1092abc0-2ebc-4cb2-8989-2741ab7862df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:23.526293 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-1092abc0-2ebc-4cb2-8989-2741ab7862df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:23.528233 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 870/1727] 10.222.0.36 () {58 vars in 1232 bytes} [Tue May 3 14:13:22 2022] DELETE /identity/v3/projects/160cc3d05844420e90b47380a0381e67 => generated 0 bytes in 636 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 14:13:23.530575 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1092abc0-2ebc-4cb2-8989-2741ab7862df admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:23.540055 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-1092abc0-2ebc-4cb2-8989-2741ab7862df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:13:23.626769 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 858/1728] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:13:23 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 403 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:13:23.630173 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed2af4a-45dc-44da-82ef-9b84b27ecdf6 None None] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:23.630515 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed2af4a-45dc-44da-82ef-9b84b27ecdf6 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:23.630863 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed2af4a-45dc-44da-82ef-9b84b27ecdf6 None None] PATH_INFO: `/` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:23.635515 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 859/1729] 10.222.0.36 () {54 vars in 921 bytes} [Tue May 3 14:13:23 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 14:13:23.640822 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed2af4a-45dc-44da-82ef-9b84b27ecdf6 None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:23.648481 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-5ed2af4a-45dc-44da-82ef-9b84b27ecdf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:13:23.752997 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1092abc0-2ebc-4cb2-8989-2741ab7862df admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:23.763772 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d640914-7cd8-42ef-9e50-0402780470bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '937bea4f355144b4a7ee11baabc3a4cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:23.764562 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d640914-7cd8-42ef-9e50-0402780470bd service neutron] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:23.764862 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d640914-7cd8-42ef-9e50-0402780470bd service neutron] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:23.775040 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d640914-7cd8-42ef-9e50-0402780470bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:23.782986 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-9d640914-7cd8-42ef-9e50-0402780470bd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:13:23.815639 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed2af4a-45dc-44da-82ef-9b84b27ecdf6 None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:23.825247 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8baefc8f-f3d3-45ba-8a4f-f3f3092d6986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:23.826686 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baefc8f-f3d3-45ba-8a4f-f3f3092d6986 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:23.827226 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baefc8f-f3d3-45ba-8a4f-f3f3092d6986 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:23.827725 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baefc8f-f3d3-45ba-8a4f-f3f3092d6986 admin admin] PATH_INFO: `/v3/users/513501326f6c4af798288586b8018857` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:23.831763 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8baefc8f-f3d3-45ba-8a4f-f3f3092d6986 admin admin] RBAC: Authorizing `identity:delete_user(user_id=513501326f6c4af798288586b8018857)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:23.834072 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8baefc8f-f3d3-45ba-8a4f-f3f3092d6986 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:23.849029 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d640914-7cd8-42ef-9e50-0402780470bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:23.850984 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d640914-7cd8-42ef-9e50-0402780470bd service neutron] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:23.925366 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 871/1730] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:13:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 14:13:23.927226 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d640914-7cd8-42ef-9e50-0402780470bd service neutron] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:23.933420 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-9d640914-7cd8-42ef-9e50-0402780470bd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:13:23.938292 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-8baefc8f-f3d3-45ba-8a4f-f3f3092d6986 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '513501326f6c4af798288586b8018857'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:23.959395 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-8baefc8f-f3d3-45ba-8a4f-f3f3092d6986 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '513501326f6c4af798288586b8018857'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:23.960423 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-8baefc8f-f3d3-45ba-8a4f-f3f3092d6986 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '513501326f6c4af798288586b8018857'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:23.986373 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-8baefc8f-f3d3-45ba-8a4f-f3f3092d6986 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '513501326f6c4af798288586b8018857'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:23.987507 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-8baefc8f-f3d3-45ba-8a4f-f3f3092d6986 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '513501326f6c4af798288586b8018857'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:24.016187 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 860/1731] 10.222.0.36 () {58 vars in 1223 bytes} [Tue May 3 14:13:23 2022] DELETE /identity/v3/users/513501326f6c4af798288586b8018857 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:13:24.018507 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4beb4bf-ea87-437c-9bae-abc271218f1e None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:24.018960 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4beb4bf-ea87-437c-9bae-abc271218f1e None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:24.019384 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4beb4bf-ea87-437c-9bae-abc271218f1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:24.066917 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-f4beb4bf-ea87-437c-9bae-abc271218f1e None None] MFA Rules not processed for user `63489e658c094a2598a2ac62159d2fda`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:13:24.068812 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-f4beb4bf-ea87-437c-9bae-abc271218f1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:13:24.230673 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 861/1732] 10.222.0.36 () {58 vars in 1018 bytes} [Tue May 3 14:13:24 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:13:24.622494 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d640914-7cd8-42ef-9e50-0402780470bd service neutron] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:24.655618 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c01684c-eb84-44e9-ba3c-3bc20e086f5c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63489e658c094a2598a2ac62159d2fda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:24.656333 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c01684c-eb84-44e9-ba3c-3bc20e086f5c service nova] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:24.657089 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c01684c-eb84-44e9-ba3c-3bc20e086f5c service nova] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:24.657089 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c01684c-eb84-44e9-ba3c-3bc20e086f5c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:24.671420 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-6c01684c-eb84-44e9-ba3c-3bc20e086f5c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:13:24.880764 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c01684c-eb84-44e9-ba3c-3bc20e086f5c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:24.888745 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c01684c-eb84-44e9-ba3c-3bc20e086f5c service nova] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:24.919105 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 872/1733] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:13:23 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 993 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 14:13:25.524790 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4beb4bf-ea87-437c-9bae-abc271218f1e None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:25.529107 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-f4beb4bf-ea87-437c-9bae-abc271218f1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:13:25.700728 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c01684c-eb84-44e9-ba3c-3bc20e086f5c service nova] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:25.703021 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-6c01684c-eb84-44e9-ba3c-3bc20e086f5c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:13:25.767167 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c01684c-eb84-44e9-ba3c-3bc20e086f5c service nova] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:25.806332 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8ba369-0e37-40b3-860e-a1fef4ea8bb8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63489e658c094a2598a2ac62159d2fda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:25.808257 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8ba369-0e37-40b3-860e-a1fef4ea8bb8 service nova] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:25.809807 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8ba369-0e37-40b3-860e-a1fef4ea8bb8 service nova] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:25.810838 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8ba369-0e37-40b3-860e-a1fef4ea8bb8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:25.862164 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4beb4bf-ea87-437c-9bae-abc271218f1e None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:25.866996 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8ba369-0e37-40b3-860e-a1fef4ea8bb8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:25.870910 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8ba369-0e37-40b3-860e-a1fef4ea8bb8 service nova] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:25.880583 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878df6ed-845e-4952-89a3-f3d4a068536a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:25.882527 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878df6ed-845e-4952-89a3-f3d4a068536a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:25.883143 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878df6ed-845e-4952-89a3-f3d4a068536a admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:25.883743 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878df6ed-845e-4952-89a3-f3d4a068536a admin admin] PATH_INFO: `/v3/projects/f44a0c0337b84fedb428590ee3dbd981` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:25.887418 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878df6ed-845e-4952-89a3-f3d4a068536a admin admin] RBAC: Authorizing `identity:delete_project(project_id=f44a0c0337b84fedb428590ee3dbd981)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:25.893176 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878df6ed-845e-4952-89a3-f3d4a068536a admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:25.934057 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 873/1734] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:13:25 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 03 14:13:26.087920 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f02a1e-ccd0-40f6-a437-4f5c83cc0c51 None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:26.088267 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f02a1e-ccd0-40f6-a437-4f5c83cc0c51 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:26.088622 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f02a1e-ccd0-40f6-a437-4f5c83cc0c51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:26.104185 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-878df6ed-845e-4952-89a3-f3d4a068536a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f44a0c0337b84fedb428590ee3dbd981', 'request_id': 'req-878df6ed-845e-4952-89a3-f3d4a068536a'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:26.137077 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-878df6ed-845e-4952-89a3-f3d4a068536a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f44a0c0337b84fedb428590ee3dbd981', 'request_id': 'req-878df6ed-845e-4952-89a3-f3d4a068536a'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:26.163259 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-878df6ed-845e-4952-89a3-f3d4a068536a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f44a0c0337b84fedb428590ee3dbd981', 'request_id': 'req-878df6ed-845e-4952-89a3-f3d4a068536a'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:26.186142 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-878df6ed-845e-4952-89a3-f3d4a068536a admin admin] The token cache is being invalidate because project f44a0c0337b84fedb428590ee3dbd981 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80012) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 14:13:26.186875 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-878df6ed-845e-4952-89a3-f3d4a068536a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:26.188019 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-878df6ed-845e-4952-89a3-f3d4a068536a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:26.201087 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 862/1735] 10.222.0.36 () {58 vars in 1232 bytes} [Tue May 3 14:13:25 2022] DELETE /identity/v3/projects/f44a0c0337b84fedb428590ee3dbd981 => generated 0 bytes in 677 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:13:26.210394 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0221b72-df4f-4dcb-86da-8793b4d3193c None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:26.215289 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0221b72-df4f-4dcb-86da-8793b4d3193c None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:26.215688 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0221b72-df4f-4dcb-86da-8793b4d3193c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:26.222313 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-38f02a1e-ccd0-40f6-a437-4f5c83cc0c51 None None] MFA Rules not processed for user `38de7546d3524382b4589def32732e6e`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:13:26.227913 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-38f02a1e-ccd0-40f6-a437-4f5c83cc0c51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:13:26.267281 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-d0221b72-df4f-4dcb-86da-8793b4d3193c None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:13:26.268534 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-d0221b72-df4f-4dcb-86da-8793b4d3193c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:13:26.458053 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 863/1736] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:13:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:13:26.461695 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7248a7fc-355c-4760-85f8-e1adb5c9ddcb None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:26.462171 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7248a7fc-355c-4760-85f8-e1adb5c9ddcb None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:26.462460 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7248a7fc-355c-4760-85f8-e1adb5c9ddcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:26.534916 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 874/1737] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:13:26 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 443 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:13:26.561477 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-7248a7fc-355c-4760-85f8-e1adb5c9ddcb None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:13:26.565919 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-7248a7fc-355c-4760-85f8-e1adb5c9ddcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:13:26.603029 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 864/1738] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:13:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:13:26.607341 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f02a1e-ccd0-40f6-a437-4f5c83cc0c51 None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:26.635177 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f02a1e-ccd0-40f6-a437-4f5c83cc0c51 None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:26.661044 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d41b79d-704a-4ce4-8c45-03c5550bd397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:26.661779 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d41b79d-704a-4ce4-8c45-03c5550bd397 admin admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:26.662057 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d41b79d-704a-4ce4-8c45-03c5550bd397 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:26.662329 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d41b79d-704a-4ce4-8c45-03c5550bd397 admin admin] PATH_INFO: `/v3/domains` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:26.666885 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d41b79d-704a-4ce4-8c45-03c5550bd397 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:13:26.667208 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d41b79d-704a-4ce4-8c45-03c5550bd397 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:26.668870 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d41b79d-704a-4ce4-8c45-03c5550bd397 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:26.688635 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7248a7fc-355c-4760-85f8-e1adb5c9ddcb None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:26.690303 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-7248a7fc-355c-4760-85f8-e1adb5c9ddcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:13:26.726895 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 875/1739] 10.222.0.36 () {58 vars in 1152 bytes} [Tue May 3 14:13:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:13:26.726895 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233a3653-8b39-4dc8-8d8f-223ba2763cbb None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:26.726895 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233a3653-8b39-4dc8-8d8f-223ba2763cbb None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:26.727557 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233a3653-8b39-4dc8-8d8f-223ba2763cbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:26.802189 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-233a3653-8b39-4dc8-8d8f-223ba2763cbb None None] MFA Rules not processed for user `b67e152bc8e94244bce87e63c3b33747`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:13:26.807998 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-233a3653-8b39-4dc8-8d8f-223ba2763cbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:13:26.879410 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7248a7fc-355c-4760-85f8-e1adb5c9ddcb None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:26.917015 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd1e024-e09d-4835-97ca-5b6b615ef1a9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63489e658c094a2598a2ac62159d2fda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:26.917887 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd1e024-e09d-4835-97ca-5b6b615ef1a9 service nova] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:26.919183 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd1e024-e09d-4835-97ca-5b6b615ef1a9 service nova] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:26.922472 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd1e024-e09d-4835-97ca-5b6b615ef1a9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:26.974747 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd1e024-e09d-4835-97ca-5b6b615ef1a9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:26.978508 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd1e024-e09d-4835-97ca-5b6b615ef1a9 service nova] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:27.040337 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 865/1740] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:13:26 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 03 14:13:27.041963 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd1e024-e09d-4835-97ca-5b6b615ef1a9 service nova] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:27.095035 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd1e024-e09d-4835-97ca-5b6b615ef1a9 service nova] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:27.127973 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9266ef8-e4d5-4934-a14b-4268baac5740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:27.128786 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9266ef8-e4d5-4934-a14b-4268baac5740 admin admin] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:27.129165 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9266ef8-e4d5-4934-a14b-4268baac5740 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:27.132091 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 876/1741] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:13:26 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 408 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:13:27.138089 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9266ef8-e4d5-4934-a14b-4268baac5740 admin admin] PATH_INFO: `/v3/projects` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:27.138973 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9266ef8-e4d5-4934-a14b-4268baac5740 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:27.145321 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9266ef8-e4d5-4934-a14b-4268baac5740 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:27.255404 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 866/1742] 10.222.0.36 () {60 vars in 1152 bytes} [Tue May 3 14:13:27 2022] POST /identity/v3/projects => generated 363 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 14:13:27.259788 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233a3653-8b39-4dc8-8d8f-223ba2763cbb None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:27.287088 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233a3653-8b39-4dc8-8d8f-223ba2763cbb None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:27.310263 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9266ef8-e4d5-4934-a14b-4268baac5740 admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:27.312157 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-c9266ef8-e4d5-4934-a14b-4268baac5740 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:13:27.550706 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de4acf5-9003-41ff-9318-5f7019af4a15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:27.556605 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de4acf5-9003-41ff-9318-5f7019af4a15 admin admin] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:27.556899 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de4acf5-9003-41ff-9318-5f7019af4a15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:27.570366 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de4acf5-9003-41ff-9318-5f7019af4a15 admin admin] PATH_INFO: `/v3/users` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:27.571379 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de4acf5-9003-41ff-9318-5f7019af4a15 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:27.575119 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de4acf5-9003-41ff-9318-5f7019af4a15 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:27.612946 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9266ef8-e4d5-4934-a14b-4268baac5740 admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:27.620587 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab810893-254d-48d8-be22-53f3ecb0b734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:27.662087 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab810893-254d-48d8-be22-53f3ecb0b734 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:27.662583 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab810893-254d-48d8-be22-53f3ecb0b734 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:27.663005 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab810893-254d-48d8-be22-53f3ecb0b734 admin admin] PATH_INFO: `/v3/projects/b8d5f7f6a4b24de0bea994e4e004082c` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:27.665111 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab810893-254d-48d8-be22-53f3ecb0b734 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8d5f7f6a4b24de0bea994e4e004082c)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:27.667758 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab810893-254d-48d8-be22-53f3ecb0b734 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:27.668095 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 877/1743] 10.222.0.36 () {60 vars in 1143 bytes} [Tue May 3 14:13:27 2022] POST /identity/v3/users => generated 282 bytes in 409 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 14:13:27.672669 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de4acf5-9003-41ff-9318-5f7019af4a15 admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:27.723263 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de4acf5-9003-41ff-9318-5f7019af4a15 admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:27.783752 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-ab810893-254d-48d8-be22-53f3ecb0b734 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8d5f7f6a4b24de0bea994e4e004082c', 'request_id': 'req-ab810893-254d-48d8-be22-53f3ecb0b734'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:27.804654 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-ab810893-254d-48d8-be22-53f3ecb0b734 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8d5f7f6a4b24de0bea994e4e004082c', 'request_id': 'req-ab810893-254d-48d8-be22-53f3ecb0b734'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:27.828584 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-ab810893-254d-48d8-be22-53f3ecb0b734 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8d5f7f6a4b24de0bea994e4e004082c', 'request_id': 'req-ab810893-254d-48d8-be22-53f3ecb0b734'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:27.878907 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-ab810893-254d-48d8-be22-53f3ecb0b734 admin admin] The token cache is being invalidate because project b8d5f7f6a4b24de0bea994e4e004082c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80012) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 14:13:27.879471 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-ab810893-254d-48d8-be22-53f3ecb0b734 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:27.881941 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-ab810893-254d-48d8-be22-53f3ecb0b734 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:27.888447 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 867/1744] 10.222.0.36 () {58 vars in 1232 bytes} [Tue May 3 14:13:27 2022] DELETE /identity/v3/projects/b8d5f7f6a4b24de0bea994e4e004082c => generated 0 bytes in 576 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:13:27.888447 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab810893-254d-48d8-be22-53f3ecb0b734 admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:27.891181 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-ab810893-254d-48d8-be22-53f3ecb0b734 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:13:27.897793 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdff5fd-ec98-47e8-879a-e7b29fb03424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:27.898482 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdff5fd-ec98-47e8-879a-e7b29fb03424 admin admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:27.899779 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdff5fd-ec98-47e8-879a-e7b29fb03424 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:27.900254 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdff5fd-ec98-47e8-879a-e7b29fb03424 admin admin] PATH_INFO: `/v3/roles` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:27.901984 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdff5fd-ec98-47e8-879a-e7b29fb03424 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:27.905413 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdff5fd-ec98-47e8-879a-e7b29fb03424 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:27.924928 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab810893-254d-48d8-be22-53f3ecb0b734 admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:27.932063 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 878/1745] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 3 14:13:27 2022] GET /identity/v3/roles => generated 1420 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 14:13:27.937047 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8ac48a-9598-4d77-98ac-aefd05d00182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:27.939651 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8ac48a-9598-4d77-98ac-aefd05d00182 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:27.940087 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8ac48a-9598-4d77-98ac-aefd05d00182 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:27.940471 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8ac48a-9598-4d77-98ac-aefd05d00182 admin admin] PATH_INFO: `/v3/users/1c979ae89998466c89e40983a4fecf43` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:27.942484 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e758243-a6df-4354-9961-5c44f3486975 None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:27.942749 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e758243-a6df-4354-9961-5c44f3486975 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:27.943035 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e758243-a6df-4354-9961-5c44f3486975 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:27.944196 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8ac48a-9598-4d77-98ac-aefd05d00182 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c979ae89998466c89e40983a4fecf43)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:27.948056 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8ac48a-9598-4d77-98ac-aefd05d00182 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:28.004928 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-6e758243-a6df-4354-9961-5c44f3486975 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:13:28.010504 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-6e758243-a6df-4354-9961-5c44f3486975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:13:28.067367 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 879/1746] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:13:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:13:28.067367 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e758243-a6df-4354-9961-5c44f3486975 None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:28.071151 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-6e758243-a6df-4354-9961-5c44f3486975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:13:28.134093 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e758243-a6df-4354-9961-5c44f3486975 None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:28.161244 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcc85ae-14d9-4af4-865f-4ed1b015b629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:28.168405 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-2e8ac48a-9598-4d77-98ac-aefd05d00182 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c979ae89998466c89e40983a4fecf43'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:28.174553 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcc85ae-14d9-4af4-865f-4ed1b015b629 admin admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:28.175216 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcc85ae-14d9-4af4-865f-4ed1b015b629 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:28.178654 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcc85ae-14d9-4af4-865f-4ed1b015b629 admin admin] PATH_INFO: `/v3/roles` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:28.180652 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcc85ae-14d9-4af4-865f-4ed1b015b629 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:28.194042 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcc85ae-14d9-4af4-865f-4ed1b015b629 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:28.201583 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-2e8ac48a-9598-4d77-98ac-aefd05d00182 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c979ae89998466c89e40983a4fecf43'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:28.202766 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-2e8ac48a-9598-4d77-98ac-aefd05d00182 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c979ae89998466c89e40983a4fecf43'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:28.265502 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 880/1747] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 3 14:13:28 2022] GET /identity/v3/roles => generated 1420 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 14:13:28.269765 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-2e8ac48a-9598-4d77-98ac-aefd05d00182 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c979ae89998466c89e40983a4fecf43'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:28.270110 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b15c33b-c532-4d73-9c38-d733c7f0a85b None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:28.271255 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-2e8ac48a-9598-4d77-98ac-aefd05d00182 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c979ae89998466c89e40983a4fecf43'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:28.271425 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b15c33b-c532-4d73-9c38-d733c7f0a85b None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:28.275086 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b15c33b-c532-4d73-9c38-d733c7f0a85b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:28.305522 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 868/1748] 10.222.0.36 () {58 vars in 1223 bytes} [Tue May 3 14:13:27 2022] DELETE /identity/v3/users/1c979ae89998466c89e40983a4fecf43 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:13:28.306710 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8ac48a-9598-4d77-98ac-aefd05d00182 admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:28.312156 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-2e8ac48a-9598-4d77-98ac-aefd05d00182 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:13:28.376903 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-7b15c33b-c532-4d73-9c38-d733c7f0a85b None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:13:28.389781 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-7b15c33b-c532-4d73-9c38-d733c7f0a85b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:13:28.753416 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8ac48a-9598-4d77-98ac-aefd05d00182 admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:28.792249 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c087cf30-b149-40e4-a7fd-c3c765e892d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:28.796123 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c087cf30-b149-40e4-a7fd-c3c765e892d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:28.796652 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c087cf30-b149-40e4-a7fd-c3c765e892d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:28.797097 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c087cf30-b149-40e4-a7fd-c3c765e892d6 admin admin] PATH_INFO: `/v3/projects/5af14764aeca42479351494fe0b6b2d7/users/f04a64b2d3f143e4a989e914e35a3a5c/roles/441fdc11e95b47f4813f72610e39018b` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:28.822020 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 881/1749] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:13:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 556 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:13:28.824781 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4898a4-d4dd-4c72-a679-672b6bf2f966 None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:28.832380 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4898a4-d4dd-4c72-a679-672b6bf2f966 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:28.832989 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4898a4-d4dd-4c72-a679-672b6bf2f966 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:28.875566 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c087cf30-b149-40e4-a7fd-c3c765e892d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5af14764aeca42479351494fe0b6b2d7, user_id=f04a64b2d3f143e4a989e914e35a3a5c, role_id=441fdc11e95b47f4813f72610e39018b)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:28.878392 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-db4898a4-d4dd-4c72-a679-672b6bf2f966 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:13:28.880742 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-db4898a4-d4dd-4c72-a679-672b6bf2f966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:13:28.891108 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c087cf30-b149-40e4-a7fd-c3c765e892d6 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:28.896068 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 882/1750] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:13:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:13:28.897881 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4898a4-d4dd-4c72-a679-672b6bf2f966 None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:28.917122 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4898a4-d4dd-4c72-a679-672b6bf2f966 None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:28.936805 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 869/1751] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 3 14:13:28 2022] PUT /identity/v3/projects/5af14764aeca42479351494fe0b6b2d7/users/f04a64b2d3f143e4a989e914e35a3a5c/roles/441fdc11e95b47f4813f72610e39018b => generated 0 bytes in 631 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:13:28.957949 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbe1314-66f9-4999-905a-4ea0d6d986b6 None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:28.958491 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbe1314-66f9-4999-905a-4ea0d6d986b6 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:28.959043 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbe1314-66f9-4999-905a-4ea0d6d986b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:29.038721 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-2cbe1314-66f9-4999-905a-4ea0d6d986b6 None None] MFA Rules not processed for user `f04a64b2d3f143e4a989e914e35a3a5c`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:13:29.038926 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-2cbe1314-66f9-4999-905a-4ea0d6d986b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:13:29.143018 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b6a06c-cf05-4c1e-ba54-b261208341ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:29.145227 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b6a06c-cf05-4c1e-ba54-b261208341ea admin admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:29.146973 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b6a06c-cf05-4c1e-ba54-b261208341ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:29.150231 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b6a06c-cf05-4c1e-ba54-b261208341ea admin admin] PATH_INFO: `/v3/domains` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:29.151602 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b6a06c-cf05-4c1e-ba54-b261208341ea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:13:29.152968 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b6a06c-cf05-4c1e-ba54-b261208341ea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:29.180166 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b6a06c-cf05-4c1e-ba54-b261208341ea admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:29.235862 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 883/1752] 10.222.0.36 () {58 vars in 1152 bytes} [Tue May 3 14:13:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:13:29.246188 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b6a06c-cf05-4c1e-ba54-b261208341ea admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:29.292760 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b6a06c-cf05-4c1e-ba54-b261208341ea admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:29.318114 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03943562-ef93-4dd9-8840-5132f8887062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:29.319221 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03943562-ef93-4dd9-8840-5132f8887062 admin admin] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:29.325425 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03943562-ef93-4dd9-8840-5132f8887062 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:29.325809 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03943562-ef93-4dd9-8840-5132f8887062 admin admin] PATH_INFO: `/v3/projects` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:29.329562 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03943562-ef93-4dd9-8840-5132f8887062 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:29.332925 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03943562-ef93-4dd9-8840-5132f8887062 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:29.374479 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 870/1753] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:13:28 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 424 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:13:29.379772 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbe1314-66f9-4999-905a-4ea0d6d986b6 None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:29.383909 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-2cbe1314-66f9-4999-905a-4ea0d6d986b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:13:29.490731 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 884/1754] 10.222.0.36 () {60 vars in 1152 bytes} [Tue May 3 14:13:29 2022] POST /identity/v3/projects => generated 409 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 14:13:29.491774 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03943562-ef93-4dd9-8840-5132f8887062 admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:29.622442 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbe1314-66f9-4999-905a-4ea0d6d986b6 None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:29.708891 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03943562-ef93-4dd9-8840-5132f8887062 admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:29.714535 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09d40cf-20c3-4044-a989-41e469f4e9f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:29.715809 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09d40cf-20c3-4044-a989-41e469f4e9f9 admin admin] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:29.716451 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09d40cf-20c3-4044-a989-41e469f4e9f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:29.716782 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09d40cf-20c3-4044-a989-41e469f4e9f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:29.717848 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09d40cf-20c3-4044-a989-41e469f4e9f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:29.720034 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09d40cf-20c3-4044-a989-41e469f4e9f9 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:29.777974 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 885/1755] 10.222.0.36 () {60 vars in 1152 bytes} [Tue May 3 14:13:29 2022] POST /identity/v3/projects => generated 365 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 14:13:29.779338 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b49babe-d13b-4c50-9d65-a2d1e4bfaec2 None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:29.779624 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b49babe-d13b-4c50-9d65-a2d1e4bfaec2 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:29.780043 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b49babe-d13b-4c50-9d65-a2d1e4bfaec2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:29.805055 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582da0cc-5ac6-4750-89d9-841faa94a68e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '937bea4f355144b4a7ee11baabc3a4cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:29.805829 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582da0cc-5ac6-4750-89d9-841faa94a68e service neutron] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:29.806045 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582da0cc-5ac6-4750-89d9-841faa94a68e service neutron] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:29.806321 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582da0cc-5ac6-4750-89d9-841faa94a68e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:29.822626 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-0b49babe-d13b-4c50-9d65-a2d1e4bfaec2 None None] MFA Rules not processed for user `a0a71649ac834217a2ec646508adc4c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:13:29.824891 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-0b49babe-d13b-4c50-9d65-a2d1e4bfaec2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:13:29.855251 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582da0cc-5ac6-4750-89d9-841faa94a68e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:29.868569 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582da0cc-5ac6-4750-89d9-841faa94a68e service neutron] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:29.914222 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 871/1756] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:13:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 539 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 14:13:29.915294 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582da0cc-5ac6-4750-89d9-841faa94a68e service neutron] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:29.925098 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 886/1757] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:13:29 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:13:29.925979 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b49babe-d13b-4c50-9d65-a2d1e4bfaec2 None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:29.942177 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582da0cc-5ac6-4750-89d9-841faa94a68e service neutron] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:30.020300 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b49babe-d13b-4c50-9d65-a2d1e4bfaec2 None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:30.026938 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f73da84-da7d-4ca8-9085-865b487cf0ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:30.028143 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f73da84-da7d-4ca8-9085-865b487cf0ad admin admin] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:30.028977 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f73da84-da7d-4ca8-9085-865b487cf0ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:30.029519 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f73da84-da7d-4ca8-9085-865b487cf0ad admin admin] PATH_INFO: `/v3/users` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:30.030393 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f73da84-da7d-4ca8-9085-865b487cf0ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:30.033686 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f73da84-da7d-4ca8-9085-865b487cf0ad admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:30.084265 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 887/1758] 10.222.0.36 () {60 vars in 1143 bytes} [Tue May 3 14:13:29 2022] POST /identity/v3/users => generated 289 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 14:13:30.085321 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f73da84-da7d-4ca8-9085-865b487cf0ad admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:30.096043 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-4f73da84-da7d-4ca8-9085-865b487cf0ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:13:30.137341 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f73da84-da7d-4ca8-9085-865b487cf0ad admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:30.148174 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06effb11-fc19-446a-a281-320746e43cbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:30.148934 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06effb11-fc19-446a-a281-320746e43cbe admin admin] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:30.149364 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06effb11-fc19-446a-a281-320746e43cbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:30.149516 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06effb11-fc19-446a-a281-320746e43cbe admin admin] PATH_INFO: `/v3/users` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:30.150148 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06effb11-fc19-446a-a281-320746e43cbe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:30.151053 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac5d239-6bc3-465a-9f63-e378f0d1735d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:30.151732 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac5d239-6bc3-465a-9f63-e378f0d1735d admin admin] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:30.152044 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac5d239-6bc3-465a-9f63-e378f0d1735d admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:30.152140 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06effb11-fc19-446a-a281-320746e43cbe admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:30.152322 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac5d239-6bc3-465a-9f63-e378f0d1735d admin admin] PATH_INFO: `/v3/projects` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:30.153071 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac5d239-6bc3-465a-9f63-e378f0d1735d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:30.155160 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac5d239-6bc3-465a-9f63-e378f0d1735d admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:30.196724 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 872/1759] 10.222.0.36 () {60 vars in 1143 bytes} [Tue May 3 14:13:29 2022] POST /identity/v3/users => generated 305 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 14:13:30.198226 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45d1536-acfe-45d5-8703-e15923d50773 None None] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:30.198516 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45d1536-acfe-45d5-8703-e15923d50773 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:30.198820 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45d1536-acfe-45d5-8703-e15923d50773 None None] PATH_INFO: `/` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:30.210221 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 873/1760] 10.222.0.36 () {54 vars in 912 bytes} [Tue May 3 14:13:30 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 14:13:30.210982 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45d1536-acfe-45d5-8703-e15923d50773 None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:30.236618 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 888/1761] 10.222.0.36 () {60 vars in 1152 bytes} [Tue May 3 14:13:30 2022] POST /identity/v3/projects => generated 403 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 14:13:30.237756 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac5d239-6bc3-465a-9f63-e378f0d1735d admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:30.239925 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45d1536-acfe-45d5-8703-e15923d50773 None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:30.372557 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bfc32e-2673-4045-8c18-ac9d6feee2fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:30.373249 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bfc32e-2673-4045-8c18-ac9d6feee2fa admin admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:30.373542 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bfc32e-2673-4045-8c18-ac9d6feee2fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:30.374008 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bfc32e-2673-4045-8c18-ac9d6feee2fa admin admin] PATH_INFO: `/v3/roles` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:30.375304 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bfc32e-2673-4045-8c18-ac9d6feee2fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:30.376402 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bfc32e-2673-4045-8c18-ac9d6feee2fa admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:30.396866 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 874/1762] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 3 14:13:30 2022] GET /identity/v3/roles => generated 1420 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 14:13:30.402795 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5594978-c92a-4d45-856d-b39eeda76af2 None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:30.403149 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5594978-c92a-4d45-856d-b39eeda76af2 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:30.403378 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5594978-c92a-4d45-856d-b39eeda76af2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:30.415359 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac5d239-6bc3-465a-9f63-e378f0d1735d admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:30.434809 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e5ff6c-09ac-4736-910c-35951e3ecf02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:30.438374 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e5ff6c-09ac-4736-910c-35951e3ecf02 admin admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:30.438764 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e5ff6c-09ac-4736-910c-35951e3ecf02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:30.439013 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e5ff6c-09ac-4736-910c-35951e3ecf02 admin admin] PATH_INFO: `/v3/roles` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:30.439834 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e5ff6c-09ac-4736-910c-35951e3ecf02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:30.441770 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-c5594978-c92a-4d45-856d-b39eeda76af2 None None] MFA Rules not processed for user `937bea4f355144b4a7ee11baabc3a4cb`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:13:30.443716 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e5ff6c-09ac-4736-910c-35951e3ecf02 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:30.446055 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-c5594978-c92a-4d45-856d-b39eeda76af2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:13:30.466976 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 889/1763] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 3 14:13:30 2022] GET /identity/v3/roles => generated 1420 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 14:13:30.470919 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e5ff6c-09ac-4736-910c-35951e3ecf02 admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:30.495134 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e5ff6c-09ac-4736-910c-35951e3ecf02 admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:30.512242 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df51460-be21-42ee-9f6f-6d90aeac0ddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:30.514683 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df51460-be21-42ee-9f6f-6d90aeac0ddb admin admin] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:30.517090 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df51460-be21-42ee-9f6f-6d90aeac0ddb admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:30.518006 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df51460-be21-42ee-9f6f-6d90aeac0ddb admin admin] PATH_INFO: `/v3/users` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:30.519347 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df51460-be21-42ee-9f6f-6d90aeac0ddb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:30.522982 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df51460-be21-42ee-9f6f-6d90aeac0ddb admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:30.561553 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 875/1764] 10.222.0.36 () {58 vars in 1009 bytes} [Tue May 3 14:13:30 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:13:30.562799 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5594978-c92a-4d45-856d-b39eeda76af2 None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:30.582318 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 890/1765] 10.222.0.36 () {60 vars in 1143 bytes} [Tue May 3 14:13:30 2022] POST /identity/v3/users => generated 308 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 14:13:30.583902 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df51460-be21-42ee-9f6f-6d90aeac0ddb admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:30.593105 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5594978-c92a-4d45-856d-b39eeda76af2 None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:30.600479 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df51460-be21-42ee-9f6f-6d90aeac0ddb admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:30.608528 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f34e927-e2d2-43b4-ac71-d1aa8d2a777f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:30.608801 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecb9292-e688-4f91-9705-a5b5b166163b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:30.609722 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f34e927-e2d2-43b4-ac71-d1aa8d2a777f admin admin] REQUEST_METHOD: `PUT` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:30.609932 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecb9292-e688-4f91-9705-a5b5b166163b admin admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:30.610036 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f34e927-e2d2-43b4-ac71-d1aa8d2a777f admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:30.610311 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f34e927-e2d2-43b4-ac71-d1aa8d2a777f admin admin] PATH_INFO: `/v3/projects/2ccaaf97c1ab483aa94af8ca0aa44e1e/users/05f27e4360844319b639f9058c8feb6b/roles/36abe9b50fd8479c86c4f8f70fd85aa3` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:30.610845 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecb9292-e688-4f91-9705-a5b5b166163b admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:30.611473 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecb9292-e688-4f91-9705-a5b5b166163b admin admin] PATH_INFO: `/v3/roles` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:30.612678 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecb9292-e688-4f91-9705-a5b5b166163b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:30.629555 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecb9292-e688-4f91-9705-a5b5b166163b admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:30.646748 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f34e927-e2d2-43b4-ac71-d1aa8d2a777f admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ccaaf97c1ab483aa94af8ca0aa44e1e, user_id=05f27e4360844319b639f9058c8feb6b, role_id=36abe9b50fd8479c86c4f8f70fd85aa3)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:30.649507 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f34e927-e2d2-43b4-ac71-d1aa8d2a777f admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:30.652972 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 891/1766] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 3 14:13:30 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 14:13:30.654128 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecb9292-e688-4f91-9705-a5b5b166163b admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:30.669226 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecb9292-e688-4f91-9705-a5b5b166163b admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:30.678543 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd04648e-72a4-48e4-8deb-3986d2996979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:30.679761 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd04648e-72a4-48e4-8deb-3986d2996979 admin admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:30.680637 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 876/1767] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 3 14:13:30 2022] PUT /identity/v3/projects/2ccaaf97c1ab483aa94af8ca0aa44e1e/users/05f27e4360844319b639f9058c8feb6b/roles/36abe9b50fd8479c86c4f8f70fd85aa3 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:13:30.680763 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd04648e-72a4-48e4-8deb-3986d2996979 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:30.681264 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd04648e-72a4-48e4-8deb-3986d2996979 admin admin] PATH_INFO: `/v3/roles` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:30.682558 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd04648e-72a4-48e4-8deb-3986d2996979 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:30.685656 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd04648e-72a4-48e4-8deb-3986d2996979 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:30.689481 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f34e927-e2d2-43b4-ac71-d1aa8d2a777f admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:30.705257 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 892/1768] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 3 14:13:30 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 14:13:30.707001 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd04648e-72a4-48e4-8deb-3986d2996979 admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:30.727486 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd04648e-72a4-48e4-8deb-3986d2996979 admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:30.822208 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f34e927-e2d2-43b4-ac71-d1aa8d2a777f admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:30.831959 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ffc818-e902-4851-a298-76adcd32fb56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '937bea4f355144b4a7ee11baabc3a4cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:30.832933 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ffc818-e902-4851-a298-76adcd32fb56 service neutron] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:30.833387 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ffc818-e902-4851-a298-76adcd32fb56 service neutron] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:30.836825 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ffc818-e902-4851-a298-76adcd32fb56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:30.853655 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ffc818-e902-4851-a298-76adcd32fb56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:30.855505 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ffc818-e902-4851-a298-76adcd32fb56 service neutron] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:30.875874 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 877/1769] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:13:30 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 14:13:30.877164 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ffc818-e902-4851-a298-76adcd32fb56 service neutron] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:30.902336 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d75dd5-d755-4f5a-903f-2600012e98be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:30.906789 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d75dd5-d755-4f5a-903f-2600012e98be admin admin] REQUEST_METHOD: `PUT` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:30.907210 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d75dd5-d755-4f5a-903f-2600012e98be admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:30.907794 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d75dd5-d755-4f5a-903f-2600012e98be admin admin] PATH_INFO: `/v3/projects/92a459fde9a64e15836f3d5f781af46c/users/67ab8927d0e144ebb147ab9e3039f28d/roles/441fdc11e95b47f4813f72610e39018b` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:30.969703 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d75dd5-d755-4f5a-903f-2600012e98be admin admin] RBAC: Authorizing `identity:create_grant(project_id=92a459fde9a64e15836f3d5f781af46c, user_id=67ab8927d0e144ebb147ab9e3039f28d, role_id=441fdc11e95b47f4813f72610e39018b)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:30.976341 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d75dd5-d755-4f5a-903f-2600012e98be admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:31.019513 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 893/1770] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 3 14:13:30 2022] PUT /identity/v3/projects/92a459fde9a64e15836f3d5f781af46c/users/67ab8927d0e144ebb147ab9e3039f28d/roles/441fdc11e95b47f4813f72610e39018b => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:13:31.020815 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d75dd5-d755-4f5a-903f-2600012e98be admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:31.081319 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ffc818-e902-4851-a298-76adcd32fb56 service neutron] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:31.173727 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d75dd5-d755-4f5a-903f-2600012e98be admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:31.185997 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a883bc6f-bfc3-456b-b50a-f2ecde9f958f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:31.187515 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a883bc6f-bfc3-456b-b50a-f2ecde9f958f admin admin] REQUEST_METHOD: `PUT` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:31.187783 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a883bc6f-bfc3-456b-b50a-f2ecde9f958f admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:31.188139 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a883bc6f-bfc3-456b-b50a-f2ecde9f958f admin admin] PATH_INFO: `/v3/projects/ca6136bae53743bfa63d54a58ed8abb9/users/a0bcadd57a774b74bf569892be098d9a/roles/36abe9b50fd8479c86c4f8f70fd85aa3` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:31.205024 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06323bf8-2183-49bc-9194-a4c32bdd2c14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:31.206919 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06323bf8-2183-49bc-9194-a4c32bdd2c14 admin admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:31.208187 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06323bf8-2183-49bc-9194-a4c32bdd2c14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:31.209274 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06323bf8-2183-49bc-9194-a4c32bdd2c14 admin admin] PATH_INFO: `/v3/roles` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:31.210959 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06323bf8-2183-49bc-9194-a4c32bdd2c14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:31.213229 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06323bf8-2183-49bc-9194-a4c32bdd2c14 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:31.233440 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a883bc6f-bfc3-456b-b50a-f2ecde9f958f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca6136bae53743bfa63d54a58ed8abb9, user_id=a0bcadd57a774b74bf569892be098d9a, role_id=36abe9b50fd8479c86c4f8f70fd85aa3)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:31.236397 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 878/1771] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 3 14:13:30 2022] GET /identity/v3/roles => generated 1420 bytes in 360 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 14:13:31.241708 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d316c579-fabd-49c2-a409-b8522d76a91b None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:31.242205 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d316c579-fabd-49c2-a409-b8522d76a91b None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:31.242779 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d316c579-fabd-49c2-a409-b8522d76a91b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:31.249199 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a883bc6f-bfc3-456b-b50a-f2ecde9f958f admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:31.281982 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-d316c579-fabd-49c2-a409-b8522d76a91b None None] MFA Rules not processed for user `67ab8927d0e144ebb147ab9e3039f28d`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:13:31.284258 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-d316c579-fabd-49c2-a409-b8522d76a91b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:13:31.298262 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 894/1772] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 3 14:13:31 2022] PUT /identity/v3/projects/ca6136bae53743bfa63d54a58ed8abb9/users/a0bcadd57a774b74bf569892be098d9a/roles/36abe9b50fd8479c86c4f8f70fd85aa3 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:13:31.301412 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a883bc6f-bfc3-456b-b50a-f2ecde9f958f admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:31.390374 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 879/1773] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:13:31 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:13:31.391400 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d316c579-fabd-49c2-a409-b8522d76a91b None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:31.474596 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a883bc6f-bfc3-456b-b50a-f2ecde9f958f admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:31.481089 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6884dde-0f60-45c4-bd46-81556b0345e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:31.490179 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6884dde-0f60-45c4-bd46-81556b0345e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:31.490832 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6884dde-0f60-45c4-bd46-81556b0345e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:31.491362 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6884dde-0f60-45c4-bd46-81556b0345e8 admin admin] PATH_INFO: `/v3/projects/2ccaaf97c1ab483aa94af8ca0aa44e1e/users/05f27e4360844319b639f9058c8feb6b/roles/36abe9b50fd8479c86c4f8f70fd85aa3` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:31.496513 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6884dde-0f60-45c4-bd46-81556b0345e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ccaaf97c1ab483aa94af8ca0aa44e1e, user_id=05f27e4360844319b639f9058c8feb6b, role_id=36abe9b50fd8479c86c4f8f70fd85aa3)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:31.503069 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6884dde-0f60-45c4-bd46-81556b0345e8 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:31.535659 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 895/1774] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 3 14:13:31 2022] PUT /identity/v3/projects/2ccaaf97c1ab483aa94af8ca0aa44e1e/users/05f27e4360844319b639f9058c8feb6b/roles/36abe9b50fd8479c86c4f8f70fd85aa3 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:13:31.537315 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6884dde-0f60-45c4-bd46-81556b0345e8 admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:31.558567 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d316c579-fabd-49c2-a409-b8522d76a91b None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:31.693158 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6884dde-0f60-45c4-bd46-81556b0345e8 admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:31.699073 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00edd14e-aec7-4410-bfa3-6d598471a53e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:31.699972 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00edd14e-aec7-4410-bfa3-6d598471a53e admin admin] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:31.700676 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00edd14e-aec7-4410-bfa3-6d598471a53e admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:31.701418 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00edd14e-aec7-4410-bfa3-6d598471a53e admin admin] PATH_INFO: `/v3/projects` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:31.702366 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00edd14e-aec7-4410-bfa3-6d598471a53e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:31.705000 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00edd14e-aec7-4410-bfa3-6d598471a53e admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:31.718037 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac7b6fe-8734-4c76-84fc-c24ac2e2dac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:31.718880 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac7b6fe-8734-4c76-84fc-c24ac2e2dac4 admin admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:31.719169 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac7b6fe-8734-4c76-84fc-c24ac2e2dac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:31.719446 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac7b6fe-8734-4c76-84fc-c24ac2e2dac4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:31.720407 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac7b6fe-8734-4c76-84fc-c24ac2e2dac4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:31.726246 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac7b6fe-8734-4c76-84fc-c24ac2e2dac4 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:31.752998 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 880/1775] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 3 14:13:31 2022] GET /identity/v3/roles => generated 1420 bytes in 362 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 14:13:31.754504 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3ab5c4-f0b2-48a3-930f-ddac4757766d None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:31.754789 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3ab5c4-f0b2-48a3-930f-ddac4757766d None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:31.755228 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3ab5c4-f0b2-48a3-930f-ddac4757766d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:31.769090 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 896/1776] 10.222.0.36 () {60 vars in 1152 bytes} [Tue May 3 14:13:31 2022] POST /identity/v3/projects => generated 409 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 14:13:31.772651 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00edd14e-aec7-4410-bfa3-6d598471a53e admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:31.821714 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-ee3ab5c4-f0b2-48a3-930f-ddac4757766d None None] MFA Rules not processed for user `05f27e4360844319b639f9058c8feb6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:13:31.823148 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-ee3ab5c4-f0b2-48a3-930f-ddac4757766d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:13:31.914315 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00edd14e-aec7-4410-bfa3-6d598471a53e admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:31.922559 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1c2dab-9fee-45bb-86a1-086c9133f8ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:31.924123 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1c2dab-9fee-45bb-86a1-086c9133f8ba admin admin] REQUEST_METHOD: `PUT` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:31.924652 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1c2dab-9fee-45bb-86a1-086c9133f8ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:31.925412 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1c2dab-9fee-45bb-86a1-086c9133f8ba admin admin] PATH_INFO: `/v3/projects/ca6136bae53743bfa63d54a58ed8abb9/users/a0bcadd57a774b74bf569892be098d9a/roles/36abe9b50fd8479c86c4f8f70fd85aa3` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:31.928453 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1c2dab-9fee-45bb-86a1-086c9133f8ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca6136bae53743bfa63d54a58ed8abb9, user_id=a0bcadd57a774b74bf569892be098d9a, role_id=36abe9b50fd8479c86c4f8f70fd85aa3)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:31.932395 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1c2dab-9fee-45bb-86a1-086c9133f8ba admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:31.962424 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 897/1777] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 3 14:13:31 2022] PUT /identity/v3/projects/ca6136bae53743bfa63d54a58ed8abb9/users/a0bcadd57a774b74bf569892be098d9a/roles/36abe9b50fd8479c86c4f8f70fd85aa3 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:13:31.964010 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1c2dab-9fee-45bb-86a1-086c9133f8ba admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:31.986150 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 881/1778] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:13:31 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:13:32.004248 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3ab5c4-f0b2-48a3-930f-ddac4757766d None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:32.008733 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-ee3ab5c4-f0b2-48a3-930f-ddac4757766d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:13:32.152659 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1c2dab-9fee-45bb-86a1-086c9133f8ba admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:32.165189 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f540eb2-078d-4f6b-9cc8-78d542da66db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:32.165941 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f540eb2-078d-4f6b-9cc8-78d542da66db admin admin] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:32.166218 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f540eb2-078d-4f6b-9cc8-78d542da66db admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:32.166489 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f540eb2-078d-4f6b-9cc8-78d542da66db admin admin] PATH_INFO: `/v3/users` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:32.171066 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3ab5c4-f0b2-48a3-930f-ddac4757766d None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:32.174168 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f540eb2-078d-4f6b-9cc8-78d542da66db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:32.176782 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f540eb2-078d-4f6b-9cc8-78d542da66db admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:32.221889 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 898/1779] 10.222.0.36 () {60 vars in 1143 bytes} [Tue May 3 14:13:31 2022] POST /identity/v3/users => generated 311 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 14:13:32.223190 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6410d60-59ec-49dc-9bd2-f41001fb681b None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:32.223482 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6410d60-59ec-49dc-9bd2-f41001fb681b None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:32.223759 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6410d60-59ec-49dc-9bd2-f41001fb681b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:32.274265 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-c6410d60-59ec-49dc-9bd2-f41001fb681b None None] MFA Rules not processed for user `93f81a3015ce4e70a69b5d91c279b37b`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:13:32.278411 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-c6410d60-59ec-49dc-9bd2-f41001fb681b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:13:32.308862 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c51095-a4f0-491f-b060-406d5e3379a9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b014f4c7ba1414cb8a597f5bc4033f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:32.309551 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c51095-a4f0-491f-b060-406d5e3379a9 service cinder] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:32.309836 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c51095-a4f0-491f-b060-406d5e3379a9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:32.310110 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c51095-a4f0-491f-b060-406d5e3379a9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:32.445169 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c51095-a4f0-491f-b060-406d5e3379a9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:32.452522 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c51095-a4f0-491f-b060-406d5e3379a9 service cinder] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:32.465414 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 899/1780] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:13:32 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:13:32.465414 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6410d60-59ec-49dc-9bd2-f41001fb681b None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:32.467653 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 882/1781] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:13:32 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 14:13:32.576198 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c51095-a4f0-491f-b060-406d5e3379a9 service cinder] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:32.578514 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-e0c51095-a4f0-491f-b060-406d5e3379a9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:13:32.596503 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6410d60-59ec-49dc-9bd2-f41001fb681b None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:32.604977 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c51095-a4f0-491f-b060-406d5e3379a9 service cinder] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:32.615631 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c1105f-4656-4d87-9e3f-dc8397430cd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:32.616415 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c1105f-4656-4d87-9e3f-dc8397430cd8 admin admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:32.616696 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c1105f-4656-4d87-9e3f-dc8397430cd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:32.616968 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c1105f-4656-4d87-9e3f-dc8397430cd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:32.617665 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f94ead-a038-4bd9-b209-b78392f82fa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:32.618561 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f94ead-a038-4bd9-b209-b78392f82fa3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:32.618845 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f94ead-a038-4bd9-b209-b78392f82fa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:32.619123 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f94ead-a038-4bd9-b209-b78392f82fa3 admin admin] PATH_INFO: `/v3/projects/d913f57aed9b45eb8357bd86e534a5c1` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:32.622680 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f94ead-a038-4bd9-b209-b78392f82fa3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d913f57aed9b45eb8357bd86e534a5c1)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:32.628884 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f94ead-a038-4bd9-b209-b78392f82fa3 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:32.664506 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c1105f-4656-4d87-9e3f-dc8397430cd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:32.680166 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c1105f-4656-4d87-9e3f-dc8397430cd8 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:32.738262 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-82f94ead-a038-4bd9-b209-b78392f82fa3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd913f57aed9b45eb8357bd86e534a5c1', 'request_id': 'req-82f94ead-a038-4bd9-b209-b78392f82fa3'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:32.751479 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-82f94ead-a038-4bd9-b209-b78392f82fa3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd913f57aed9b45eb8357bd86e534a5c1', 'request_id': 'req-82f94ead-a038-4bd9-b209-b78392f82fa3'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:32.753641 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 900/1782] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 3 14:13:32 2022] GET /identity/v3/roles => generated 1420 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 14:13:32.758856 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c1105f-4656-4d87-9e3f-dc8397430cd8 admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:32.770948 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-82f94ead-a038-4bd9-b209-b78392f82fa3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd913f57aed9b45eb8357bd86e534a5c1', 'request_id': 'req-82f94ead-a038-4bd9-b209-b78392f82fa3'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:32.800481 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-82f94ead-a038-4bd9-b209-b78392f82fa3 admin admin] The token cache is being invalidate because project d913f57aed9b45eb8357bd86e534a5c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80012) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 14:13:32.800780 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-82f94ead-a038-4bd9-b209-b78392f82fa3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:32.801633 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-82f94ead-a038-4bd9-b209-b78392f82fa3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:32.803714 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 883/1783] 10.222.0.36 () {58 vars in 1232 bytes} [Tue May 3 14:13:32 2022] DELETE /identity/v3/projects/d913f57aed9b45eb8357bd86e534a5c1 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 14:13:32.808426 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f94ead-a038-4bd9-b209-b78392f82fa3 admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:32.812766 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-82f94ead-a038-4bd9-b209-b78392f82fa3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:13:32.823385 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c1105f-4656-4d87-9e3f-dc8397430cd8 admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:33.015868 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f94ead-a038-4bd9-b209-b78392f82fa3 admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:33.023855 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59269bd6-981a-402d-ab15-627f5cad7905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:33.025732 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59269bd6-981a-402d-ab15-627f5cad7905 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:33.026014 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59269bd6-981a-402d-ab15-627f5cad7905 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:33.026290 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59269bd6-981a-402d-ab15-627f5cad7905 admin admin] PATH_INFO: `/v3/users/10bb7dc29b1149b8b72f16c10d4b605b` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:33.029459 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59269bd6-981a-402d-ab15-627f5cad7905 admin admin] RBAC: Authorizing `identity:delete_user(user_id=10bb7dc29b1149b8b72f16c10d4b605b)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:33.032876 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59269bd6-981a-402d-ab15-627f5cad7905 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:33.104102 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a2198b-2811-410f-8667-32614689f3e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:33.105320 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a2198b-2811-410f-8667-32614689f3e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:33.105320 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a2198b-2811-410f-8667-32614689f3e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:33.105681 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a2198b-2811-410f-8667-32614689f3e4 admin admin] PATH_INFO: `/v3/projects/c4b84e786368422b8ad5abf54f8951ea/users/1c26a964ca614634ab42054d8bcf0637/roles/36abe9b50fd8479c86c4f8f70fd85aa3` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:33.128363 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-59269bd6-981a-402d-ab15-627f5cad7905 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10bb7dc29b1149b8b72f16c10d4b605b'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:33.137781 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-59269bd6-981a-402d-ab15-627f5cad7905 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10bb7dc29b1149b8b72f16c10d4b605b'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:33.138571 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-59269bd6-981a-402d-ab15-627f5cad7905 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10bb7dc29b1149b8b72f16c10d4b605b'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:33.153490 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a2198b-2811-410f-8667-32614689f3e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4b84e786368422b8ad5abf54f8951ea, user_id=1c26a964ca614634ab42054d8bcf0637, role_id=36abe9b50fd8479c86c4f8f70fd85aa3)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:33.158650 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a2198b-2811-410f-8667-32614689f3e4 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:33.172861 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-59269bd6-981a-402d-ab15-627f5cad7905 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10bb7dc29b1149b8b72f16c10d4b605b'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:33.175543 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-59269bd6-981a-402d-ab15-627f5cad7905 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10bb7dc29b1149b8b72f16c10d4b605b'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:33.196418 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 901/1784] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 3 14:13:32 2022] PUT /identity/v3/projects/c4b84e786368422b8ad5abf54f8951ea/users/1c26a964ca614634ab42054d8bcf0637/roles/36abe9b50fd8479c86c4f8f70fd85aa3 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:13:33.197833 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a2198b-2811-410f-8667-32614689f3e4 admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:33.221439 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-87a2198b-2811-410f-8667-32614689f3e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:13:33.225047 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 884/1785] 10.222.0.36 () {58 vars in 1223 bytes} [Tue May 3 14:13:32 2022] DELETE /identity/v3/users/10bb7dc29b1149b8b72f16c10d4b605b => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:13:33.347022 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a2198b-2811-410f-8667-32614689f3e4 admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:33.431413 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca131b55-9f38-441e-ba6e-e399ce5cfe0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:33.432186 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca131b55-9f38-441e-ba6e-e399ce5cfe0f admin admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:33.432532 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca131b55-9f38-441e-ba6e-e399ce5cfe0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:33.432875 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca131b55-9f38-441e-ba6e-e399ce5cfe0f admin admin] PATH_INFO: `/v3/roles` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:33.433728 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca131b55-9f38-441e-ba6e-e399ce5cfe0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:33.435532 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca131b55-9f38-441e-ba6e-e399ce5cfe0f admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:33.449688 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 902/1786] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 3 14:13:33 2022] GET /identity/v3/roles => generated 1420 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 14:13:33.454157 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59269bd6-981a-402d-ab15-627f5cad7905 admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:33.469592 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59269bd6-981a-402d-ab15-627f5cad7905 admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:33.491461 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dec6c1-3ce2-4a53-a738-f863ac5821ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:33.493193 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dec6c1-3ce2-4a53-a738-f863ac5821ee admin admin] REQUEST_METHOD: `PUT` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:33.493988 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dec6c1-3ce2-4a53-a738-f863ac5821ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:33.495503 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dec6c1-3ce2-4a53-a738-f863ac5821ee admin admin] PATH_INFO: `/v3/projects/c4b84e786368422b8ad5abf54f8951ea/users/1c26a964ca614634ab42054d8bcf0637/roles/36abe9b50fd8479c86c4f8f70fd85aa3` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:33.501925 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dec6c1-3ce2-4a53-a738-f863ac5821ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4b84e786368422b8ad5abf54f8951ea, user_id=1c26a964ca614634ab42054d8bcf0637, role_id=36abe9b50fd8479c86c4f8f70fd85aa3)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:33.505022 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dec6c1-3ce2-4a53-a738-f863ac5821ee admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:33.538993 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afda301-a3fa-48ec-a3e8-d4e6b9effb3a None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:33.539497 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afda301-a3fa-48ec-a3e8-d4e6b9effb3a None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:33.540184 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afda301-a3fa-48ec-a3e8-d4e6b9effb3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:33.555515 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 885/1787] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 3 14:13:33 2022] PUT /identity/v3/projects/c4b84e786368422b8ad5abf54f8951ea/users/1c26a964ca614634ab42054d8bcf0637/roles/36abe9b50fd8479c86c4f8f70fd85aa3 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:13:33.559523 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dec6c1-3ce2-4a53-a738-f863ac5821ee admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:33.565837 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-69dec6c1-3ce2-4a53-a738-f863ac5821ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:13:33.607519 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-2afda301-a3fa-48ec-a3e8-d4e6b9effb3a None None] MFA Rules not processed for user `1c26a964ca614634ab42054d8bcf0637`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:13:33.608812 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-2afda301-a3fa-48ec-a3e8-d4e6b9effb3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:13:33.695359 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dec6c1-3ce2-4a53-a738-f863ac5821ee admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:33.703862 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9c5c54-8dc9-4033-bdac-cbce69b60cd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:33.705277 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9c5c54-8dc9-4033-bdac-cbce69b60cd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:33.705630 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9c5c54-8dc9-4033-bdac-cbce69b60cd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:33.705884 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9c5c54-8dc9-4033-bdac-cbce69b60cd0 admin admin] PATH_INFO: `/v3/users/f04a64b2d3f143e4a989e914e35a3a5c` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:33.707192 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9c5c54-8dc9-4033-bdac-cbce69b60cd0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f04a64b2d3f143e4a989e914e35a3a5c)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:33.709580 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9c5c54-8dc9-4033-bdac-cbce69b60cd0 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:33.806404 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-6c9c5c54-8dc9-4033-bdac-cbce69b60cd0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f04a64b2d3f143e4a989e914e35a3a5c'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:33.815930 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-6c9c5c54-8dc9-4033-bdac-cbce69b60cd0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f04a64b2d3f143e4a989e914e35a3a5c'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:33.817575 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-6c9c5c54-8dc9-4033-bdac-cbce69b60cd0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f04a64b2d3f143e4a989e914e35a3a5c'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:33.818899 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 903/1788] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:13:33 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:13:33.856619 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afda301-a3fa-48ec-a3e8-d4e6b9effb3a None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:33.859253 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-2afda301-a3fa-48ec-a3e8-d4e6b9effb3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:13:33.872238 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-6c9c5c54-8dc9-4033-bdac-cbce69b60cd0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f04a64b2d3f143e4a989e914e35a3a5c'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:33.872999 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-6c9c5c54-8dc9-4033-bdac-cbce69b60cd0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f04a64b2d3f143e4a989e914e35a3a5c'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:33.897669 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 886/1789] 10.222.0.36 () {58 vars in 1223 bytes} [Tue May 3 14:13:33 2022] DELETE /identity/v3/users/f04a64b2d3f143e4a989e914e35a3a5c => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:13:33.902395 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49b1ce0-f664-46df-9c59-00e2a0ad9526 None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:33.902687 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49b1ce0-f664-46df-9c59-00e2a0ad9526 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:33.903012 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49b1ce0-f664-46df-9c59-00e2a0ad9526 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:33.969928 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-f49b1ce0-f664-46df-9c59-00e2a0ad9526 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:13:33.976563 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-f49b1ce0-f664-46df-9c59-00e2a0ad9526 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:13:34.089653 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afda301-a3fa-48ec-a3e8-d4e6b9effb3a None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:34.143257 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 887/1790] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:13:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:13:34.173160 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49b1ce0-f664-46df-9c59-00e2a0ad9526 None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:34.174863 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-f49b1ce0-f664-46df-9c59-00e2a0ad9526 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:13:34.210810 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7948f370-3449-437c-b93b-85875498bbf5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b014f4c7ba1414cb8a597f5bc4033f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:34.213208 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7948f370-3449-437c-b93b-85875498bbf5 service cinder] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:34.213794 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7948f370-3449-437c-b93b-85875498bbf5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:34.214493 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7948f370-3449-437c-b93b-85875498bbf5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:34.217682 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-7948f370-3449-437c-b93b-85875498bbf5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:13:34.335267 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7948f370-3449-437c-b93b-85875498bbf5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:34.341560 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7948f370-3449-437c-b93b-85875498bbf5 service cinder] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:34.373420 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 904/1791] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:13:33 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 517 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 14:13:34.399229 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49b1ce0-f664-46df-9c59-00e2a0ad9526 None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:34.411650 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecedf104-61b9-4b28-bb7b-41415de431de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '937bea4f355144b4a7ee11baabc3a4cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:34.413070 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecedf104-61b9-4b28-bb7b-41415de431de service neutron] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:34.413788 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecedf104-61b9-4b28-bb7b-41415de431de service neutron] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:34.416478 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecedf104-61b9-4b28-bb7b-41415de431de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:34.456452 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecedf104-61b9-4b28-bb7b-41415de431de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:34.461587 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecedf104-61b9-4b28-bb7b-41415de431de service neutron] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:34.490103 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 888/1792] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:13:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 03 14:13:34.710582 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7948f370-3449-437c-b93b-85875498bbf5 service cinder] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:34.712738 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-7948f370-3449-437c-b93b-85875498bbf5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:13:34.725194 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7948f370-3449-437c-b93b-85875498bbf5 service cinder] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:34.736048 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f99e7b-09be-46ac-a409-79207ce422a6 None None] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:34.736334 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f99e7b-09be-46ac-a409-79207ce422a6 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:34.736767 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f99e7b-09be-46ac-a409-79207ce422a6 None None] PATH_INFO: `/` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:34.738935 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 889/1793] 10.222.0.36 () {54 vars in 921 bytes} [Tue May 3 14:13:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 14:13:34.740291 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aefc41b-d92c-4a3a-8272-949a7efc4edc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b014f4c7ba1414cb8a597f5bc4033f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:34.741152 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aefc41b-d92c-4a3a-8272-949a7efc4edc service cinder] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:34.741708 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aefc41b-d92c-4a3a-8272-949a7efc4edc service cinder] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:34.742167 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aefc41b-d92c-4a3a-8272-949a7efc4edc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:34.745071 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-4aefc41b-d92c-4a3a-8272-949a7efc4edc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:13:34.820893 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aefc41b-d92c-4a3a-8272-949a7efc4edc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:34.822862 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aefc41b-d92c-4a3a-8272-949a7efc4edc service cinder] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:34.834625 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 905/1794] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:13:34 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 14:13:34.858577 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9550650-7381-4fd8-906d-900728ed1acd None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:34.859067 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9550650-7381-4fd8-906d-900728ed1acd None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:34.859514 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9550650-7381-4fd8-906d-900728ed1acd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:34.904120 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-a9550650-7381-4fd8-906d-900728ed1acd None None] MFA Rules not processed for user `63489e658c094a2598a2ac62159d2fda`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:13:34.906042 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-a9550650-7381-4fd8-906d-900728ed1acd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:13:35.056943 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 890/1795] 10.222.0.36 () {58 vars in 1018 bytes} [Tue May 3 14:13:34 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:13:35.744226 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aefc41b-d92c-4a3a-8272-949a7efc4edc service cinder] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:35.746154 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-4aefc41b-d92c-4a3a-8272-949a7efc4edc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:13:35.789102 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aefc41b-d92c-4a3a-8272-949a7efc4edc service cinder] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:35.812455 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d589346d-671f-4711-9718-7a66fc139e18 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63489e658c094a2598a2ac62159d2fda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:35.813950 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d589346d-671f-4711-9718-7a66fc139e18 service nova] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:35.814522 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d589346d-671f-4711-9718-7a66fc139e18 service nova] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:35.815071 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d589346d-671f-4711-9718-7a66fc139e18 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:35.828682 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d589346d-671f-4711-9718-7a66fc139e18 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:35.830522 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d589346d-671f-4711-9718-7a66fc139e18 service nova] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:35.859438 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 906/1796] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:13:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 14:13:36.034414 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9550650-7381-4fd8-906d-900728ed1acd None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:36.038757 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-a9550650-7381-4fd8-906d-900728ed1acd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:13:36.061048 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9550650-7381-4fd8-906d-900728ed1acd None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:36.070863 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2b7f27-5e06-4bae-9683-ed025a54e52c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:36.072208 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2b7f27-5e06-4bae-9683-ed025a54e52c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:36.072752 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2b7f27-5e06-4bae-9683-ed025a54e52c admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:36.073397 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2b7f27-5e06-4bae-9683-ed025a54e52c admin admin] PATH_INFO: `/v3/projects/5af14764aeca42479351494fe0b6b2d7` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:36.075028 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2b7f27-5e06-4bae-9683-ed025a54e52c admin admin] RBAC: Authorizing `identity:delete_project(project_id=5af14764aeca42479351494fe0b6b2d7)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:36.079365 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2b7f27-5e06-4bae-9683-ed025a54e52c admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:36.149861 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-5c2b7f27-5e06-4bae-9683-ed025a54e52c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5af14764aeca42479351494fe0b6b2d7', 'request_id': 'req-5c2b7f27-5e06-4bae-9683-ed025a54e52c'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:36.159939 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-5c2b7f27-5e06-4bae-9683-ed025a54e52c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5af14764aeca42479351494fe0b6b2d7', 'request_id': 'req-5c2b7f27-5e06-4bae-9683-ed025a54e52c'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:36.169528 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-5c2b7f27-5e06-4bae-9683-ed025a54e52c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5af14764aeca42479351494fe0b6b2d7', 'request_id': 'req-5c2b7f27-5e06-4bae-9683-ed025a54e52c'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:36.191309 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-5c2b7f27-5e06-4bae-9683-ed025a54e52c admin admin] The token cache is being invalidate because project 5af14764aeca42479351494fe0b6b2d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80012) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 14:13:36.192264 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-5c2b7f27-5e06-4bae-9683-ed025a54e52c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:36.193233 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-5c2b7f27-5e06-4bae-9683-ed025a54e52c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:36.195055 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 891/1797] 10.222.0.36 () {58 vars in 1232 bytes} [Tue May 3 14:13:36 2022] DELETE /identity/v3/projects/5af14764aeca42479351494fe0b6b2d7 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:13:36.199478 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d589346d-671f-4711-9718-7a66fc139e18 service nova] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:36.212493 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d589346d-671f-4711-9718-7a66fc139e18 service nova] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:36.238321 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65143dd-a65f-4170-b8d1-dc8fb60d992b None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:36.238899 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65143dd-a65f-4170-b8d1-dc8fb60d992b None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:36.240199 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65143dd-a65f-4170-b8d1-dc8fb60d992b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:36.283331 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-e65143dd-a65f-4170-b8d1-dc8fb60d992b None None] MFA Rules not processed for user `38de7546d3524382b4589def32732e6e`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:13:36.285160 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-e65143dd-a65f-4170-b8d1-dc8fb60d992b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:13:36.347251 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86602ede-94e7-400e-949f-6b1a1aa429d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:36.348180 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86602ede-94e7-400e-949f-6b1a1aa429d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:36.348466 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86602ede-94e7-400e-949f-6b1a1aa429d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:36.348742 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86602ede-94e7-400e-949f-6b1a1aa429d2 admin admin] PATH_INFO: `/v3/users/05f27e4360844319b639f9058c8feb6b` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:36.350592 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86602ede-94e7-400e-949f-6b1a1aa429d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=05f27e4360844319b639f9058c8feb6b)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:36.353568 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86602ede-94e7-400e-949f-6b1a1aa429d2 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:36.405770 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 892/1798] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:13:36 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:13:36.407081 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65143dd-a65f-4170-b8d1-dc8fb60d992b None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:36.408400 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-e65143dd-a65f-4170-b8d1-dc8fb60d992b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:13:36.424534 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65143dd-a65f-4170-b8d1-dc8fb60d992b None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:36.430957 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad87f0ed-b267-4e92-9185-d5a0730af3c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:36.431856 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad87f0ed-b267-4e92-9185-d5a0730af3c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:36.432141 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad87f0ed-b267-4e92-9185-d5a0730af3c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:36.432420 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad87f0ed-b267-4e92-9185-d5a0730af3c5 admin admin] PATH_INFO: `/v3/projects/97be4e4cab2c4d0c887c5da3c0c54234` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:36.434539 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad87f0ed-b267-4e92-9185-d5a0730af3c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=97be4e4cab2c4d0c887c5da3c0c54234)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:36.435731 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad87f0ed-b267-4e92-9185-d5a0730af3c5 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:36.439124 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-86602ede-94e7-400e-949f-6b1a1aa429d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05f27e4360844319b639f9058c8feb6b'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:36.451107 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-86602ede-94e7-400e-949f-6b1a1aa429d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05f27e4360844319b639f9058c8feb6b'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:36.453028 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-86602ede-94e7-400e-949f-6b1a1aa429d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05f27e4360844319b639f9058c8feb6b'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:36.485975 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-86602ede-94e7-400e-949f-6b1a1aa429d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05f27e4360844319b639f9058c8feb6b'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:36.487316 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-86602ede-94e7-400e-949f-6b1a1aa429d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05f27e4360844319b639f9058c8feb6b'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:36.523976 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-ad87f0ed-b267-4e92-9185-d5a0730af3c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97be4e4cab2c4d0c887c5da3c0c54234', 'request_id': 'req-ad87f0ed-b267-4e92-9185-d5a0730af3c5'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:36.554585 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-ad87f0ed-b267-4e92-9185-d5a0730af3c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97be4e4cab2c4d0c887c5da3c0c54234', 'request_id': 'req-ad87f0ed-b267-4e92-9185-d5a0730af3c5'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:36.558134 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 907/1799] 10.222.0.36 () {58 vars in 1223 bytes} [Tue May 3 14:13:36 2022] DELETE /identity/v3/users/05f27e4360844319b639f9058c8feb6b => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:13:36.576244 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-ad87f0ed-b267-4e92-9185-d5a0730af3c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97be4e4cab2c4d0c887c5da3c0c54234', 'request_id': 'req-ad87f0ed-b267-4e92-9185-d5a0730af3c5'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:36.615470 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-ad87f0ed-b267-4e92-9185-d5a0730af3c5 admin admin] The token cache is being invalidate because project 97be4e4cab2c4d0c887c5da3c0c54234 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80012) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 14:13:36.615772 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-ad87f0ed-b267-4e92-9185-d5a0730af3c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:36.616496 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-ad87f0ed-b267-4e92-9185-d5a0730af3c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:36.618416 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 893/1800] 10.222.0.36 () {58 vars in 1232 bytes} [Tue May 3 14:13:36 2022] DELETE /identity/v3/projects/97be4e4cab2c4d0c887c5da3c0c54234 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:13:36.625585 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c410f36b-f83e-436c-9d32-73c1300acd3f None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:36.625835 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c410f36b-f83e-436c-9d32-73c1300acd3f None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:36.626113 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c410f36b-f83e-436c-9d32-73c1300acd3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:36.683817 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-c410f36b-f83e-436c-9d32-73c1300acd3f None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:13:36.687428 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-c410f36b-f83e-436c-9d32-73c1300acd3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:13:36.853964 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 908/1801] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:13:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:13:36.861025 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d355ab5d-fc0a-4cb2-848e-117d3cabad28 None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:36.861463 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d355ab5d-fc0a-4cb2-848e-117d3cabad28 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:36.861754 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d355ab5d-fc0a-4cb2-848e-117d3cabad28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:36.889696 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-d355ab5d-fc0a-4cb2-848e-117d3cabad28 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:13:36.891892 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-d355ab5d-fc0a-4cb2-848e-117d3cabad28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:13:36.936715 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 894/1802] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:13:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:13:36.941896 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c410f36b-f83e-436c-9d32-73c1300acd3f None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:36.975106 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c410f36b-f83e-436c-9d32-73c1300acd3f None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:36.998839 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f648ce9a-b4f8-48f4-9cee-a454b1565337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:37.001534 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f648ce9a-b4f8-48f4-9cee-a454b1565337 admin admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:37.004952 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f648ce9a-b4f8-48f4-9cee-a454b1565337 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:37.005498 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f648ce9a-b4f8-48f4-9cee-a454b1565337 admin admin] PATH_INFO: `/v3/domains` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:37.007273 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f648ce9a-b4f8-48f4-9cee-a454b1565337 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:13:37.009775 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f648ce9a-b4f8-48f4-9cee-a454b1565337 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:37.014138 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f648ce9a-b4f8-48f4-9cee-a454b1565337 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:37.036146 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 909/1803] 10.222.0.36 () {58 vars in 1152 bytes} [Tue May 3 14:13:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:13:37.039649 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d355ab5d-fc0a-4cb2-848e-117d3cabad28 None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:37.051868 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d355ab5d-fc0a-4cb2-848e-117d3cabad28 None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:37.072081 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87e8bc4-823c-4281-94ab-28cce7c6e2ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:37.075050 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87e8bc4-823c-4281-94ab-28cce7c6e2ed admin admin] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:37.077638 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87e8bc4-823c-4281-94ab-28cce7c6e2ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:37.078173 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87e8bc4-823c-4281-94ab-28cce7c6e2ed admin admin] PATH_INFO: `/v3/projects` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:37.079235 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87e8bc4-823c-4281-94ab-28cce7c6e2ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:37.090716 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87e8bc4-823c-4281-94ab-28cce7c6e2ed admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:37.103560 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9800e773-7ae4-4441-95b9-eecda2c43087 None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:37.104112 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9800e773-7ae4-4441-95b9-eecda2c43087 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:37.104531 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9800e773-7ae4-4441-95b9-eecda2c43087 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:37.161200 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-9800e773-7ae4-4441-95b9-eecda2c43087 None None] MFA Rules not processed for user `a0bcadd57a774b74bf569892be098d9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:13:37.162470 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-9800e773-7ae4-4441-95b9-eecda2c43087 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:13:37.164969 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 895/1804] 10.222.0.36 () {60 vars in 1152 bytes} [Tue May 3 14:13:37 2022] POST /identity/v3/projects => generated 365 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 14:13:37.169577 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87e8bc4-823c-4281-94ab-28cce7c6e2ed admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:37.321343 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 910/1805] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:13:37 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 14:13:37.362340 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87e8bc4-823c-4281-94ab-28cce7c6e2ed admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:37.368364 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f21d5e1-9e3c-4243-98ff-e3c2ae34fc05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:37.369376 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f21d5e1-9e3c-4243-98ff-e3c2ae34fc05 admin admin] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:37.369823 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f21d5e1-9e3c-4243-98ff-e3c2ae34fc05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:37.370396 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f21d5e1-9e3c-4243-98ff-e3c2ae34fc05 admin admin] PATH_INFO: `/v3/users` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:37.371312 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f21d5e1-9e3c-4243-98ff-e3c2ae34fc05 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:37.373698 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f21d5e1-9e3c-4243-98ff-e3c2ae34fc05 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:37.402095 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 896/1806] 10.222.0.36 () {60 vars in 1143 bytes} [Tue May 3 14:13:37 2022] POST /identity/v3/users => generated 283 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 14:13:37.406686 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9800e773-7ae4-4441-95b9-eecda2c43087 None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:37.433102 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9800e773-7ae4-4441-95b9-eecda2c43087 None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:37.443194 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07a82c7-4801-431f-af41-cbd6be3c6db1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:37.444257 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07a82c7-4801-431f-af41-cbd6be3c6db1 admin admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:37.444815 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07a82c7-4801-431f-af41-cbd6be3c6db1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:37.445327 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07a82c7-4801-431f-af41-cbd6be3c6db1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:37.446663 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07a82c7-4801-431f-af41-cbd6be3c6db1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:37.448910 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07a82c7-4801-431f-af41-cbd6be3c6db1 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:37.461968 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f21d5e1-9e3c-4243-98ff-e3c2ae34fc05 admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:37.468972 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-6f21d5e1-9e3c-4243-98ff-e3c2ae34fc05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:13:37.473624 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 911/1807] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 3 14:13:37 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 14:13:37.474725 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07a82c7-4801-431f-af41-cbd6be3c6db1 admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:37.489791 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07a82c7-4801-431f-af41-cbd6be3c6db1 admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:37.492925 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f21d5e1-9e3c-4243-98ff-e3c2ae34fc05 admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:37.496239 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f685edf-e680-4a1f-8d13-5c2aac2f5695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:37.496920 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f685edf-e680-4a1f-8d13-5c2aac2f5695 admin admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:37.497654 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f685edf-e680-4a1f-8d13-5c2aac2f5695 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:37.497654 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f685edf-e680-4a1f-8d13-5c2aac2f5695 admin admin] PATH_INFO: `/v3/roles` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:37.498207 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f685edf-e680-4a1f-8d13-5c2aac2f5695 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:37.500077 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f685edf-e680-4a1f-8d13-5c2aac2f5695 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:37.500876 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac49062d-df82-42bd-88a4-76dccdd240de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:37.502607 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac49062d-df82-42bd-88a4-76dccdd240de admin admin] REQUEST_METHOD: `DELETE` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:37.503350 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac49062d-df82-42bd-88a4-76dccdd240de admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:37.503918 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac49062d-df82-42bd-88a4-76dccdd240de admin admin] PATH_INFO: `/v3/projects/2ccaaf97c1ab483aa94af8ca0aa44e1e` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:37.505511 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac49062d-df82-42bd-88a4-76dccdd240de admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ccaaf97c1ab483aa94af8ca0aa44e1e)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:37.508959 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac49062d-df82-42bd-88a4-76dccdd240de admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:37.515692 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 912/1808] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 3 14:13:37 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 14:13:37.517515 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f685edf-e680-4a1f-8d13-5c2aac2f5695 admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:37.527690 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f685edf-e680-4a1f-8d13-5c2aac2f5695 admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:37.534209 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c3c67b-931c-4796-a510-2bd92c788b82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:37.535161 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c3c67b-931c-4796-a510-2bd92c788b82 admin admin] REQUEST_METHOD: `PUT` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:37.535533 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c3c67b-931c-4796-a510-2bd92c788b82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:37.536160 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c3c67b-931c-4796-a510-2bd92c788b82 admin admin] PATH_INFO: `/v3/projects/b03ca0a925924649ab03aa6b75e68343/users/4f5a73454ddd44bb943d32e8d066f088/roles/441fdc11e95b47f4813f72610e39018b` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:37.563712 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c3c67b-931c-4796-a510-2bd92c788b82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b03ca0a925924649ab03aa6b75e68343, user_id=4f5a73454ddd44bb943d32e8d066f088, role_id=441fdc11e95b47f4813f72610e39018b)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:37.569836 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c3c67b-931c-4796-a510-2bd92c788b82 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:37.579288 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-ac49062d-df82-42bd-88a4-76dccdd240de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ccaaf97c1ab483aa94af8ca0aa44e1e', 'request_id': 'req-ac49062d-df82-42bd-88a4-76dccdd240de'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:37.592048 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-ac49062d-df82-42bd-88a4-76dccdd240de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ccaaf97c1ab483aa94af8ca0aa44e1e', 'request_id': 'req-ac49062d-df82-42bd-88a4-76dccdd240de'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:37.601915 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-ac49062d-df82-42bd-88a4-76dccdd240de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ccaaf97c1ab483aa94af8ca0aa44e1e', 'request_id': 'req-ac49062d-df82-42bd-88a4-76dccdd240de'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:37.602657 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 913/1809] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 3 14:13:37 2022] PUT /identity/v3/projects/b03ca0a925924649ab03aa6b75e68343/users/4f5a73454ddd44bb943d32e8d066f088/roles/441fdc11e95b47f4813f72610e39018b => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 14:13:37.606672 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d5f392-2893-41b4-9f1a-0f395424458b None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:37.607212 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d5f392-2893-41b4-9f1a-0f395424458b None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:37.607772 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d5f392-2893-41b4-9f1a-0f395424458b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:37.613998 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-ac49062d-df82-42bd-88a4-76dccdd240de admin admin] The token cache is being invalidate because project 2ccaaf97c1ab483aa94af8ca0aa44e1e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80012) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 14:13:37.614462 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-ac49062d-df82-42bd-88a4-76dccdd240de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:37.615263 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-ac49062d-df82-42bd-88a4-76dccdd240de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:37.617235 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 897/1810] 10.222.0.36 () {58 vars in 1232 bytes} [Tue May 3 14:13:37 2022] DELETE /identity/v3/projects/2ccaaf97c1ab483aa94af8ca0aa44e1e => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:13:37.621957 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0917a59-16e5-4b33-ba05-814ad6134c1a None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:37.622310 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0917a59-16e5-4b33-ba05-814ad6134c1a None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:37.622694 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0917a59-16e5-4b33-ba05-814ad6134c1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:37.642192 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-e0917a59-16e5-4b33-ba05-814ad6134c1a None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:13:37.643649 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-e0917a59-16e5-4b33-ba05-814ad6134c1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:13:37.652307 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-37d5f392-2893-41b4-9f1a-0f395424458b None None] MFA Rules not processed for user `4f5a73454ddd44bb943d32e8d066f088`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:13:37.653537 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-37d5f392-2893-41b4-9f1a-0f395424458b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:13:37.726324 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 914/1811] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:13:37 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:13:37.733974 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d5f392-2893-41b4-9f1a-0f395424458b None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:37.735757 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-37d5f392-2893-41b4-9f1a-0f395424458b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:13:37.742439 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 898/1812] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:13:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:13:37.751443 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036243cf-e219-431e-911b-0bd3bccbab74 None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:37.754055 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036243cf-e219-431e-911b-0bd3bccbab74 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:37.754670 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036243cf-e219-431e-911b-0bd3bccbab74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:37.780618 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-036243cf-e219-431e-911b-0bd3bccbab74 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:13:37.782250 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-036243cf-e219-431e-911b-0bd3bccbab74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:13:37.786009 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d5f392-2893-41b4-9f1a-0f395424458b None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:37.797369 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 899/1813] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:13:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:13:37.797369 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d3d362-2b14-48a1-ae8a-841db6a111f1 None None] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:37.797369 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d3d362-2b14-48a1-ae8a-841db6a111f1 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:37.797369 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d3d362-2b14-48a1-ae8a-841db6a111f1 None None] PATH_INFO: `/` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:37.799221 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 900/1814] 10.222.0.36 () {54 vars in 921 bytes} [Tue May 3 14:13:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 14:13:37.800136 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d3d362-2b14-48a1-ae8a-841db6a111f1 None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:37.807743 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd4ab35-b1ce-4044-85f4-2d08fc2086f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:37.808821 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd4ab35-b1ce-4044-85f4-2d08fc2086f2 admin admin] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:37.809317 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd4ab35-b1ce-4044-85f4-2d08fc2086f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:37.810446 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd4ab35-b1ce-4044-85f4-2d08fc2086f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:37.811822 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd4ab35-b1ce-4044-85f4-2d08fc2086f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:37.814004 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd4ab35-b1ce-4044-85f4-2d08fc2086f2 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:37.820440 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d3d362-2b14-48a1-ae8a-841db6a111f1 None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:37.826417 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc94b867-51fe-46c8-a600-0c5bb38eb125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:37.827143 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc94b867-51fe-46c8-a600-0c5bb38eb125 admin admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:37.827560 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc94b867-51fe-46c8-a600-0c5bb38eb125 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:37.827862 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc94b867-51fe-46c8-a600-0c5bb38eb125 admin admin] PATH_INFO: `/v3/domains` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:37.828569 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc94b867-51fe-46c8-a600-0c5bb38eb125 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80012) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:13:37.828869 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc94b867-51fe-46c8-a600-0c5bb38eb125 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:37.831580 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc94b867-51fe-46c8-a600-0c5bb38eb125 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:37.858285 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 901/1815] 10.222.0.36 () {58 vars in 1152 bytes} [Tue May 3 14:13:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:13:37.858723 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc94b867-51fe-46c8-a600-0c5bb38eb125 admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:37.870917 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc94b867-51fe-46c8-a600-0c5bb38eb125 admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:37.876741 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bed844d-4a70-4486-998f-d382cb397a88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:37.877572 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bed844d-4a70-4486-998f-d382cb397a88 admin admin] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:37.877931 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bed844d-4a70-4486-998f-d382cb397a88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:37.878503 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bed844d-4a70-4486-998f-d382cb397a88 admin admin] PATH_INFO: `/v3/projects` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:37.879376 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bed844d-4a70-4486-998f-d382cb397a88 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:37.881886 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bed844d-4a70-4486-998f-d382cb397a88 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:37.900472 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 915/1816] 10.222.0.36 () {60 vars in 1152 bytes} [Tue May 3 14:13:37 2022] POST /identity/v3/projects => generated 363 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 14:13:37.901771 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd4ab35-b1ce-4044-85f4-2d08fc2086f2 admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:37.932994 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 902/1817] 10.222.0.36 () {60 vars in 1152 bytes} [Tue May 3 14:13:37 2022] POST /identity/v3/projects => generated 375 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 14:13:37.932994 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44868fa-6222-4cc8-b253-1bf5d10acc32 None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:37.932994 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44868fa-6222-4cc8-b253-1bf5d10acc32 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:37.932994 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44868fa-6222-4cc8-b253-1bf5d10acc32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:37.956239 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-a44868fa-6222-4cc8-b253-1bf5d10acc32 None None] MFA Rules not processed for user `63489e658c094a2598a2ac62159d2fda`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:13:37.957272 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-a44868fa-6222-4cc8-b253-1bf5d10acc32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:13:38.005643 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd4ab35-b1ce-4044-85f4-2d08fc2086f2 admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:38.072058 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 903/1818] 10.222.0.36 () {58 vars in 1018 bytes} [Tue May 3 14:13:37 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:13:38.077020 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44868fa-6222-4cc8-b253-1bf5d10acc32 None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:38.147193 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2748c63-db2a-41dd-9e95-0f5e00f4d6f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:38.147873 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2748c63-db2a-41dd-9e95-0f5e00f4d6f8 admin admin] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:38.148150 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2748c63-db2a-41dd-9e95-0f5e00f4d6f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:38.148422 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2748c63-db2a-41dd-9e95-0f5e00f4d6f8 admin admin] PATH_INFO: `/v3/users` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:38.151359 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2748c63-db2a-41dd-9e95-0f5e00f4d6f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:38.156937 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2748c63-db2a-41dd-9e95-0f5e00f4d6f8 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:38.214872 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 916/1819] 10.222.0.36 () {60 vars in 1143 bytes} [Tue May 3 14:13:37 2022] POST /identity/v3/users => generated 288 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 14:13:38.215779 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2748c63-db2a-41dd-9e95-0f5e00f4d6f8 admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:38.247070 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44868fa-6222-4cc8-b253-1bf5d10acc32 None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:38.261139 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ed103d-bc24-488a-8fc2-6ab03b73d9de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:38.261566 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2748c63-db2a-41dd-9e95-0f5e00f4d6f8 admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:38.261899 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ed103d-bc24-488a-8fc2-6ab03b73d9de admin admin] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:38.262189 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ed103d-bc24-488a-8fc2-6ab03b73d9de admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:38.262468 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ed103d-bc24-488a-8fc2-6ab03b73d9de admin admin] PATH_INFO: `/v3/users` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:38.265206 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ed103d-bc24-488a-8fc2-6ab03b73d9de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:38.267951 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ed103d-bc24-488a-8fc2-6ab03b73d9de admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:38.269210 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d327d54-9ec7-401f-a1a7-d1c4c7e0fe50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:38.270497 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d327d54-9ec7-401f-a1a7-d1c4c7e0fe50 admin admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:38.270884 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d327d54-9ec7-401f-a1a7-d1c4c7e0fe50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:38.271274 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d327d54-9ec7-401f-a1a7-d1c4c7e0fe50 admin admin] PATH_INFO: `/v3/roles` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:38.272164 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d327d54-9ec7-401f-a1a7-d1c4c7e0fe50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:38.274258 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d327d54-9ec7-401f-a1a7-d1c4c7e0fe50 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:38.286358 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 917/1820] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 3 14:13:38 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 14:13:38.294229 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d327d54-9ec7-401f-a1a7-d1c4c7e0fe50 admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:38.297270 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-7d327d54-9ec7-401f-a1a7-d1c4c7e0fe50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:13:38.300974 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 904/1821] 10.222.0.36 () {60 vars in 1143 bytes} [Tue May 3 14:13:38 2022] POST /identity/v3/users => generated 288 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 14:13:38.302487 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ed103d-bc24-488a-8fc2-6ab03b73d9de admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:38.316396 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ed103d-bc24-488a-8fc2-6ab03b73d9de admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:38.319661 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d327d54-9ec7-401f-a1a7-d1c4c7e0fe50 admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:38.322991 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a445cb-4dda-41ce-9bee-77c0665356d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:38.324269 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a445cb-4dda-41ce-9bee-77c0665356d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:38.324740 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a445cb-4dda-41ce-9bee-77c0665356d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:38.325476 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a445cb-4dda-41ce-9bee-77c0665356d4 admin admin] PATH_INFO: `/v3/projects/1cda940fa3e8405082ae69fa2f515ed0/users/c9a7876806ad4e40af84c8446b2898dc/roles/36abe9b50fd8479c86c4f8f70fd85aa3` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:38.326356 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990e54f4-e338-4510-ac4d-6bf150fd8a3a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63489e658c094a2598a2ac62159d2fda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:38.327230 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990e54f4-e338-4510-ac4d-6bf150fd8a3a service nova] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:38.327589 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990e54f4-e338-4510-ac4d-6bf150fd8a3a service nova] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:38.327934 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990e54f4-e338-4510-ac4d-6bf150fd8a3a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:38.341026 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990e54f4-e338-4510-ac4d-6bf150fd8a3a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:38.343372 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990e54f4-e338-4510-ac4d-6bf150fd8a3a service nova] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:38.370462 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a445cb-4dda-41ce-9bee-77c0665356d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1cda940fa3e8405082ae69fa2f515ed0, user_id=c9a7876806ad4e40af84c8446b2898dc, role_id=36abe9b50fd8479c86c4f8f70fd85aa3)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:38.373567 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a445cb-4dda-41ce-9bee-77c0665356d4 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:38.380107 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 918/1822] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:13:38 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 14:13:38.382224 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990e54f4-e338-4510-ac4d-6bf150fd8a3a service nova] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:38.396970 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990e54f4-e338-4510-ac4d-6bf150fd8a3a service nova] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:38.401383 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 905/1823] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 3 14:13:38 2022] PUT /identity/v3/projects/1cda940fa3e8405082ae69fa2f515ed0/users/c9a7876806ad4e40af84c8446b2898dc/roles/36abe9b50fd8479c86c4f8f70fd85aa3 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:13:38.402274 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a445cb-4dda-41ce-9bee-77c0665356d4 admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:38.496346 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b994ee-cda9-4972-bd0b-c92dff9b416b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:38.497306 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b994ee-cda9-4972-bd0b-c92dff9b416b admin admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:38.497855 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b994ee-cda9-4972-bd0b-c92dff9b416b admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:38.498227 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a445cb-4dda-41ce-9bee-77c0665356d4 admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:38.498496 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b994ee-cda9-4972-bd0b-c92dff9b416b admin admin] PATH_INFO: `/v3/roles` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:38.499599 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b994ee-cda9-4972-bd0b-c92dff9b416b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:38.502000 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b994ee-cda9-4972-bd0b-c92dff9b416b admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:38.509321 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4506addd-9961-46d2-89ee-a7f545a74b80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:38.509321 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4506addd-9961-46d2-89ee-a7f545a74b80 admin admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:38.509321 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4506addd-9961-46d2-89ee-a7f545a74b80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:38.509321 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4506addd-9961-46d2-89ee-a7f545a74b80 admin admin] PATH_INFO: `/v3/roles` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:38.509776 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4506addd-9961-46d2-89ee-a7f545a74b80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:38.512191 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4506addd-9961-46d2-89ee-a7f545a74b80 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:38.516143 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 919/1824] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 3 14:13:38 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 14:13:38.521486 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b994ee-cda9-4972-bd0b-c92dff9b416b admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:38.527848 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 906/1825] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 3 14:13:38 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 14:13:38.528864 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4506addd-9961-46d2-89ee-a7f545a74b80 admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:38.533417 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b994ee-cda9-4972-bd0b-c92dff9b416b admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:38.540551 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3189da3a-193f-4718-91a4-baaf8de9fb8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:38.540735 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4506addd-9961-46d2-89ee-a7f545a74b80 admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:38.541463 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3189da3a-193f-4718-91a4-baaf8de9fb8b admin admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:38.541819 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3189da3a-193f-4718-91a4-baaf8de9fb8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:38.542099 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3189da3a-193f-4718-91a4-baaf8de9fb8b admin admin] PATH_INFO: `/v3/roles` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:38.543495 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3189da3a-193f-4718-91a4-baaf8de9fb8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:38.545832 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3189da3a-193f-4718-91a4-baaf8de9fb8b admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:38.545967 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903eb32d-e718-4e66-b3cc-782eb6ba329c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:38.546734 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903eb32d-e718-4e66-b3cc-782eb6ba329c admin admin] REQUEST_METHOD: `PUT` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:38.547016 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903eb32d-e718-4e66-b3cc-782eb6ba329c admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:38.547287 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903eb32d-e718-4e66-b3cc-782eb6ba329c admin admin] PATH_INFO: `/v3/projects/1cda940fa3e8405082ae69fa2f515ed0/users/c9a7876806ad4e40af84c8446b2898dc/roles/36abe9b50fd8479c86c4f8f70fd85aa3` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:38.549798 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903eb32d-e718-4e66-b3cc-782eb6ba329c admin admin] RBAC: Authorizing `identity:create_grant(project_id=1cda940fa3e8405082ae69fa2f515ed0, user_id=c9a7876806ad4e40af84c8446b2898dc, role_id=36abe9b50fd8479c86c4f8f70fd85aa3)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:38.552797 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903eb32d-e718-4e66-b3cc-782eb6ba329c admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:38.565527 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 920/1826] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 3 14:13:38 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 14:13:38.569330 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 907/1827] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 3 14:13:38 2022] PUT /identity/v3/projects/1cda940fa3e8405082ae69fa2f515ed0/users/c9a7876806ad4e40af84c8446b2898dc/roles/36abe9b50fd8479c86c4f8f70fd85aa3 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:13:38.577131 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3189da3a-193f-4718-91a4-baaf8de9fb8b admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:38.579087 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa862ae0-27c9-449d-b991-448c0daa679d None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:38.579383 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa862ae0-27c9-449d-b991-448c0daa679d None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:38.579661 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa862ae0-27c9-449d-b991-448c0daa679d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:38.599240 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3189da3a-193f-4718-91a4-baaf8de9fb8b admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:38.617138 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-aa862ae0-27c9-449d-b991-448c0daa679d None None] MFA Rules not processed for user `c9a7876806ad4e40af84c8446b2898dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:13:38.618667 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-aa862ae0-27c9-449d-b991-448c0daa679d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:13:38.672907 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbb7bc7-a517-4777-8645-b5ffefc44df0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:38.673868 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbb7bc7-a517-4777-8645-b5ffefc44df0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:38.674148 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbb7bc7-a517-4777-8645-b5ffefc44df0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:38.674424 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbb7bc7-a517-4777-8645-b5ffefc44df0 admin admin] PATH_INFO: `/v3/projects/670ea88096a54967b906469bfda49e14/users/b195a0cfa579445e97f2081bab44e896/roles/441fdc11e95b47f4813f72610e39018b` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:38.689565 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbb7bc7-a517-4777-8645-b5ffefc44df0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=670ea88096a54967b906469bfda49e14, user_id=b195a0cfa579445e97f2081bab44e896, role_id=441fdc11e95b47f4813f72610e39018b)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:38.692236 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbb7bc7-a517-4777-8645-b5ffefc44df0 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:38.713411 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 921/1828] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 3 14:13:38 2022] PUT /identity/v3/projects/670ea88096a54967b906469bfda49e14/users/b195a0cfa579445e97f2081bab44e896/roles/441fdc11e95b47f4813f72610e39018b => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:13:38.721982 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7779b3d-305e-4d74-862b-00ad078814c9 None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:38.722674 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7779b3d-305e-4d74-862b-00ad078814c9 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:38.723248 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7779b3d-305e-4d74-862b-00ad078814c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:38.729895 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 908/1829] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:13:38 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 14:13:38.756657 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa862ae0-27c9-449d-b991-448c0daa679d None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:38.758613 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-aa862ae0-27c9-449d-b991-448c0daa679d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:13:38.785494 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-c7779b3d-305e-4d74-862b-00ad078814c9 None None] MFA Rules not processed for user `b195a0cfa579445e97f2081bab44e896`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:13:38.786700 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-c7779b3d-305e-4d74-862b-00ad078814c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:13:38.846784 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa862ae0-27c9-449d-b991-448c0daa679d None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:38.861502 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 922/1830] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:13:38 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:13:38.862801 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7779b3d-305e-4d74-862b-00ad078814c9 None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:38.899466 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469059c9-3e3c-4a76-86c9-a2cd5721d618 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b014f4c7ba1414cb8a597f5bc4033f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:38.900137 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469059c9-3e3c-4a76-86c9-a2cd5721d618 service cinder] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:38.900422 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469059c9-3e3c-4a76-86c9-a2cd5721d618 service cinder] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:38.900709 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469059c9-3e3c-4a76-86c9-a2cd5721d618 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:38.938582 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7779b3d-305e-4d74-862b-00ad078814c9 None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:38.942923 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37940136-b13f-4155-b497-adfeba9c7ba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:38.943706 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37940136-b13f-4155-b497-adfeba9c7ba4 admin admin] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:38.944042 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37940136-b13f-4155-b497-adfeba9c7ba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:38.944333 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37940136-b13f-4155-b497-adfeba9c7ba4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:38.945032 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37940136-b13f-4155-b497-adfeba9c7ba4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:38.947165 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37940136-b13f-4155-b497-adfeba9c7ba4 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:38.974902 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469059c9-3e3c-4a76-86c9-a2cd5721d618 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:38.976600 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469059c9-3e3c-4a76-86c9-a2cd5721d618 service cinder] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:38.977538 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 923/1831] 10.222.0.36 () {60 vars in 1152 bytes} [Tue May 3 14:13:38 2022] POST /identity/v3/projects => generated 375 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 14:13:38.981737 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37940136-b13f-4155-b497-adfeba9c7ba4 admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:38.991328 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 909/1832] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:13:38 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 14:13:39.048263 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37940136-b13f-4155-b497-adfeba9c7ba4 admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:39.054057 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272b0ab2-fa2a-4bbf-8bdd-d4e5c1edfdc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:39.054764 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272b0ab2-fa2a-4bbf-8bdd-d4e5c1edfdc2 admin admin] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:39.055180 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272b0ab2-fa2a-4bbf-8bdd-d4e5c1edfdc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:39.055466 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272b0ab2-fa2a-4bbf-8bdd-d4e5c1edfdc2 admin admin] PATH_INFO: `/v3/users` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:39.057229 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272b0ab2-fa2a-4bbf-8bdd-d4e5c1edfdc2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:39.059086 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272b0ab2-fa2a-4bbf-8bdd-d4e5c1edfdc2 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:39.083489 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469059c9-3e3c-4a76-86c9-a2cd5721d618 service cinder] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:39.087602 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 924/1833] 10.222.0.36 () {60 vars in 1143 bytes} [Tue May 3 14:13:38 2022] POST /identity/v3/users => generated 294 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 14:13:39.091378 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272b0ab2-fa2a-4bbf-8bdd-d4e5c1edfdc2 admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:39.094108 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469059c9-3e3c-4a76-86c9-a2cd5721d618 service cinder] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:39.101626 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272b0ab2-fa2a-4bbf-8bdd-d4e5c1edfdc2 admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:39.106810 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0910ed-24c8-4884-becf-1e0e90e9b4d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:39.107527 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0910ed-24c8-4884-becf-1e0e90e9b4d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:39.107641 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0910ed-24c8-4884-becf-1e0e90e9b4d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:39.107956 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0910ed-24c8-4884-becf-1e0e90e9b4d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:39.108729 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0910ed-24c8-4884-becf-1e0e90e9b4d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:39.110466 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0910ed-24c8-4884-becf-1e0e90e9b4d7 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:39.123805 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 925/1834] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 3 14:13:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 14:13:39.124862 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0910ed-24c8-4884-becf-1e0e90e9b4d7 admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:39.134501 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0910ed-24c8-4884-becf-1e0e90e9b4d7 admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:39.139595 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcf4dec-4d74-44b2-8524-c02955ff47fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:39.140228 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcf4dec-4d74-44b2-8524-c02955ff47fe admin admin] REQUEST_METHOD: `PUT` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:39.140509 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcf4dec-4d74-44b2-8524-c02955ff47fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:39.140782 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcf4dec-4d74-44b2-8524-c02955ff47fe admin admin] PATH_INFO: `/v3/projects/7a788f7f0ed94b12beb05a43acb87179/users/6bca643320b94d3ebf8bc6d5824c695e/roles/36abe9b50fd8479c86c4f8f70fd85aa3` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:39.148426 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95aa15f8-2b11-459b-b457-610fbf7c4a36 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b014f4c7ba1414cb8a597f5bc4033f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:39.149176 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95aa15f8-2b11-459b-b457-610fbf7c4a36 service cinder] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:39.149498 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95aa15f8-2b11-459b-b457-610fbf7c4a36 service cinder] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:39.149776 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95aa15f8-2b11-459b-b457-610fbf7c4a36 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:39.156665 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcf4dec-4d74-44b2-8524-c02955ff47fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a788f7f0ed94b12beb05a43acb87179, user_id=6bca643320b94d3ebf8bc6d5824c695e, role_id=36abe9b50fd8479c86c4f8f70fd85aa3)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:39.159701 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcf4dec-4d74-44b2-8524-c02955ff47fe admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:39.173842 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 926/1835] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 3 14:13:39 2022] PUT /identity/v3/projects/7a788f7f0ed94b12beb05a43acb87179/users/6bca643320b94d3ebf8bc6d5824c695e/roles/36abe9b50fd8479c86c4f8f70fd85aa3 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:13:39.177707 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcf4dec-4d74-44b2-8524-c02955ff47fe admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:39.221167 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95aa15f8-2b11-459b-b457-610fbf7c4a36 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:39.223816 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95aa15f8-2b11-459b-b457-610fbf7c4a36 service cinder] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:39.250679 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 910/1836] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:13:39 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 03 14:13:39.253258 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcf4dec-4d74-44b2-8524-c02955ff47fe admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:39.258483 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcfd2af-f9a4-4fc8-b595-bef0b744578b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:39.259428 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcfd2af-f9a4-4fc8-b595-bef0b744578b admin admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:39.259763 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcfd2af-f9a4-4fc8-b595-bef0b744578b admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:39.260138 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcfd2af-f9a4-4fc8-b595-bef0b744578b admin admin] PATH_INFO: `/v3/roles` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:39.260976 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcfd2af-f9a4-4fc8-b595-bef0b744578b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:39.262867 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcfd2af-f9a4-4fc8-b595-bef0b744578b admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:39.283488 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 927/1837] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 3 14:13:39 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 14:13:39.287555 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95aa15f8-2b11-459b-b457-610fbf7c4a36 service cinder] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:39.300900 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95aa15f8-2b11-459b-b457-610fbf7c4a36 service cinder] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:39.308540 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20397e65-beae-4dbb-a614-aa57c730a505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:39.309777 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20397e65-beae-4dbb-a614-aa57c730a505 admin admin] REQUEST_METHOD: `PUT` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:39.310103 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20397e65-beae-4dbb-a614-aa57c730a505 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:39.310498 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20397e65-beae-4dbb-a614-aa57c730a505 admin admin] PATH_INFO: `/v3/projects/7a788f7f0ed94b12beb05a43acb87179/users/6bca643320b94d3ebf8bc6d5824c695e/roles/36abe9b50fd8479c86c4f8f70fd85aa3` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:39.313668 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20397e65-beae-4dbb-a614-aa57c730a505 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a788f7f0ed94b12beb05a43acb87179, user_id=6bca643320b94d3ebf8bc6d5824c695e, role_id=36abe9b50fd8479c86c4f8f70fd85aa3)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:39.316819 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20397e65-beae-4dbb-a614-aa57c730a505 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:39.333407 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 911/1838] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 3 14:13:39 2022] PUT /identity/v3/projects/7a788f7f0ed94b12beb05a43acb87179/users/6bca643320b94d3ebf8bc6d5824c695e/roles/36abe9b50fd8479c86c4f8f70fd85aa3 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:13:39.341028 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16e4ad9-de4e-4ac1-a595-845fdc3dd5d2 None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:39.341302 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16e4ad9-de4e-4ac1-a595-845fdc3dd5d2 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:39.341742 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16e4ad9-de4e-4ac1-a595-845fdc3dd5d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:39.397601 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-e16e4ad9-de4e-4ac1-a595-845fdc3dd5d2 None None] MFA Rules not processed for user `6bca643320b94d3ebf8bc6d5824c695e`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:13:39.400018 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-e16e4ad9-de4e-4ac1-a595-845fdc3dd5d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:13:39.484220 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 928/1839] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:13:39 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 14:13:39.495301 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20397e65-beae-4dbb-a614-aa57c730a505 admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:39.559268 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20397e65-beae-4dbb-a614-aa57c730a505 admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:39.564072 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a9958b-49c1-4682-9bba-74ce86c99476 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b014f4c7ba1414cb8a597f5bc4033f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:39.564751 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a9958b-49c1-4682-9bba-74ce86c99476 service cinder] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:39.565065 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a9958b-49c1-4682-9bba-74ce86c99476 service cinder] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:39.565381 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a9958b-49c1-4682-9bba-74ce86c99476 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:39.624092 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a9958b-49c1-4682-9bba-74ce86c99476 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:39.625568 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a9958b-49c1-4682-9bba-74ce86c99476 service cinder] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:39.634987 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 912/1840] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:13:39 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 14:13:39.709121 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16e4ad9-de4e-4ac1-a595-845fdc3dd5d2 None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:39.710655 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-e16e4ad9-de4e-4ac1-a595-845fdc3dd5d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:13:39.783310 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16e4ad9-de4e-4ac1-a595-845fdc3dd5d2 None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:39.788001 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39be411-a59d-46bc-bc4a-793e17b3de3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:39.788883 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39be411-a59d-46bc-bc4a-793e17b3de3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:39.789159 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39be411-a59d-46bc-bc4a-793e17b3de3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:39.789496 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39be411-a59d-46bc-bc4a-793e17b3de3f admin admin] PATH_INFO: `/v3/users/a0a71649ac834217a2ec646508adc4c7` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:39.791001 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39be411-a59d-46bc-bc4a-793e17b3de3f admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0a71649ac834217a2ec646508adc4c7)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:39.792937 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39be411-a59d-46bc-bc4a-793e17b3de3f admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:39.845435 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-f39be411-a59d-46bc-bc4a-793e17b3de3f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0a71649ac834217a2ec646508adc4c7'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:39.853804 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-f39be411-a59d-46bc-bc4a-793e17b3de3f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0a71649ac834217a2ec646508adc4c7'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:39.857964 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-f39be411-a59d-46bc-bc4a-793e17b3de3f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0a71649ac834217a2ec646508adc4c7'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:39.867044 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-f39be411-a59d-46bc-bc4a-793e17b3de3f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0a71649ac834217a2ec646508adc4c7'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:39.867852 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-f39be411-a59d-46bc-bc4a-793e17b3de3f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0a71649ac834217a2ec646508adc4c7'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:39.922043 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 929/1841] 10.222.0.36 () {58 vars in 1223 bytes} [Tue May 3 14:13:39 2022] DELETE /identity/v3/users/a0a71649ac834217a2ec646508adc4c7 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:13:40.931857 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a9958b-49c1-4682-9bba-74ce86c99476 service cinder] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:40.947887 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a9958b-49c1-4682-9bba-74ce86c99476 service cinder] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:41.105697 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511e2882-c58a-4a56-bea8-4a74cd978813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:41.106796 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511e2882-c58a-4a56-bea8-4a74cd978813 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:41.107171 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511e2882-c58a-4a56-bea8-4a74cd978813 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:41.107533 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511e2882-c58a-4a56-bea8-4a74cd978813 admin admin] PATH_INFO: `/v3/projects/b93d213e2ffb496a965faffef1768a56` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:41.109678 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511e2882-c58a-4a56-bea8-4a74cd978813 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b93d213e2ffb496a965faffef1768a56)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:41.111895 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511e2882-c58a-4a56-bea8-4a74cd978813 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:41.181273 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-511e2882-c58a-4a56-bea8-4a74cd978813 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b93d213e2ffb496a965faffef1768a56', 'request_id': 'req-511e2882-c58a-4a56-bea8-4a74cd978813'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:41.196160 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-511e2882-c58a-4a56-bea8-4a74cd978813 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b93d213e2ffb496a965faffef1768a56', 'request_id': 'req-511e2882-c58a-4a56-bea8-4a74cd978813'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:41.202671 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-511e2882-c58a-4a56-bea8-4a74cd978813 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b93d213e2ffb496a965faffef1768a56', 'request_id': 'req-511e2882-c58a-4a56-bea8-4a74cd978813'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:41.227721 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-511e2882-c58a-4a56-bea8-4a74cd978813 admin admin] The token cache is being invalidate because project b93d213e2ffb496a965faffef1768a56 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80012) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 14:13:41.228011 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-511e2882-c58a-4a56-bea8-4a74cd978813 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:41.229941 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-511e2882-c58a-4a56-bea8-4a74cd978813 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:41.235560 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 913/1842] 10.222.0.36 () {58 vars in 1232 bytes} [Tue May 3 14:13:40 2022] DELETE /identity/v3/projects/b93d213e2ffb496a965faffef1768a56 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:13:41.239873 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39be411-a59d-46bc-bc4a-793e17b3de3f admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:41.243036 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-f39be411-a59d-46bc-bc4a-793e17b3de3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:13:41.267555 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39be411-a59d-46bc-bc4a-793e17b3de3f admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:41.363922 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7bbac2-1564-47c5-a5c0-c98ac7907fca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:41.365427 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7bbac2-1564-47c5-a5c0-c98ac7907fca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:41.365972 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7bbac2-1564-47c5-a5c0-c98ac7907fca admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:41.366319 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7bbac2-1564-47c5-a5c0-c98ac7907fca admin admin] PATH_INFO: `/v3/users/a0bcadd57a774b74bf569892be098d9a` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:41.367910 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7bbac2-1564-47c5-a5c0-c98ac7907fca admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0bcadd57a774b74bf569892be098d9a)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:41.371354 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7bbac2-1564-47c5-a5c0-c98ac7907fca admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:41.447473 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-6b7bbac2-1564-47c5-a5c0-c98ac7907fca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0bcadd57a774b74bf569892be098d9a'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:41.464495 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-6b7bbac2-1564-47c5-a5c0-c98ac7907fca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0bcadd57a774b74bf569892be098d9a'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:41.465244 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-6b7bbac2-1564-47c5-a5c0-c98ac7907fca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0bcadd57a774b74bf569892be098d9a'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:41.497751 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-6b7bbac2-1564-47c5-a5c0-c98ac7907fca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0bcadd57a774b74bf569892be098d9a'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:41.498545 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-6b7bbac2-1564-47c5-a5c0-c98ac7907fca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0bcadd57a774b74bf569892be098d9a'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:41.534078 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 930/1843] 10.222.0.36 () {58 vars in 1223 bytes} [Tue May 3 14:13:41 2022] DELETE /identity/v3/users/a0bcadd57a774b74bf569892be098d9a => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:13:42.003827 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511e2882-c58a-4a56-bea8-4a74cd978813 admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:42.006272 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-511e2882-c58a-4a56-bea8-4a74cd978813 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:13:42.059009 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511e2882-c58a-4a56-bea8-4a74cd978813 admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:42.179794 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63b6ca1-5844-4cee-960c-05149e2821fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:42.180733 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63b6ca1-5844-4cee-960c-05149e2821fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:42.181617 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63b6ca1-5844-4cee-960c-05149e2821fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:42.182222 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63b6ca1-5844-4cee-960c-05149e2821fc admin admin] PATH_INFO: `/v3/projects/ca6136bae53743bfa63d54a58ed8abb9` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:42.183507 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63b6ca1-5844-4cee-960c-05149e2821fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca6136bae53743bfa63d54a58ed8abb9)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:42.185489 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63b6ca1-5844-4cee-960c-05149e2821fc admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:42.250610 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-f63b6ca1-5844-4cee-960c-05149e2821fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca6136bae53743bfa63d54a58ed8abb9', 'request_id': 'req-f63b6ca1-5844-4cee-960c-05149e2821fc'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:42.257588 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-f63b6ca1-5844-4cee-960c-05149e2821fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca6136bae53743bfa63d54a58ed8abb9', 'request_id': 'req-f63b6ca1-5844-4cee-960c-05149e2821fc'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:42.263474 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-f63b6ca1-5844-4cee-960c-05149e2821fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca6136bae53743bfa63d54a58ed8abb9', 'request_id': 'req-f63b6ca1-5844-4cee-960c-05149e2821fc'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:42.288287 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-f63b6ca1-5844-4cee-960c-05149e2821fc admin admin] The token cache is being invalidate because project ca6136bae53743bfa63d54a58ed8abb9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80012) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 14:13:42.288627 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-f63b6ca1-5844-4cee-960c-05149e2821fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:42.289573 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-f63b6ca1-5844-4cee-960c-05149e2821fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:42.292741 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 914/1844] 10.222.0.36 () {58 vars in 1232 bytes} [Tue May 3 14:13:42 2022] DELETE /identity/v3/projects/ca6136bae53743bfa63d54a58ed8abb9 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:13:42.297768 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5106df-9acd-44a6-9971-b8b586f9c193 None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:42.298328 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5106df-9acd-44a6-9971-b8b586f9c193 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:42.298328 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5106df-9acd-44a6-9971-b8b586f9c193 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:42.329727 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-ae5106df-9acd-44a6-9971-b8b586f9c193 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:13:42.330962 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-ae5106df-9acd-44a6-9971-b8b586f9c193 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:13:42.462303 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 931/1845] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:13:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:13:42.471496 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6227a8-93df-43eb-93e4-e7b9b4bafa36 None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:42.471794 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6227a8-93df-43eb-93e4-e7b9b4bafa36 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:42.472063 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6227a8-93df-43eb-93e4-e7b9b4bafa36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:42.517323 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-db6227a8-93df-43eb-93e4-e7b9b4bafa36 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:13:42.522413 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-db6227a8-93df-43eb-93e4-e7b9b4bafa36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:13:42.532548 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5106df-9acd-44a6-9971-b8b586f9c193 None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:42.535364 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-ae5106df-9acd-44a6-9971-b8b586f9c193 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:13:42.565222 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 915/1846] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:13:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:13:42.567155 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6227a8-93df-43eb-93e4-e7b9b4bafa36 None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:42.575135 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5106df-9acd-44a6-9971-b8b586f9c193 None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:42.591460 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6227a8-93df-43eb-93e4-e7b9b4bafa36 None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:42.597789 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d783c92-190f-4682-9235-f2a38aa7f078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:42.608194 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d783c92-190f-4682-9235-f2a38aa7f078 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:42.608485 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d783c92-190f-4682-9235-f2a38aa7f078 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:42.608911 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d783c92-190f-4682-9235-f2a38aa7f078 admin admin] PATH_INFO: `/v3/users/4f5a73454ddd44bb943d32e8d066f088` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:42.609499 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09106445-8b09-4cf5-918f-079129694192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:42.610398 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09106445-8b09-4cf5-918f-079129694192 admin admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:42.611094 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09106445-8b09-4cf5-918f-079129694192 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:42.611557 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09106445-8b09-4cf5-918f-079129694192 admin admin] PATH_INFO: `/v3/domains` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:42.612617 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09106445-8b09-4cf5-918f-079129694192 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80012) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:13:42.614545 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09106445-8b09-4cf5-918f-079129694192 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:42.615650 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d783c92-190f-4682-9235-f2a38aa7f078 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f5a73454ddd44bb943d32e8d066f088)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:42.617927 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d783c92-190f-4682-9235-f2a38aa7f078 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:42.620956 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09106445-8b09-4cf5-918f-079129694192 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:42.643189 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 916/1847] 10.222.0.36 () {58 vars in 1152 bytes} [Tue May 3 14:13:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:13:42.648235 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09106445-8b09-4cf5-918f-079129694192 admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:42.673699 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09106445-8b09-4cf5-918f-079129694192 admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:42.680654 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31acd84-3925-4de3-8c77-ace0e51fd1a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:42.681424 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31acd84-3925-4de3-8c77-ace0e51fd1a6 admin admin] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:42.681719 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31acd84-3925-4de3-8c77-ace0e51fd1a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:42.681978 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31acd84-3925-4de3-8c77-ace0e51fd1a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:42.682735 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31acd84-3925-4de3-8c77-ace0e51fd1a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:42.687654 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31acd84-3925-4de3-8c77-ace0e51fd1a6 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:42.715144 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-9d783c92-190f-4682-9235-f2a38aa7f078 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f5a73454ddd44bb943d32e8d066f088'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:42.730719 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-9d783c92-190f-4682-9235-f2a38aa7f078 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f5a73454ddd44bb943d32e8d066f088'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:42.731717 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-9d783c92-190f-4682-9235-f2a38aa7f078 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f5a73454ddd44bb943d32e8d066f088'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:42.740492 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 917/1848] 10.222.0.36 () {60 vars in 1152 bytes} [Tue May 3 14:13:42 2022] POST /identity/v3/projects => generated 401 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 14:13:42.744773 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31acd84-3925-4de3-8c77-ace0e51fd1a6 admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:42.746723 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-f31acd84-3925-4de3-8c77-ace0e51fd1a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:13:42.746952 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-9d783c92-190f-4682-9235-f2a38aa7f078 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f5a73454ddd44bb943d32e8d066f088'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:42.747478 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-9d783c92-190f-4682-9235-f2a38aa7f078 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f5a73454ddd44bb943d32e8d066f088'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:42.798042 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 932/1849] 10.222.0.36 () {58 vars in 1223 bytes} [Tue May 3 14:13:42 2022] DELETE /identity/v3/users/4f5a73454ddd44bb943d32e8d066f088 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 14:13:42.802523 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b831b2-107b-4387-9a68-ad0c66107951 None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:42.804388 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b831b2-107b-4387-9a68-ad0c66107951 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:42.804771 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b831b2-107b-4387-9a68-ad0c66107951 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:42.845847 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-40b831b2-107b-4387-9a68-ad0c66107951 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:13:42.847197 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-40b831b2-107b-4387-9a68-ad0c66107951 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:13:42.876983 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31acd84-3925-4de3-8c77-ace0e51fd1a6 admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:42.972169 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac19963-5dca-4e2e-b274-f808fe91a447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:42.972860 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac19963-5dca-4e2e-b274-f808fe91a447 admin admin] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:42.973135 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac19963-5dca-4e2e-b274-f808fe91a447 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:42.973442 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac19963-5dca-4e2e-b274-f808fe91a447 admin admin] PATH_INFO: `/v3/users` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:42.974404 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac19963-5dca-4e2e-b274-f808fe91a447 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:42.976790 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac19963-5dca-4e2e-b274-f808fe91a447 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:42.979438 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 933/1850] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:13:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:13:42.990156 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b831b2-107b-4387-9a68-ad0c66107951 None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:42.991671 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-40b831b2-107b-4387-9a68-ad0c66107951 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:13:43.000755 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 918/1851] 10.222.0.36 () {60 vars in 1143 bytes} [Tue May 3 14:13:42 2022] POST /identity/v3/users => generated 301 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 14:13:43.005329 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac19963-5dca-4e2e-b274-f808fe91a447 admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:43.018735 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac19963-5dca-4e2e-b274-f808fe91a447 admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:43.024471 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da02605e-3270-4b06-b22d-084f844ab022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:43.025320 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da02605e-3270-4b06-b22d-084f844ab022 admin admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:43.025618 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da02605e-3270-4b06-b22d-084f844ab022 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:43.025895 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da02605e-3270-4b06-b22d-084f844ab022 admin admin] PATH_INFO: `/v3/roles` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:43.026669 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da02605e-3270-4b06-b22d-084f844ab022 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:43.028254 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da02605e-3270-4b06-b22d-084f844ab022 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:43.039983 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 919/1852] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 3 14:13:43 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 14:13:43.043684 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da02605e-3270-4b06-b22d-084f844ab022 admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:43.059612 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da02605e-3270-4b06-b22d-084f844ab022 admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:43.067142 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec114e2-ec8a-4963-ac29-4beb80ec4721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:43.068838 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec114e2-ec8a-4963-ac29-4beb80ec4721 admin admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:43.069958 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec114e2-ec8a-4963-ac29-4beb80ec4721 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:43.070611 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec114e2-ec8a-4963-ac29-4beb80ec4721 admin admin] PATH_INFO: `/v3/roles` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:43.071541 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec114e2-ec8a-4963-ac29-4beb80ec4721 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:43.074630 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec114e2-ec8a-4963-ac29-4beb80ec4721 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:43.088770 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 920/1853] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 3 14:13:43 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 14:13:43.093807 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec114e2-ec8a-4963-ac29-4beb80ec4721 admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:43.107771 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec114e2-ec8a-4963-ac29-4beb80ec4721 admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:43.113806 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a3d5df-a131-4ae9-8728-0eaef16cf9e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:43.115840 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a3d5df-a131-4ae9-8728-0eaef16cf9e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:43.116487 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a3d5df-a131-4ae9-8728-0eaef16cf9e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:43.118185 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a3d5df-a131-4ae9-8728-0eaef16cf9e0 admin admin] PATH_INFO: `/v3/projects/760782ff1ea54af0bd90c5aeec9b46c4/users/912018de56b44bc4a79eb16ec9c59630/roles/441fdc11e95b47f4813f72610e39018b` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:43.125116 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b831b2-107b-4387-9a68-ad0c66107951 None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:43.129518 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2687c58b-cb38-4a02-a62c-675d9d42cd43 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '937bea4f355144b4a7ee11baabc3a4cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:43.130181 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2687c58b-cb38-4a02-a62c-675d9d42cd43 service neutron] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:43.130459 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2687c58b-cb38-4a02-a62c-675d9d42cd43 service neutron] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:43.130735 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2687c58b-cb38-4a02-a62c-675d9d42cd43 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:43.140192 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a3d5df-a131-4ae9-8728-0eaef16cf9e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=760782ff1ea54af0bd90c5aeec9b46c4, user_id=912018de56b44bc4a79eb16ec9c59630, role_id=441fdc11e95b47f4813f72610e39018b)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:43.151788 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2687c58b-cb38-4a02-a62c-675d9d42cd43 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:43.152456 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a3d5df-a131-4ae9-8728-0eaef16cf9e0 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:43.153246 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2687c58b-cb38-4a02-a62c-675d9d42cd43 service neutron] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:43.170066 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 934/1854] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:13:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 14:13:43.177461 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 921/1855] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 3 14:13:43 2022] PUT /identity/v3/projects/760782ff1ea54af0bd90c5aeec9b46c4/users/912018de56b44bc4a79eb16ec9c59630/roles/441fdc11e95b47f4813f72610e39018b => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:13:43.183189 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a17ae69-20c0-4d9b-8d91-2f60e05142c0 None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:43.183573 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a17ae69-20c0-4d9b-8d91-2f60e05142c0 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:43.183966 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a17ae69-20c0-4d9b-8d91-2f60e05142c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:43.214383 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-6a17ae69-20c0-4d9b-8d91-2f60e05142c0 None None] MFA Rules not processed for user `912018de56b44bc4a79eb16ec9c59630`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:13:43.215692 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-6a17ae69-20c0-4d9b-8d91-2f60e05142c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:13:43.331408 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 935/1856] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:13:43 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 14:13:43.336619 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a3d5df-a131-4ae9-8728-0eaef16cf9e0 admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:43.403292 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a3d5df-a131-4ae9-8728-0eaef16cf9e0 admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:43.408513 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691bfa01-ebb8-45d1-a193-0bc0b0b13119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:43.409180 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691bfa01-ebb8-45d1-a193-0bc0b0b13119 admin admin] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:43.409492 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691bfa01-ebb8-45d1-a193-0bc0b0b13119 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:43.409772 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691bfa01-ebb8-45d1-a193-0bc0b0b13119 admin admin] PATH_INFO: `/v3/projects` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:43.410476 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691bfa01-ebb8-45d1-a193-0bc0b0b13119 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:43.412454 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691bfa01-ebb8-45d1-a193-0bc0b0b13119 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:43.438358 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 922/1857] 10.222.0.36 () {60 vars in 1152 bytes} [Tue May 3 14:13:43 2022] POST /identity/v3/projects => generated 399 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 14:13:43.442378 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a17ae69-20c0-4d9b-8d91-2f60e05142c0 None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:43.452817 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a17ae69-20c0-4d9b-8d91-2f60e05142c0 None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:43.510820 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a235a82-c984-4cd8-8a2f-680abc4d0e0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:43.511693 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a235a82-c984-4cd8-8a2f-680abc4d0e0e admin admin] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:43.511987 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a235a82-c984-4cd8-8a2f-680abc4d0e0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:43.512233 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a235a82-c984-4cd8-8a2f-680abc4d0e0e admin admin] PATH_INFO: `/v3/users` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:43.512920 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a235a82-c984-4cd8-8a2f-680abc4d0e0e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:43.515362 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a235a82-c984-4cd8-8a2f-680abc4d0e0e admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:43.515498 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691bfa01-ebb8-45d1-a193-0bc0b0b13119 admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:43.517210 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-691bfa01-ebb8-45d1-a193-0bc0b0b13119 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:13:43.530361 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691bfa01-ebb8-45d1-a193-0bc0b0b13119 admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:43.535836 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99567a7-ee16-4b36-bfd8-26175dc5f984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:43.536748 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99567a7-ee16-4b36-bfd8-26175dc5f984 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:43.537028 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99567a7-ee16-4b36-bfd8-26175dc5f984 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:43.537313 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99567a7-ee16-4b36-bfd8-26175dc5f984 admin admin] PATH_INFO: `/v3/projects/b03ca0a925924649ab03aa6b75e68343` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:43.538543 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99567a7-ee16-4b36-bfd8-26175dc5f984 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b03ca0a925924649ab03aa6b75e68343)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:43.540491 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99567a7-ee16-4b36-bfd8-26175dc5f984 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:43.551829 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 936/1858] 10.222.0.36 () {60 vars in 1143 bytes} [Tue May 3 14:13:43 2022] POST /identity/v3/users => generated 306 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 14:13:43.556142 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a235a82-c984-4cd8-8a2f-680abc4d0e0e admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:43.566728 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a235a82-c984-4cd8-8a2f-680abc4d0e0e admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:43.571509 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655c5efe-37d6-4c5c-a2be-9456acaefa16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:43.572175 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655c5efe-37d6-4c5c-a2be-9456acaefa16 admin admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:43.572452 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655c5efe-37d6-4c5c-a2be-9456acaefa16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:43.572723 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655c5efe-37d6-4c5c-a2be-9456acaefa16 admin admin] PATH_INFO: `/v3/roles` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:43.573483 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655c5efe-37d6-4c5c-a2be-9456acaefa16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:43.575119 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655c5efe-37d6-4c5c-a2be-9456acaefa16 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:43.585474 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 937/1859] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 3 14:13:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 14:13:43.589804 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655c5efe-37d6-4c5c-a2be-9456acaefa16 admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:43.591829 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-d99567a7-ee16-4b36-bfd8-26175dc5f984 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b03ca0a925924649ab03aa6b75e68343', 'request_id': 'req-d99567a7-ee16-4b36-bfd8-26175dc5f984'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:43.598693 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-d99567a7-ee16-4b36-bfd8-26175dc5f984 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b03ca0a925924649ab03aa6b75e68343', 'request_id': 'req-d99567a7-ee16-4b36-bfd8-26175dc5f984'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:43.599677 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655c5efe-37d6-4c5c-a2be-9456acaefa16 admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:43.604121 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-d99567a7-ee16-4b36-bfd8-26175dc5f984 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b03ca0a925924649ab03aa6b75e68343', 'request_id': 'req-d99567a7-ee16-4b36-bfd8-26175dc5f984'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:43.617575 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-d99567a7-ee16-4b36-bfd8-26175dc5f984 admin admin] The token cache is being invalidate because project b03ca0a925924649ab03aa6b75e68343 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80012) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 14:13:43.617854 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-d99567a7-ee16-4b36-bfd8-26175dc5f984 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:43.618500 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-d99567a7-ee16-4b36-bfd8-26175dc5f984 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:43.620154 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 923/1860] 10.222.0.36 () {58 vars in 1232 bytes} [Tue May 3 14:13:43 2022] DELETE /identity/v3/projects/b03ca0a925924649ab03aa6b75e68343 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 14:13:43.624382 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99567a7-ee16-4b36-bfd8-26175dc5f984 admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:43.625773 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-d99567a7-ee16-4b36-bfd8-26175dc5f984 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:13:43.660007 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dae31b-6644-46e8-a1e7-3f60e31eeb50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:43.660908 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dae31b-6644-46e8-a1e7-3f60e31eeb50 admin admin] REQUEST_METHOD: `PUT` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:43.661209 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dae31b-6644-46e8-a1e7-3f60e31eeb50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:43.661677 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dae31b-6644-46e8-a1e7-3f60e31eeb50 admin admin] PATH_INFO: `/v3/projects/17a0998f8d8d4dd0b71f6b36e2e9d2d7/users/e55fb99f36cd4ffb921b4f380ba59409/roles/36abe9b50fd8479c86c4f8f70fd85aa3` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:43.676640 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dae31b-6644-46e8-a1e7-3f60e31eeb50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=17a0998f8d8d4dd0b71f6b36e2e9d2d7, user_id=e55fb99f36cd4ffb921b4f380ba59409, role_id=36abe9b50fd8479c86c4f8f70fd85aa3)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:43.679641 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dae31b-6644-46e8-a1e7-3f60e31eeb50 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:43.694743 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 938/1861] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 3 14:13:43 2022] PUT /identity/v3/projects/17a0998f8d8d4dd0b71f6b36e2e9d2d7/users/e55fb99f36cd4ffb921b4f380ba59409/roles/36abe9b50fd8479c86c4f8f70fd85aa3 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 14:13:43.698351 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dae31b-6644-46e8-a1e7-3f60e31eeb50 admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:43.699405 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99567a7-ee16-4b36-bfd8-26175dc5f984 admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:43.699986 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-49dae31b-6644-46e8-a1e7-3f60e31eeb50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:13:43.755882 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5a68c0-ebb0-4213-b334-48b153914c6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:43.756814 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5a68c0-ebb0-4213-b334-48b153914c6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:43.757217 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5a68c0-ebb0-4213-b334-48b153914c6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:43.757528 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5a68c0-ebb0-4213-b334-48b153914c6d admin admin] PATH_INFO: `/v3/users/c9a7876806ad4e40af84c8446b2898dc` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:43.758760 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5a68c0-ebb0-4213-b334-48b153914c6d admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9a7876806ad4e40af84c8446b2898dc)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:43.760732 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5a68c0-ebb0-4213-b334-48b153914c6d admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:43.764958 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dae31b-6644-46e8-a1e7-3f60e31eeb50 admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:43.770896 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d60ec2-12ff-4daa-9ae7-8352ed3bef28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:43.771640 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d60ec2-12ff-4daa-9ae7-8352ed3bef28 admin admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:43.771986 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d60ec2-12ff-4daa-9ae7-8352ed3bef28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:43.772337 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d60ec2-12ff-4daa-9ae7-8352ed3bef28 admin admin] PATH_INFO: `/v3/roles` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:43.773136 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d60ec2-12ff-4daa-9ae7-8352ed3bef28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:43.774828 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d60ec2-12ff-4daa-9ae7-8352ed3bef28 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:43.786586 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 939/1862] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 3 14:13:43 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 14:13:43.790829 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d60ec2-12ff-4daa-9ae7-8352ed3bef28 admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:43.803323 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d60ec2-12ff-4daa-9ae7-8352ed3bef28 admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:43.808245 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c224503-8fcd-4503-a7fd-0c70f3b53ded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:43.809136 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c224503-8fcd-4503-a7fd-0c70f3b53ded admin admin] REQUEST_METHOD: `PUT` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:43.809447 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c224503-8fcd-4503-a7fd-0c70f3b53ded admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:43.809719 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c224503-8fcd-4503-a7fd-0c70f3b53ded admin admin] PATH_INFO: `/v3/projects/17a0998f8d8d4dd0b71f6b36e2e9d2d7/users/e55fb99f36cd4ffb921b4f380ba59409/roles/36abe9b50fd8479c86c4f8f70fd85aa3` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:43.811358 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-ca5a68c0-ebb0-4213-b334-48b153914c6d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9a7876806ad4e40af84c8446b2898dc'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:43.812170 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c224503-8fcd-4503-a7fd-0c70f3b53ded admin admin] RBAC: Authorizing `identity:create_grant(project_id=17a0998f8d8d4dd0b71f6b36e2e9d2d7, user_id=e55fb99f36cd4ffb921b4f380ba59409, role_id=36abe9b50fd8479c86c4f8f70fd85aa3)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:43.814917 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c224503-8fcd-4503-a7fd-0c70f3b53ded admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:43.818797 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-ca5a68c0-ebb0-4213-b334-48b153914c6d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9a7876806ad4e40af84c8446b2898dc'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:43.819220 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-ca5a68c0-ebb0-4213-b334-48b153914c6d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9a7876806ad4e40af84c8446b2898dc'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:43.826605 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 940/1863] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 3 14:13:43 2022] PUT /identity/v3/projects/17a0998f8d8d4dd0b71f6b36e2e9d2d7/users/e55fb99f36cd4ffb921b4f380ba59409/roles/36abe9b50fd8479c86c4f8f70fd85aa3 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:13:43.837134 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c33193-bf96-4ef4-a57f-f74d6bdeea5a None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:43.837459 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c33193-bf96-4ef4-a57f-f74d6bdeea5a None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:43.837744 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c33193-bf96-4ef4-a57f-f74d6bdeea5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:43.838474 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-ca5a68c0-ebb0-4213-b334-48b153914c6d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9a7876806ad4e40af84c8446b2898dc'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:43.839202 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-ca5a68c0-ebb0-4213-b334-48b153914c6d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9a7876806ad4e40af84c8446b2898dc'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:43.853642 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 924/1864] 10.222.0.36 () {58 vars in 1223 bytes} [Tue May 3 14:13:43 2022] DELETE /identity/v3/users/c9a7876806ad4e40af84c8446b2898dc => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 14:13:43.867614 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-f4c33193-bf96-4ef4-a57f-f74d6bdeea5a None None] MFA Rules not processed for user `e55fb99f36cd4ffb921b4f380ba59409`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:13:43.868828 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-f4c33193-bf96-4ef4-a57f-f74d6bdeea5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:13:43.950692 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 941/1865] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:13:43 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 14:13:43.966519 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5a68c0-ebb0-4213-b334-48b153914c6d admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:43.968109 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-ca5a68c0-ebb0-4213-b334-48b153914c6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:13:44.034543 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5a68c0-ebb0-4213-b334-48b153914c6d admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:44.038591 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca004e6e-b451-4da8-8fe9-ec1c175c4e6c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b014f4c7ba1414cb8a597f5bc4033f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:44.039239 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca004e6e-b451-4da8-8fe9-ec1c175c4e6c service cinder] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:44.039520 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca004e6e-b451-4da8-8fe9-ec1c175c4e6c service cinder] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:44.039793 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca004e6e-b451-4da8-8fe9-ec1c175c4e6c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:44.054730 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca004e6e-b451-4da8-8fe9-ec1c175c4e6c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:44.056210 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca004e6e-b451-4da8-8fe9-ec1c175c4e6c service cinder] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:44.073566 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 925/1866] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:13:43 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 14:13:44.157395 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c33193-bf96-4ef4-a57f-f74d6bdeea5a None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:44.160264 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-f4c33193-bf96-4ef4-a57f-f74d6bdeea5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:13:44.174340 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c33193-bf96-4ef4-a57f-f74d6bdeea5a None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:44.179075 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911f9f21-c5bc-4e66-91c9-51b3c3acc30d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b014f4c7ba1414cb8a597f5bc4033f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:44.180073 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911f9f21-c5bc-4e66-91c9-51b3c3acc30d service cinder] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:44.180437 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911f9f21-c5bc-4e66-91c9-51b3c3acc30d service cinder] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:44.180851 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911f9f21-c5bc-4e66-91c9-51b3c3acc30d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:44.187539 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-911f9f21-c5bc-4e66-91c9-51b3c3acc30d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:13:44.233165 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca004e6e-b451-4da8-8fe9-ec1c175c4e6c service cinder] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:44.234781 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-ca004e6e-b451-4da8-8fe9-ec1c175c4e6c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:13:44.290881 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911f9f21-c5bc-4e66-91c9-51b3c3acc30d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:44.294901 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911f9f21-c5bc-4e66-91c9-51b3c3acc30d service cinder] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:44.305230 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 942/1867] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:13:44 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 14:13:44.319241 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca004e6e-b451-4da8-8fe9-ec1c175c4e6c service cinder] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:44.325754 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c6b518-6a3c-40f0-ab5a-6c208fa150fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:44.327013 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c6b518-6a3c-40f0-ab5a-6c208fa150fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:44.327377 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c6b518-6a3c-40f0-ab5a-6c208fa150fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:44.327726 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c6b518-6a3c-40f0-ab5a-6c208fa150fd admin admin] PATH_INFO: `/v3/projects/1cda940fa3e8405082ae69fa2f515ed0` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:44.329457 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c6b518-6a3c-40f0-ab5a-6c208fa150fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=1cda940fa3e8405082ae69fa2f515ed0)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:44.331500 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c6b518-6a3c-40f0-ab5a-6c208fa150fd admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:44.391339 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-24c6b518-6a3c-40f0-ab5a-6c208fa150fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1cda940fa3e8405082ae69fa2f515ed0', 'request_id': 'req-24c6b518-6a3c-40f0-ab5a-6c208fa150fd'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:44.400074 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-24c6b518-6a3c-40f0-ab5a-6c208fa150fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1cda940fa3e8405082ae69fa2f515ed0', 'request_id': 'req-24c6b518-6a3c-40f0-ab5a-6c208fa150fd'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:44.425516 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-24c6b518-6a3c-40f0-ab5a-6c208fa150fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1cda940fa3e8405082ae69fa2f515ed0', 'request_id': 'req-24c6b518-6a3c-40f0-ab5a-6c208fa150fd'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:44.443052 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-24c6b518-6a3c-40f0-ab5a-6c208fa150fd admin admin] The token cache is being invalidate because project 1cda940fa3e8405082ae69fa2f515ed0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80012) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 14:13:44.443750 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-24c6b518-6a3c-40f0-ab5a-6c208fa150fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:44.444730 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-24c6b518-6a3c-40f0-ab5a-6c208fa150fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:44.446603 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 926/1868] 10.222.0.36 () {58 vars in 1232 bytes} [Tue May 3 14:13:44 2022] DELETE /identity/v3/projects/1cda940fa3e8405082ae69fa2f515ed0 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 14:13:44.451925 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78290db-a3a5-4b0b-83b1-6b554fc87c08 None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:44.452925 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78290db-a3a5-4b0b-83b1-6b554fc87c08 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:44.453377 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78290db-a3a5-4b0b-83b1-6b554fc87c08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:44.480940 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-e78290db-a3a5-4b0b-83b1-6b554fc87c08 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:13:44.482537 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-e78290db-a3a5-4b0b-83b1-6b554fc87c08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:13:44.566289 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 943/1869] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:13:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:13:44.575912 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1c65a0-906a-4db7-88b1-657c05c2cc27 None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:44.575912 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1c65a0-906a-4db7-88b1-657c05c2cc27 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:44.575912 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1c65a0-906a-4db7-88b1-657c05c2cc27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:44.606259 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-ba1c65a0-906a-4db7-88b1-657c05c2cc27 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:13:44.608505 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-ba1c65a0-906a-4db7-88b1-657c05c2cc27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:13:44.624424 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 927/1870] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:13:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:13:44.625066 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78290db-a3a5-4b0b-83b1-6b554fc87c08 None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:44.635340 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78290db-a3a5-4b0b-83b1-6b554fc87c08 None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:44.644798 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4293b3d8-d0dd-4a8f-8ee7-2b1e86a18b5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:44.645614 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4293b3d8-d0dd-4a8f-8ee7-2b1e86a18b5f admin admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:44.645977 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4293b3d8-d0dd-4a8f-8ee7-2b1e86a18b5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:44.646257 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4293b3d8-d0dd-4a8f-8ee7-2b1e86a18b5f admin admin] PATH_INFO: `/v3/domains` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:44.647067 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4293b3d8-d0dd-4a8f-8ee7-2b1e86a18b5f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:13:44.647373 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4293b3d8-d0dd-4a8f-8ee7-2b1e86a18b5f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:44.649321 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4293b3d8-d0dd-4a8f-8ee7-2b1e86a18b5f admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:44.677275 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 944/1871] 10.222.0.36 () {58 vars in 1152 bytes} [Tue May 3 14:13:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 14:13:44.677833 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1c65a0-906a-4db7-88b1-657c05c2cc27 None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:44.689231 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1c65a0-906a-4db7-88b1-657c05c2cc27 None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:44.694594 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4789e3-0647-4192-8054-a4281bc7d308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:44.696110 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4789e3-0647-4192-8054-a4281bc7d308 admin admin] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:44.696440 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4789e3-0647-4192-8054-a4281bc7d308 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:44.696717 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4789e3-0647-4192-8054-a4281bc7d308 admin admin] PATH_INFO: `/v3/projects` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:44.697707 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4789e3-0647-4192-8054-a4281bc7d308 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:44.700681 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4789e3-0647-4192-8054-a4281bc7d308 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:44.706351 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4293b3d8-d0dd-4a8f-8ee7-2b1e86a18b5f admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:44.709221 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-4293b3d8-d0dd-4a8f-8ee7-2b1e86a18b5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:13:44.775252 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 928/1872] 10.222.0.36 () {60 vars in 1152 bytes} [Tue May 3 14:13:44 2022] POST /identity/v3/projects => generated 385 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 14:13:44.778183 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4789e3-0647-4192-8054-a4281bc7d308 admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:44.844572 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4293b3d8-d0dd-4a8f-8ee7-2b1e86a18b5f admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:44.893330 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4789e3-0647-4192-8054-a4281bc7d308 admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:44.907286 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b972d737-41b0-47a8-bc56-c748b2b191dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:44.909340 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b972d737-41b0-47a8-bc56-c748b2b191dc admin admin] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:44.911025 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b972d737-41b0-47a8-bc56-c748b2b191dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:44.911510 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b972d737-41b0-47a8-bc56-c748b2b191dc admin admin] PATH_INFO: `/v3/users` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:44.912512 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b972d737-41b0-47a8-bc56-c748b2b191dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:44.915861 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b972d737-41b0-47a8-bc56-c748b2b191dc admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:44.940557 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7044ca-315f-487c-8fbe-79afa6811116 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b014f4c7ba1414cb8a597f5bc4033f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:44.941542 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7044ca-315f-487c-8fbe-79afa6811116 service cinder] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:44.941916 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7044ca-315f-487c-8fbe-79afa6811116 service cinder] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:44.942129 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7044ca-315f-487c-8fbe-79afa6811116 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:44.944204 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-6c7044ca-315f-487c-8fbe-79afa6811116 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:13:44.958765 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 929/1873] 10.222.0.36 () {60 vars in 1143 bytes} [Tue May 3 14:13:44 2022] POST /identity/v3/users => generated 293 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 14:13:44.968682 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b972d737-41b0-47a8-bc56-c748b2b191dc admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:44.993975 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b972d737-41b0-47a8-bc56-c748b2b191dc admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:45.006690 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68536469-0bde-4452-9902-9403aa08fec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:45.007459 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68536469-0bde-4452-9902-9403aa08fec6 admin admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:45.007687 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68536469-0bde-4452-9902-9403aa08fec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:45.007974 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68536469-0bde-4452-9902-9403aa08fec6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:45.008901 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68536469-0bde-4452-9902-9403aa08fec6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:45.010437 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68536469-0bde-4452-9902-9403aa08fec6 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:45.033039 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 930/1874] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 3 14:13:44 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 14:13:45.034656 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68536469-0bde-4452-9902-9403aa08fec6 admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:45.046529 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68536469-0bde-4452-9902-9403aa08fec6 admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:45.047415 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7044ca-315f-487c-8fbe-79afa6811116 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:45.049200 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7044ca-315f-487c-8fbe-79afa6811116 service cinder] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:45.052135 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b05fddf-aa54-4981-b6ad-fdf5b40e883b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:45.053523 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b05fddf-aa54-4981-b6ad-fdf5b40e883b admin admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:45.053977 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b05fddf-aa54-4981-b6ad-fdf5b40e883b admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:45.054396 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b05fddf-aa54-4981-b6ad-fdf5b40e883b admin admin] PATH_INFO: `/v3/roles` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:45.055329 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b05fddf-aa54-4981-b6ad-fdf5b40e883b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:45.057489 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b05fddf-aa54-4981-b6ad-fdf5b40e883b admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:45.062868 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 945/1875] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:13:44 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 03 14:13:45.082804 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 931/1876] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 3 14:13:45 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 14:13:45.087056 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7044ca-315f-487c-8fbe-79afa6811116 service cinder] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:45.102918 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7044ca-315f-487c-8fbe-79afa6811116 service cinder] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:45.112832 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca630d3-db52-4bbc-ad5d-00e32b37f974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:45.113866 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca630d3-db52-4bbc-ad5d-00e32b37f974 admin admin] REQUEST_METHOD: `PUT` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:45.114212 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca630d3-db52-4bbc-ad5d-00e32b37f974 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:45.114548 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca630d3-db52-4bbc-ad5d-00e32b37f974 admin admin] PATH_INFO: `/v3/projects/cfd4ee93bbbb460680dd265e8da4a66f/users/b136cead7fcc464f88f3b77ca32ce268/roles/441fdc11e95b47f4813f72610e39018b` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:45.133597 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca630d3-db52-4bbc-ad5d-00e32b37f974 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfd4ee93bbbb460680dd265e8da4a66f, user_id=b136cead7fcc464f88f3b77ca32ce268, role_id=441fdc11e95b47f4813f72610e39018b)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:45.136591 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca630d3-db52-4bbc-ad5d-00e32b37f974 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:45.159399 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 946/1877] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 3 14:13:45 2022] PUT /identity/v3/projects/cfd4ee93bbbb460680dd265e8da4a66f/users/b136cead7fcc464f88f3b77ca32ce268/roles/441fdc11e95b47f4813f72610e39018b => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 14:13:45.172517 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502ae945-76b9-4b69-8829-6e09cdffae97 None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:45.172517 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502ae945-76b9-4b69-8829-6e09cdffae97 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:45.172517 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502ae945-76b9-4b69-8829-6e09cdffae97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:45.259335 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-502ae945-76b9-4b69-8829-6e09cdffae97 None None] MFA Rules not processed for user `b136cead7fcc464f88f3b77ca32ce268`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:13:45.260573 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-502ae945-76b9-4b69-8829-6e09cdffae97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:13:45.459798 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 932/1878] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:13:45 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 14:13:45.465105 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca630d3-db52-4bbc-ad5d-00e32b37f974 admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:45.560475 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca630d3-db52-4bbc-ad5d-00e32b37f974 admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:45.568005 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2459088b-8cfc-48f8-912b-5621188cc1f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:45.568776 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2459088b-8cfc-48f8-912b-5621188cc1f5 admin admin] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:45.569220 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2459088b-8cfc-48f8-912b-5621188cc1f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:45.569600 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2459088b-8cfc-48f8-912b-5621188cc1f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:45.571322 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2459088b-8cfc-48f8-912b-5621188cc1f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:45.574646 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2459088b-8cfc-48f8-912b-5621188cc1f5 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:45.619325 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 947/1879] 10.222.0.36 () {60 vars in 1152 bytes} [Tue May 3 14:13:45 2022] POST /identity/v3/projects => generated 385 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 14:13:45.625358 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502ae945-76b9-4b69-8829-6e09cdffae97 None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:45.626380 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2459088b-8cfc-48f8-912b-5621188cc1f5 admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:45.629425 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-2459088b-8cfc-48f8-912b-5621188cc1f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:13:45.654800 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502ae945-76b9-4b69-8829-6e09cdffae97 None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:45.744430 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2459088b-8cfc-48f8-912b-5621188cc1f5 admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:45.750859 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240521ac-fb90-4db3-88eb-9dea67920875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:45.761863 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240521ac-fb90-4db3-88eb-9dea67920875 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:45.762374 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240521ac-fb90-4db3-88eb-9dea67920875 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:45.763217 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240521ac-fb90-4db3-88eb-9dea67920875 admin admin] PATH_INFO: `/v3/users/67ab8927d0e144ebb147ab9e3039f28d` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:45.766730 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240521ac-fb90-4db3-88eb-9dea67920875 admin admin] RBAC: Authorizing `identity:delete_user(user_id=67ab8927d0e144ebb147ab9e3039f28d)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:45.768649 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240521ac-fb90-4db3-88eb-9dea67920875 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:45.859251 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0f990c-9a9e-4f41-9a30-fc4708847b3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:45.859947 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0f990c-9a9e-4f41-9a30-fc4708847b3a admin admin] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:45.860240 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0f990c-9a9e-4f41-9a30-fc4708847b3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:45.860498 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0f990c-9a9e-4f41-9a30-fc4708847b3a admin admin] PATH_INFO: `/v3/users` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:45.861200 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0f990c-9a9e-4f41-9a30-fc4708847b3a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:45.863167 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0f990c-9a9e-4f41-9a30-fc4708847b3a admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:45.894803 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-240521ac-fb90-4db3-88eb-9dea67920875 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67ab8927d0e144ebb147ab9e3039f28d'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:45.906946 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-240521ac-fb90-4db3-88eb-9dea67920875 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67ab8927d0e144ebb147ab9e3039f28d'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:45.907876 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-240521ac-fb90-4db3-88eb-9dea67920875 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67ab8927d0e144ebb147ab9e3039f28d'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:45.908808 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 933/1880] 10.222.0.36 () {60 vars in 1143 bytes} [Tue May 3 14:13:45 2022] POST /identity/v3/users => generated 299 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 14:13:45.912457 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0f990c-9a9e-4f41-9a30-fc4708847b3a admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:45.915903 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-5a0f990c-9a9e-4f41-9a30-fc4708847b3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:13:45.936067 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-240521ac-fb90-4db3-88eb-9dea67920875 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67ab8927d0e144ebb147ab9e3039f28d'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:45.941680 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-240521ac-fb90-4db3-88eb-9dea67920875 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67ab8927d0e144ebb147ab9e3039f28d'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:45.953644 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0f990c-9a9e-4f41-9a30-fc4708847b3a admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:45.968537 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 948/1881] 10.222.0.36 () {58 vars in 1223 bytes} [Tue May 3 14:13:45 2022] DELETE /identity/v3/users/67ab8927d0e144ebb147ab9e3039f28d => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:13:45.972510 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfc6efd-8867-415e-9a99-cb5214db7198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:45.973319 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfc6efd-8867-415e-9a99-cb5214db7198 admin admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:45.973688 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfc6efd-8867-415e-9a99-cb5214db7198 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:45.974022 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a137915a-a00c-4426-8743-b508fa91f4a9 None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:45.974126 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfc6efd-8867-415e-9a99-cb5214db7198 admin admin] PATH_INFO: `/v3/roles` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:45.974653 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a137915a-a00c-4426-8743-b508fa91f4a9 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:45.974922 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfc6efd-8867-415e-9a99-cb5214db7198 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:45.975330 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a137915a-a00c-4426-8743-b508fa91f4a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:45.978375 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfc6efd-8867-415e-9a99-cb5214db7198 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:46.004439 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 934/1882] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 3 14:13:45 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 14:13:46.008802 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfc6efd-8867-415e-9a99-cb5214db7198 admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:46.015735 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-a137915a-a00c-4426-8743-b508fa91f4a9 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:13:46.017147 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-a137915a-a00c-4426-8743-b508fa91f4a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:13:46.024766 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfc6efd-8867-415e-9a99-cb5214db7198 admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:46.128179 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e67a19-1856-444c-95ce-827deb1e8f10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:46.129099 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e67a19-1856-444c-95ce-827deb1e8f10 admin admin] REQUEST_METHOD: `PUT` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:46.129409 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e67a19-1856-444c-95ce-827deb1e8f10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:46.129686 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e67a19-1856-444c-95ce-827deb1e8f10 admin admin] PATH_INFO: `/v3/projects/13180f80ea9a4a8ebedeeb4f956d0a99/users/b6ada335a1b24af18a76f29b6cc1bbf9/roles/36abe9b50fd8479c86c4f8f70fd85aa3` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:46.164572 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e67a19-1856-444c-95ce-827deb1e8f10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=13180f80ea9a4a8ebedeeb4f956d0a99, user_id=b6ada335a1b24af18a76f29b6cc1bbf9, role_id=36abe9b50fd8479c86c4f8f70fd85aa3)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:46.168455 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e67a19-1856-444c-95ce-827deb1e8f10 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:46.180723 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 949/1883] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:13:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:13:46.183281 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 935/1884] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 3 14:13:46 2022] PUT /identity/v3/projects/13180f80ea9a4a8ebedeeb4f956d0a99/users/b6ada335a1b24af18a76f29b6cc1bbf9/roles/36abe9b50fd8479c86c4f8f70fd85aa3 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 14:13:46.188085 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a137915a-a00c-4426-8743-b508fa91f4a9 None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:46.192149 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e67a19-1856-444c-95ce-827deb1e8f10 admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:46.194039 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-f5e67a19-1856-444c-95ce-827deb1e8f10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:13:46.198576 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a137915a-a00c-4426-8743-b508fa91f4a9 None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:46.260855 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e67a19-1856-444c-95ce-827deb1e8f10 admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:46.267232 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9418614-7c70-405a-aeae-252a585c5330 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '937bea4f355144b4a7ee11baabc3a4cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:46.268246 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9418614-7c70-405a-aeae-252a585c5330 service neutron] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:46.268724 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9418614-7c70-405a-aeae-252a585c5330 service neutron] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:46.269198 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9418614-7c70-405a-aeae-252a585c5330 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:46.272802 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370f525d-861b-4184-b0ae-8a079a5fd1ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:46.273608 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370f525d-861b-4184-b0ae-8a079a5fd1ca admin admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:46.273900 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370f525d-861b-4184-b0ae-8a079a5fd1ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:46.274266 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370f525d-861b-4184-b0ae-8a079a5fd1ca admin admin] PATH_INFO: `/v3/roles` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:46.275047 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370f525d-861b-4184-b0ae-8a079a5fd1ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:46.276686 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370f525d-861b-4184-b0ae-8a079a5fd1ca admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:46.284079 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9418614-7c70-405a-aeae-252a585c5330 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:46.285850 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9418614-7c70-405a-aeae-252a585c5330 service neutron] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:46.301551 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 950/1885] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 3 14:13:46 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 14:13:46.302587 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370f525d-861b-4184-b0ae-8a079a5fd1ca admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:46.316887 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 936/1886] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:13:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 03 14:13:46.339973 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370f525d-861b-4184-b0ae-8a079a5fd1ca admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:46.346262 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7190ca-78a4-4579-a19a-a9f7e30c0bd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:46.347403 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7190ca-78a4-4579-a19a-a9f7e30c0bd1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:46.347833 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7190ca-78a4-4579-a19a-a9f7e30c0bd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:46.348325 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7190ca-78a4-4579-a19a-a9f7e30c0bd1 admin admin] PATH_INFO: `/v3/projects/13180f80ea9a4a8ebedeeb4f956d0a99/users/b6ada335a1b24af18a76f29b6cc1bbf9/roles/36abe9b50fd8479c86c4f8f70fd85aa3` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:46.350447 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7190ca-78a4-4579-a19a-a9f7e30c0bd1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=13180f80ea9a4a8ebedeeb4f956d0a99, user_id=b6ada335a1b24af18a76f29b6cc1bbf9, role_id=36abe9b50fd8479c86c4f8f70fd85aa3)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:46.354011 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7190ca-78a4-4579-a19a-a9f7e30c0bd1 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:46.372082 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 951/1887] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 3 14:13:46 2022] PUT /identity/v3/projects/13180f80ea9a4a8ebedeeb4f956d0a99/users/b6ada335a1b24af18a76f29b6cc1bbf9/roles/36abe9b50fd8479c86c4f8f70fd85aa3 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:13:46.382438 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca23d77-129a-471e-bf81-8ef494c5d362 None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:46.382787 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca23d77-129a-471e-bf81-8ef494c5d362 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:46.383133 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca23d77-129a-471e-bf81-8ef494c5d362 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:46.422445 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-bca23d77-129a-471e-bf81-8ef494c5d362 None None] MFA Rules not processed for user `b6ada335a1b24af18a76f29b6cc1bbf9`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:13:46.424300 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-bca23d77-129a-471e-bf81-8ef494c5d362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:13:46.562276 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 937/1888] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:13:46 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:13:46.575842 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7190ca-78a4-4579-a19a-a9f7e30c0bd1 admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:46.578402 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-6c7190ca-78a4-4579-a19a-a9f7e30c0bd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:13:46.645219 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7190ca-78a4-4579-a19a-a9f7e30c0bd1 admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:46.648866 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92622ea-6b23-4fb4-84c3-1fb7342202c7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b014f4c7ba1414cb8a597f5bc4033f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:46.649549 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92622ea-6b23-4fb4-84c3-1fb7342202c7 service cinder] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:46.649828 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92622ea-6b23-4fb4-84c3-1fb7342202c7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:46.650108 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92622ea-6b23-4fb4-84c3-1fb7342202c7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:46.659437 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92622ea-6b23-4fb4-84c3-1fb7342202c7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:46.660864 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92622ea-6b23-4fb4-84c3-1fb7342202c7 service cinder] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:46.671200 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 952/1889] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:13:46 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 03 14:13:46.700541 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca23d77-129a-471e-bf81-8ef494c5d362 None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:46.704739 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92622ea-6b23-4fb4-84c3-1fb7342202c7 service cinder] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:46.706657 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-b92622ea-6b23-4fb4-84c3-1fb7342202c7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:13:46.779623 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca23d77-129a-471e-bf81-8ef494c5d362 None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:46.784717 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7473e868-2a8d-42e8-a5fe-1f92defeaa27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:46.785783 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7473e868-2a8d-42e8-a5fe-1f92defeaa27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:46.786130 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7473e868-2a8d-42e8-a5fe-1f92defeaa27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:46.786467 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7473e868-2a8d-42e8-a5fe-1f92defeaa27 admin admin] PATH_INFO: `/v3/users/b136cead7fcc464f88f3b77ca32ce268` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:46.787736 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7473e868-2a8d-42e8-a5fe-1f92defeaa27 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b136cead7fcc464f88f3b77ca32ce268)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:46.789770 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7473e868-2a8d-42e8-a5fe-1f92defeaa27 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:46.793796 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92622ea-6b23-4fb4-84c3-1fb7342202c7 service cinder] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:46.799894 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45caa77d-1861-40ff-ba8a-9a99adfe7f09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:46.800765 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45caa77d-1861-40ff-ba8a-9a99adfe7f09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:46.801041 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45caa77d-1861-40ff-ba8a-9a99adfe7f09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:46.801333 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45caa77d-1861-40ff-ba8a-9a99adfe7f09 admin admin] PATH_INFO: `/v3/projects/92a459fde9a64e15836f3d5f781af46c` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:46.802520 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45caa77d-1861-40ff-ba8a-9a99adfe7f09 admin admin] RBAC: Authorizing `identity:delete_project(project_id=92a459fde9a64e15836f3d5f781af46c)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:46.804426 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45caa77d-1861-40ff-ba8a-9a99adfe7f09 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:46.848926 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-7473e868-2a8d-42e8-a5fe-1f92defeaa27 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b136cead7fcc464f88f3b77ca32ce268'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:46.857060 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-7473e868-2a8d-42e8-a5fe-1f92defeaa27 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b136cead7fcc464f88f3b77ca32ce268'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:46.858395 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-7473e868-2a8d-42e8-a5fe-1f92defeaa27 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b136cead7fcc464f88f3b77ca32ce268'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:46.871808 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-7473e868-2a8d-42e8-a5fe-1f92defeaa27 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b136cead7fcc464f88f3b77ca32ce268'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:46.872509 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-7473e868-2a8d-42e8-a5fe-1f92defeaa27 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b136cead7fcc464f88f3b77ca32ce268'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:46.888191 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-45caa77d-1861-40ff-ba8a-9a99adfe7f09 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92a459fde9a64e15836f3d5f781af46c', 'request_id': 'req-45caa77d-1861-40ff-ba8a-9a99adfe7f09'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:46.892058 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 938/1890] 10.222.0.36 () {58 vars in 1223 bytes} [Tue May 3 14:13:46 2022] DELETE /identity/v3/users/b136cead7fcc464f88f3b77ca32ce268 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:13:46.896205 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6dbba7-449d-4cc3-8249-f5691997b726 None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:46.896721 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6dbba7-449d-4cc3-8249-f5691997b726 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:46.896828 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6dbba7-449d-4cc3-8249-f5691997b726 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:46.903930 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-45caa77d-1861-40ff-ba8a-9a99adfe7f09 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92a459fde9a64e15836f3d5f781af46c', 'request_id': 'req-45caa77d-1861-40ff-ba8a-9a99adfe7f09'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:46.916200 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-45caa77d-1861-40ff-ba8a-9a99adfe7f09 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92a459fde9a64e15836f3d5f781af46c', 'request_id': 'req-45caa77d-1861-40ff-ba8a-9a99adfe7f09'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:46.918679 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-4a6dbba7-449d-4cc3-8249-f5691997b726 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:13:46.919979 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-4a6dbba7-449d-4cc3-8249-f5691997b726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:13:46.933122 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-45caa77d-1861-40ff-ba8a-9a99adfe7f09 admin admin] The token cache is being invalidate because project 92a459fde9a64e15836f3d5f781af46c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80013) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 14:13:46.933534 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-45caa77d-1861-40ff-ba8a-9a99adfe7f09 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:46.934557 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-45caa77d-1861-40ff-ba8a-9a99adfe7f09 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:46.939797 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 953/1891] 10.222.0.36 () {58 vars in 1232 bytes} [Tue May 3 14:13:46 2022] DELETE /identity/v3/projects/92a459fde9a64e15836f3d5f781af46c => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:13:46.940893 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45caa77d-1861-40ff-ba8a-9a99adfe7f09 admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:46.943077 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-45caa77d-1861-40ff-ba8a-9a99adfe7f09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:13:46.994430 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 939/1892] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:13:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 14:13:47.004896 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6dbba7-449d-4cc3-8249-f5691997b726 None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:47.006454 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-4a6dbba7-449d-4cc3-8249-f5691997b726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:13:47.018806 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45caa77d-1861-40ff-ba8a-9a99adfe7f09 admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:47.023613 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd3638d-7ea3-47d5-bf2b-da516f224363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:47.024500 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd3638d-7ea3-47d5-bf2b-da516f224363 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:47.024777 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd3638d-7ea3-47d5-bf2b-da516f224363 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:47.025051 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd3638d-7ea3-47d5-bf2b-da516f224363 admin admin] PATH_INFO: `/v3/users/1c26a964ca614634ab42054d8bcf0637` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:47.026351 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd3638d-7ea3-47d5-bf2b-da516f224363 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c26a964ca614634ab42054d8bcf0637)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:47.028305 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd3638d-7ea3-47d5-bf2b-da516f224363 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:47.061754 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6dbba7-449d-4cc3-8249-f5691997b726 None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:47.065651 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abeb1d1-9541-42e2-b635-a1c41fae5ac6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '937bea4f355144b4a7ee11baabc3a4cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:47.066189 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abeb1d1-9541-42e2-b635-a1c41fae5ac6 service neutron] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:47.066470 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abeb1d1-9541-42e2-b635-a1c41fae5ac6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:47.066741 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abeb1d1-9541-42e2-b635-a1c41fae5ac6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:47.076698 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abeb1d1-9541-42e2-b635-a1c41fae5ac6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:47.077455 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-cdd3638d-7ea3-47d5-bf2b-da516f224363 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c26a964ca614634ab42054d8bcf0637'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:47.078385 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abeb1d1-9541-42e2-b635-a1c41fae5ac6 service neutron] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:47.083908 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-cdd3638d-7ea3-47d5-bf2b-da516f224363 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c26a964ca614634ab42054d8bcf0637'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:47.084579 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-cdd3638d-7ea3-47d5-bf2b-da516f224363 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c26a964ca614634ab42054d8bcf0637'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:47.088164 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 940/1893] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:13:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 03 14:13:47.093312 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-cdd3638d-7ea3-47d5-bf2b-da516f224363 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c26a964ca614634ab42054d8bcf0637'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:47.094010 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-cdd3638d-7ea3-47d5-bf2b-da516f224363 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c26a964ca614634ab42054d8bcf0637'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:47.111663 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 954/1894] 10.222.0.36 () {58 vars in 1223 bytes} [Tue May 3 14:13:46 2022] DELETE /identity/v3/users/1c26a964ca614634ab42054d8bcf0637 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:13:47.412108 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abeb1d1-9541-42e2-b635-a1c41fae5ac6 service neutron] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:47.413649 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-1abeb1d1-9541-42e2-b635-a1c41fae5ac6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:13:47.426561 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abeb1d1-9541-42e2-b635-a1c41fae5ac6 service neutron] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:47.472611 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd3638d-7ea3-47d5-bf2b-da516f224363 admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:47.474157 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-cdd3638d-7ea3-47d5-bf2b-da516f224363 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:13:47.496292 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fdebd0-a297-4e7b-a0b1-d325982d6770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:47.497584 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fdebd0-a297-4e7b-a0b1-d325982d6770 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:47.497748 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fdebd0-a297-4e7b-a0b1-d325982d6770 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:47.498024 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fdebd0-a297-4e7b-a0b1-d325982d6770 admin admin] PATH_INFO: `/v3/projects/cfd4ee93bbbb460680dd265e8da4a66f` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:47.499783 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fdebd0-a297-4e7b-a0b1-d325982d6770 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cfd4ee93bbbb460680dd265e8da4a66f)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:47.501988 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fdebd0-a297-4e7b-a0b1-d325982d6770 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:47.541075 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd3638d-7ea3-47d5-bf2b-da516f224363 admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:47.550274 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-93fdebd0-a297-4e7b-a0b1-d325982d6770 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cfd4ee93bbbb460680dd265e8da4a66f', 'request_id': 'req-93fdebd0-a297-4e7b-a0b1-d325982d6770'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:47.556281 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-93fdebd0-a297-4e7b-a0b1-d325982d6770 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cfd4ee93bbbb460680dd265e8da4a66f', 'request_id': 'req-93fdebd0-a297-4e7b-a0b1-d325982d6770'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:47.562370 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-93fdebd0-a297-4e7b-a0b1-d325982d6770 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cfd4ee93bbbb460680dd265e8da4a66f', 'request_id': 'req-93fdebd0-a297-4e7b-a0b1-d325982d6770'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:47.576129 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-93fdebd0-a297-4e7b-a0b1-d325982d6770 admin admin] The token cache is being invalidate because project cfd4ee93bbbb460680dd265e8da4a66f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80012) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 14:13:47.576448 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-93fdebd0-a297-4e7b-a0b1-d325982d6770 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:47.577074 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-93fdebd0-a297-4e7b-a0b1-d325982d6770 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:47.579648 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 941/1895] 10.222.0.36 () {58 vars in 1232 bytes} [Tue May 3 14:13:47 2022] DELETE /identity/v3/projects/cfd4ee93bbbb460680dd265e8da4a66f => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:13:47.584268 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fdebd0-a297-4e7b-a0b1-d325982d6770 admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:47.590266 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-93fdebd0-a297-4e7b-a0b1-d325982d6770 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:13:47.598794 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d97b31-62b8-4d0c-b554-d906bc9812c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:47.599664 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d97b31-62b8-4d0c-b554-d906bc9812c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:47.599954 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d97b31-62b8-4d0c-b554-d906bc9812c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:47.601585 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d97b31-62b8-4d0c-b554-d906bc9812c6 admin admin] PATH_INFO: `/v3/projects/c4b84e786368422b8ad5abf54f8951ea` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:47.601585 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d97b31-62b8-4d0c-b554-d906bc9812c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4b84e786368422b8ad5abf54f8951ea)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:47.603304 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d97b31-62b8-4d0c-b554-d906bc9812c6 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:47.653821 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-82d97b31-62b8-4d0c-b554-d906bc9812c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4b84e786368422b8ad5abf54f8951ea', 'request_id': 'req-82d97b31-62b8-4d0c-b554-d906bc9812c6'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:47.661557 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-82d97b31-62b8-4d0c-b554-d906bc9812c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4b84e786368422b8ad5abf54f8951ea', 'request_id': 'req-82d97b31-62b8-4d0c-b554-d906bc9812c6'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:47.671200 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-82d97b31-62b8-4d0c-b554-d906bc9812c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4b84e786368422b8ad5abf54f8951ea', 'request_id': 'req-82d97b31-62b8-4d0c-b554-d906bc9812c6'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:47.678935 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fdebd0-a297-4e7b-a0b1-d325982d6770 admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:47.684836 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-82d97b31-62b8-4d0c-b554-d906bc9812c6 admin admin] The token cache is being invalidate because project c4b84e786368422b8ad5abf54f8951ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80013) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 14:13:47.685239 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-82d97b31-62b8-4d0c-b554-d906bc9812c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:47.686584 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-82d97b31-62b8-4d0c-b554-d906bc9812c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:47.688612 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 955/1896] 10.222.0.36 () {58 vars in 1232 bytes} [Tue May 3 14:13:47 2022] DELETE /identity/v3/projects/c4b84e786368422b8ad5abf54f8951ea => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 14:13:47.693322 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ed703c-4d84-450e-94f8-3f854de708fb None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:47.693748 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ed703c-4d84-450e-94f8-3f854de708fb None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:47.694125 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ed703c-4d84-450e-94f8-3f854de708fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:47.714909 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-a8ed703c-4d84-450e-94f8-3f854de708fb None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:13:47.718058 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-a8ed703c-4d84-450e-94f8-3f854de708fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:13:47.760038 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfa621c-a94b-4b9f-a960-31e9a47aaead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:47.761059 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfa621c-a94b-4b9f-a960-31e9a47aaead admin admin] REQUEST_METHOD: `DELETE` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:47.761365 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfa621c-a94b-4b9f-a960-31e9a47aaead admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:47.761640 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfa621c-a94b-4b9f-a960-31e9a47aaead admin admin] PATH_INFO: `/v3/users/b6ada335a1b24af18a76f29b6cc1bbf9` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:47.762873 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfa621c-a94b-4b9f-a960-31e9a47aaead admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6ada335a1b24af18a76f29b6cc1bbf9)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:47.766005 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfa621c-a94b-4b9f-a960-31e9a47aaead admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:47.820175 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 956/1897] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:13:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 14:13:47.821878 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-0cfa621c-a94b-4b9f-a960-31e9a47aaead admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6ada335a1b24af18a76f29b6cc1bbf9'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:47.822171 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8e3273-2c5d-4faa-b48a-e7d0ebc80063 None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:47.822448 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8e3273-2c5d-4faa-b48a-e7d0ebc80063 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:47.822764 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8e3273-2c5d-4faa-b48a-e7d0ebc80063 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:47.828773 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-0cfa621c-a94b-4b9f-a960-31e9a47aaead admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6ada335a1b24af18a76f29b6cc1bbf9'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:47.829564 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-0cfa621c-a94b-4b9f-a960-31e9a47aaead admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6ada335a1b24af18a76f29b6cc1bbf9'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:47.842363 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-4d8e3273-2c5d-4faa-b48a-e7d0ebc80063 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:13:47.842820 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-0cfa621c-a94b-4b9f-a960-31e9a47aaead admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6ada335a1b24af18a76f29b6cc1bbf9'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:47.843487 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-4d8e3273-2c5d-4faa-b48a-e7d0ebc80063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:13:47.843601 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-0cfa621c-a94b-4b9f-a960-31e9a47aaead admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6ada335a1b24af18a76f29b6cc1bbf9'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:47.857758 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 957/1898] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:13:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:13:47.861890 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8e3273-2c5d-4faa-b48a-e7d0ebc80063 None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:47.863264 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 942/1899] 10.222.0.36 () {58 vars in 1223 bytes} [Tue May 3 14:13:47 2022] DELETE /identity/v3/users/b6ada335a1b24af18a76f29b6cc1bbf9 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:13:47.871973 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8e3273-2c5d-4faa-b48a-e7d0ebc80063 None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:47.928036 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d896edc-370a-4c0d-98c2-94b8741d04a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:47.928705 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d896edc-370a-4c0d-98c2-94b8741d04a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:47.928985 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d896edc-370a-4c0d-98c2-94b8741d04a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:47.929258 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d896edc-370a-4c0d-98c2-94b8741d04a2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:47.930025 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d896edc-370a-4c0d-98c2-94b8741d04a2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:13:47.930389 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d896edc-370a-4c0d-98c2-94b8741d04a2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:47.931960 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d896edc-370a-4c0d-98c2-94b8741d04a2 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:47.943495 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 958/1900] 10.222.0.36 () {58 vars in 1152 bytes} [Tue May 3 14:13:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 14:13:47.948063 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfa621c-a94b-4b9f-a960-31e9a47aaead admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:47.958188 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfa621c-a94b-4b9f-a960-31e9a47aaead admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:47.963327 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fb0617-602f-489e-98d2-af4d883031bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:47.963969 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fb0617-602f-489e-98d2-af4d883031bd admin admin] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:47.964249 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fb0617-602f-489e-98d2-af4d883031bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:47.964523 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fb0617-602f-489e-98d2-af4d883031bd admin admin] PATH_INFO: `/v3/projects` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:47.965241 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fb0617-602f-489e-98d2-af4d883031bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:47.967299 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fb0617-602f-489e-98d2-af4d883031bd admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:48.006841 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 943/1901] 10.222.0.36 () {60 vars in 1152 bytes} [Tue May 3 14:13:47 2022] POST /identity/v3/projects => generated 377 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 14:13:48.011037 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d896edc-370a-4c0d-98c2-94b8741d04a2 admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:48.023455 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d896edc-370a-4c0d-98c2-94b8741d04a2 admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:48.095998 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b007a45-d63f-4a66-a9b4-5880fb7e3805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:48.096675 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b007a45-d63f-4a66-a9b4-5880fb7e3805 admin admin] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:48.096950 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b007a45-d63f-4a66-a9b4-5880fb7e3805 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:48.097219 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b007a45-d63f-4a66-a9b4-5880fb7e3805 admin admin] PATH_INFO: `/v3/users` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:48.098798 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b007a45-d63f-4a66-a9b4-5880fb7e3805 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:48.100143 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b007a45-d63f-4a66-a9b4-5880fb7e3805 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:48.129194 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 959/1902] 10.222.0.36 () {60 vars in 1143 bytes} [Tue May 3 14:13:48 2022] POST /identity/v3/users => generated 289 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 14:13:48.130488 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fb0617-602f-489e-98d2-af4d883031bd admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:48.141523 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fb0617-602f-489e-98d2-af4d883031bd admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:48.146486 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f8c410-1077-4a60-9311-0be2eb32a7aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:48.147154 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f8c410-1077-4a60-9311-0be2eb32a7aa admin admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:48.147437 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f8c410-1077-4a60-9311-0be2eb32a7aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:48.147709 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f8c410-1077-4a60-9311-0be2eb32a7aa admin admin] PATH_INFO: `/v3/roles` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:48.148438 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f8c410-1077-4a60-9311-0be2eb32a7aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:48.150082 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f8c410-1077-4a60-9311-0be2eb32a7aa admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:48.161582 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 944/1903] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 3 14:13:48 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 14:13:48.166587 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b007a45-d63f-4a66-a9b4-5880fb7e3805 admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:48.180949 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b007a45-d63f-4a66-a9b4-5880fb7e3805 admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:48.188155 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a0ed13-5979-4345-9a1c-9aa651a3ccee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:48.188920 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a0ed13-5979-4345-9a1c-9aa651a3ccee admin admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:48.189622 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a0ed13-5979-4345-9a1c-9aa651a3ccee admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:48.190148 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a0ed13-5979-4345-9a1c-9aa651a3ccee admin admin] PATH_INFO: `/v3/roles` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:48.190922 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a0ed13-5979-4345-9a1c-9aa651a3ccee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:48.192743 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a0ed13-5979-4345-9a1c-9aa651a3ccee admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:48.210219 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 960/1904] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 3 14:13:48 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 14:13:48.214224 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f8c410-1077-4a60-9311-0be2eb32a7aa admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:48.236359 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f8c410-1077-4a60-9311-0be2eb32a7aa admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:48.245326 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50318da-a11f-4921-bb39-4e2e414d222b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:48.247130 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50318da-a11f-4921-bb39-4e2e414d222b admin admin] REQUEST_METHOD: `PUT` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:48.247706 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50318da-a11f-4921-bb39-4e2e414d222b admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:48.248223 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50318da-a11f-4921-bb39-4e2e414d222b admin admin] PATH_INFO: `/v3/projects/a9fdda0cde02440c91c1fa1b6a01b732/users/5548b72c4cac4c35a5455b66c678c7de/roles/441fdc11e95b47f4813f72610e39018b` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:48.255609 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a0ed13-5979-4345-9a1c-9aa651a3ccee admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:48.257600 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-54a0ed13-5979-4345-9a1c-9aa651a3ccee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:13:48.273410 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a0ed13-5979-4345-9a1c-9aa651a3ccee admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:48.277123 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50318da-a11f-4921-bb39-4e2e414d222b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9fdda0cde02440c91c1fa1b6a01b732, user_id=5548b72c4cac4c35a5455b66c678c7de, role_id=441fdc11e95b47f4813f72610e39018b)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:48.280236 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50318da-a11f-4921-bb39-4e2e414d222b admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:48.284415 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e4d16d-79e4-41cf-920a-3e00773ebe21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:48.285689 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e4d16d-79e4-41cf-920a-3e00773ebe21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:48.286104 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e4d16d-79e4-41cf-920a-3e00773ebe21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:48.286483 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e4d16d-79e4-41cf-920a-3e00773ebe21 admin admin] PATH_INFO: `/v3/projects/13180f80ea9a4a8ebedeeb4f956d0a99` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:48.287719 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e4d16d-79e4-41cf-920a-3e00773ebe21 admin admin] RBAC: Authorizing `identity:delete_project(project_id=13180f80ea9a4a8ebedeeb4f956d0a99)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:48.296933 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 945/1905] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 3 14:13:48 2022] PUT /identity/v3/projects/a9fdda0cde02440c91c1fa1b6a01b732/users/5548b72c4cac4c35a5455b66c678c7de/roles/441fdc11e95b47f4813f72610e39018b => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:13:48.298539 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e4d16d-79e4-41cf-920a-3e00773ebe21 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:48.307209 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08da817a-d04f-401f-b215-5a65d1025fad None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:48.307811 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08da817a-d04f-401f-b215-5a65d1025fad None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:48.308093 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08da817a-d04f-401f-b215-5a65d1025fad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:48.337931 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-08da817a-d04f-401f-b215-5a65d1025fad None None] MFA Rules not processed for user `5548b72c4cac4c35a5455b66c678c7de`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:13:48.339271 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-08da817a-d04f-401f-b215-5a65d1025fad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:13:48.353824 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-21e4d16d-79e4-41cf-920a-3e00773ebe21 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13180f80ea9a4a8ebedeeb4f956d0a99', 'request_id': 'req-21e4d16d-79e4-41cf-920a-3e00773ebe21'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:48.361678 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-21e4d16d-79e4-41cf-920a-3e00773ebe21 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13180f80ea9a4a8ebedeeb4f956d0a99', 'request_id': 'req-21e4d16d-79e4-41cf-920a-3e00773ebe21'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:48.370794 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-21e4d16d-79e4-41cf-920a-3e00773ebe21 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13180f80ea9a4a8ebedeeb4f956d0a99', 'request_id': 'req-21e4d16d-79e4-41cf-920a-3e00773ebe21'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:48.391323 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-21e4d16d-79e4-41cf-920a-3e00773ebe21 admin admin] The token cache is being invalidate because project 13180f80ea9a4a8ebedeeb4f956d0a99 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80013) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 14:13:48.391921 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-21e4d16d-79e4-41cf-920a-3e00773ebe21 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:48.392781 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-21e4d16d-79e4-41cf-920a-3e00773ebe21 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:48.394632 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 961/1906] 10.222.0.36 () {58 vars in 1232 bytes} [Tue May 3 14:13:48 2022] DELETE /identity/v3/projects/13180f80ea9a4a8ebedeeb4f956d0a99 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:13:48.399782 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a011c7a-8b20-45f3-bcee-180a090dfa7d None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:48.400337 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a011c7a-8b20-45f3-bcee-180a090dfa7d None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:48.401490 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a011c7a-8b20-45f3-bcee-180a090dfa7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:48.419363 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 946/1907] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:13:48 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 14:13:48.426003 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-6a011c7a-8b20-45f3-bcee-180a090dfa7d None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:13:48.427209 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-6a011c7a-8b20-45f3-bcee-180a090dfa7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:13:48.431488 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08da817a-d04f-401f-b215-5a65d1025fad None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:48.432862 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-08da817a-d04f-401f-b215-5a65d1025fad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:13:48.497026 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08da817a-d04f-401f-b215-5a65d1025fad None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:48.501345 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9478c7-7c9b-4973-b3ed-4e58aa881fe5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '616de5e7daed46849efc75ad77ea054e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:48.502049 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9478c7-7c9b-4973-b3ed-4e58aa881fe5 service glance] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:48.502336 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9478c7-7c9b-4973-b3ed-4e58aa881fe5 service glance] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:48.502923 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9478c7-7c9b-4973-b3ed-4e58aa881fe5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:48.513566 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9478c7-7c9b-4973-b3ed-4e58aa881fe5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:48.515250 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9478c7-7c9b-4973-b3ed-4e58aa881fe5 service glance] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:48.526241 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 962/1908] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:13:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:13:48.527716 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 947/1909] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:13:48 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 14:13:48.534801 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42631537-c59d-42c7-ae6b-bf4cc4027a00 None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:48.535290 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42631537-c59d-42c7-ae6b-bf4cc4027a00 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:48.535568 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42631537-c59d-42c7-ae6b-bf4cc4027a00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:48.575015 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-42631537-c59d-42c7-ae6b-bf4cc4027a00 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:13:48.576265 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-42631537-c59d-42c7-ae6b-bf4cc4027a00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:13:48.585344 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 963/1910] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:13:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:13:48.590167 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9478c7-7c9b-4973-b3ed-4e58aa881fe5 service glance] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:48.602435 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9478c7-7c9b-4973-b3ed-4e58aa881fe5 service glance] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:48.609615 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2677b0-dc94-48e4-bfd1-606b0320799c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:48.610308 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2677b0-dc94-48e4-bfd1-606b0320799c admin admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:48.610586 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2677b0-dc94-48e4-bfd1-606b0320799c admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:48.610876 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2677b0-dc94-48e4-bfd1-606b0320799c admin admin] PATH_INFO: `/v3/domains` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:48.611576 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2677b0-dc94-48e4-bfd1-606b0320799c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80012) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:13:48.611889 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2677b0-dc94-48e4-bfd1-606b0320799c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:48.613554 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2677b0-dc94-48e4-bfd1-606b0320799c admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:48.626472 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 948/1911] 10.222.0.36 () {58 vars in 1152 bytes} [Tue May 3 14:13:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:13:48.631071 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42631537-c59d-42c7-ae6b-bf4cc4027a00 None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:48.641176 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42631537-c59d-42c7-ae6b-bf4cc4027a00 None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:48.646896 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bf22d5-6da7-4131-9bdd-aaf5c5ce491f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:48.647557 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bf22d5-6da7-4131-9bdd-aaf5c5ce491f admin admin] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:48.647833 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bf22d5-6da7-4131-9bdd-aaf5c5ce491f admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:48.648098 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bf22d5-6da7-4131-9bdd-aaf5c5ce491f admin admin] PATH_INFO: `/v3/projects` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:48.648776 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bf22d5-6da7-4131-9bdd-aaf5c5ce491f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:48.650712 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bf22d5-6da7-4131-9bdd-aaf5c5ce491f admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:48.688863 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 964/1912] 10.222.0.36 () {60 vars in 1152 bytes} [Tue May 3 14:13:48 2022] POST /identity/v3/projects => generated 393 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 14:13:48.693251 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2677b0-dc94-48e4-bfd1-606b0320799c admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:48.704192 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2677b0-dc94-48e4-bfd1-606b0320799c admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:48.768497 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f74b92-c9fc-43cf-8eee-672c92b84730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:48.769143 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f74b92-c9fc-43cf-8eee-672c92b84730 admin admin] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:48.769481 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f74b92-c9fc-43cf-8eee-672c92b84730 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:48.769882 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f74b92-c9fc-43cf-8eee-672c92b84730 admin admin] PATH_INFO: `/v3/users` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:48.770596 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f74b92-c9fc-43cf-8eee-672c92b84730 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:48.772515 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f74b92-c9fc-43cf-8eee-672c92b84730 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:48.808312 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bf22d5-6da7-4131-9bdd-aaf5c5ce491f admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:48.808623 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 949/1913] 10.222.0.36 () {60 vars in 1143 bytes} [Tue May 3 14:13:48 2022] POST /identity/v3/users => generated 297 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 14:13:48.821820 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bf22d5-6da7-4131-9bdd-aaf5c5ce491f admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:48.827115 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdbb098-3a9a-4480-bfa4-731db9f685bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:48.827812 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdbb098-3a9a-4480-bfa4-731db9f685bb admin admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:48.828087 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdbb098-3a9a-4480-bfa4-731db9f685bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:48.828362 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdbb098-3a9a-4480-bfa4-731db9f685bb admin admin] PATH_INFO: `/v3/roles` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:48.830237 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdbb098-3a9a-4480-bfa4-731db9f685bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:48.830790 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdbb098-3a9a-4480-bfa4-731db9f685bb admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:48.844911 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 965/1914] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 3 14:13:48 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 14:13:48.849130 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f74b92-c9fc-43cf-8eee-672c92b84730 admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:48.861777 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f74b92-c9fc-43cf-8eee-672c92b84730 admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:48.876248 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4f990f-701a-4528-9981-3ae2b30ab516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:48.876964 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4f990f-701a-4528-9981-3ae2b30ab516 admin admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:48.877249 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4f990f-701a-4528-9981-3ae2b30ab516 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:48.877558 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4f990f-701a-4528-9981-3ae2b30ab516 admin admin] PATH_INFO: `/v3/roles` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:48.878305 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4f990f-701a-4528-9981-3ae2b30ab516 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:48.880739 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4f990f-701a-4528-9981-3ae2b30ab516 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:48.899507 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 950/1915] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 3 14:13:48 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 14:13:48.901354 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdbb098-3a9a-4480-bfa4-731db9f685bb admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:48.913543 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdbb098-3a9a-4480-bfa4-731db9f685bb admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:48.921538 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f52ef3-5778-488e-a3da-eeb705c9d052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:48.922593 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f52ef3-5778-488e-a3da-eeb705c9d052 admin admin] REQUEST_METHOD: `PUT` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:48.922915 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f52ef3-5778-488e-a3da-eeb705c9d052 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:48.923188 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f52ef3-5778-488e-a3da-eeb705c9d052 admin admin] PATH_INFO: `/v3/projects/be2dd387a7f149d58d5a241d598da1ec/users/bd473562405e49d88e8c97e327107e22/roles/441fdc11e95b47f4813f72610e39018b` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:48.938265 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f52ef3-5778-488e-a3da-eeb705c9d052 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be2dd387a7f149d58d5a241d598da1ec, user_id=bd473562405e49d88e8c97e327107e22, role_id=441fdc11e95b47f4813f72610e39018b)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:48.940905 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f52ef3-5778-488e-a3da-eeb705c9d052 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:48.971431 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 966/1916] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 3 14:13:48 2022] PUT /identity/v3/projects/be2dd387a7f149d58d5a241d598da1ec/users/bd473562405e49d88e8c97e327107e22/roles/441fdc11e95b47f4813f72610e39018b => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:13:48.983398 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1ce475-3c73-40d5-971f-05eb2412142b None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:48.983785 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1ce475-3c73-40d5-971f-05eb2412142b None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:48.984110 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1ce475-3c73-40d5-971f-05eb2412142b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:49.034076 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-0a1ce475-3c73-40d5-971f-05eb2412142b None None] MFA Rules not processed for user `bd473562405e49d88e8c97e327107e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:13:49.035343 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-0a1ce475-3c73-40d5-971f-05eb2412142b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:13:49.125926 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 951/1917] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:13:48 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:13:49.130479 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f52ef3-5778-488e-a3da-eeb705c9d052 admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:49.192116 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f52ef3-5778-488e-a3da-eeb705c9d052 admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:49.197492 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1219e915-1cf4-4b28-af3c-e35b46a75e53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:49.198163 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1219e915-1cf4-4b28-af3c-e35b46a75e53 admin admin] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:49.198444 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1219e915-1cf4-4b28-af3c-e35b46a75e53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:49.198747 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1219e915-1cf4-4b28-af3c-e35b46a75e53 admin admin] PATH_INFO: `/v3/projects` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:49.199413 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1219e915-1cf4-4b28-af3c-e35b46a75e53 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:49.201384 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1219e915-1cf4-4b28-af3c-e35b46a75e53 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:49.231666 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 967/1918] 10.222.0.36 () {60 vars in 1152 bytes} [Tue May 3 14:13:49 2022] POST /identity/v3/projects => generated 393 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 14:13:49.235750 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1ce475-3c73-40d5-971f-05eb2412142b None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:49.248417 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1ce475-3c73-40d5-971f-05eb2412142b None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:49.317825 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714d8575-222d-44f9-a973-93b94d3424cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:49.318616 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714d8575-222d-44f9-a973-93b94d3424cf admin admin] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:49.318964 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714d8575-222d-44f9-a973-93b94d3424cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:49.319342 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714d8575-222d-44f9-a973-93b94d3424cf admin admin] PATH_INFO: `/v3/users` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:49.320416 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714d8575-222d-44f9-a973-93b94d3424cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:49.323031 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714d8575-222d-44f9-a973-93b94d3424cf admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:49.348227 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 952/1919] 10.222.0.36 () {60 vars in 1143 bytes} [Tue May 3 14:13:49 2022] POST /identity/v3/users => generated 303 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 14:13:49.353200 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1219e915-1cf4-4b28-af3c-e35b46a75e53 admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:49.365624 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1219e915-1cf4-4b28-af3c-e35b46a75e53 admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:49.372134 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c7b5e7-528c-4d2c-b6ea-7f1d2c699f21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:49.373094 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c7b5e7-528c-4d2c-b6ea-7f1d2c699f21 admin admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:49.373555 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c7b5e7-528c-4d2c-b6ea-7f1d2c699f21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:49.373973 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c7b5e7-528c-4d2c-b6ea-7f1d2c699f21 admin admin] PATH_INFO: `/v3/roles` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:49.374877 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c7b5e7-528c-4d2c-b6ea-7f1d2c699f21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:49.376705 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c7b5e7-528c-4d2c-b6ea-7f1d2c699f21 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:49.388478 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 968/1920] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 3 14:13:49 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 14:13:49.392788 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714d8575-222d-44f9-a973-93b94d3424cf admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:49.403101 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714d8575-222d-44f9-a973-93b94d3424cf admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:49.408956 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5fed7e-e7a7-430f-9da1-f2666814ea67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:49.410517 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5fed7e-e7a7-430f-9da1-f2666814ea67 admin admin] REQUEST_METHOD: `PUT` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:49.410901 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5fed7e-e7a7-430f-9da1-f2666814ea67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:49.411320 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5fed7e-e7a7-430f-9da1-f2666814ea67 admin admin] PATH_INFO: `/v3/projects/f8a71d02fa354e6d9ce4aeb58f20c832/users/aa20cfab25fa405db25fc93b7b71a590/roles/36abe9b50fd8479c86c4f8f70fd85aa3` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:49.429021 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5fed7e-e7a7-430f-9da1-f2666814ea67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8a71d02fa354e6d9ce4aeb58f20c832, user_id=aa20cfab25fa405db25fc93b7b71a590, role_id=36abe9b50fd8479c86c4f8f70fd85aa3)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:49.431882 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5fed7e-e7a7-430f-9da1-f2666814ea67 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:49.447956 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 953/1921] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 3 14:13:49 2022] PUT /identity/v3/projects/f8a71d02fa354e6d9ce4aeb58f20c832/users/aa20cfab25fa405db25fc93b7b71a590/roles/36abe9b50fd8479c86c4f8f70fd85aa3 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:13:49.452477 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c7b5e7-528c-4d2c-b6ea-7f1d2c699f21 admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:49.468341 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c7b5e7-528c-4d2c-b6ea-7f1d2c699f21 admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:49.571528 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200df62b-0c9e-4897-9207-c1ce244c14a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:49.572293 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200df62b-0c9e-4897-9207-c1ce244c14a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:49.572577 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200df62b-0c9e-4897-9207-c1ce244c14a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:49.572856 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200df62b-0c9e-4897-9207-c1ce244c14a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:49.573648 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200df62b-0c9e-4897-9207-c1ce244c14a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:49.575257 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200df62b-0c9e-4897-9207-c1ce244c14a3 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:49.587450 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 969/1922] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 3 14:13:49 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 14:13:49.591560 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5fed7e-e7a7-430f-9da1-f2666814ea67 admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:49.602412 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5fed7e-e7a7-430f-9da1-f2666814ea67 admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:49.609098 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91143234-257c-4863-8be4-95c1ac8768bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:49.610341 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91143234-257c-4863-8be4-95c1ac8768bb admin admin] REQUEST_METHOD: `PUT` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:49.611063 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91143234-257c-4863-8be4-95c1ac8768bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:49.611621 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91143234-257c-4863-8be4-95c1ac8768bb admin admin] PATH_INFO: `/v3/projects/f8a71d02fa354e6d9ce4aeb58f20c832/users/aa20cfab25fa405db25fc93b7b71a590/roles/36abe9b50fd8479c86c4f8f70fd85aa3` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:49.617864 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91143234-257c-4863-8be4-95c1ac8768bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8a71d02fa354e6d9ce4aeb58f20c832, user_id=aa20cfab25fa405db25fc93b7b71a590, role_id=36abe9b50fd8479c86c4f8f70fd85aa3)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:49.620838 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91143234-257c-4863-8be4-95c1ac8768bb admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:49.637323 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 954/1923] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 3 14:13:49 2022] PUT /identity/v3/projects/f8a71d02fa354e6d9ce4aeb58f20c832/users/aa20cfab25fa405db25fc93b7b71a590/roles/36abe9b50fd8479c86c4f8f70fd85aa3 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 14:13:49.645314 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd66609c-32fb-48f3-9605-2e2885c3689b None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:49.645835 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd66609c-32fb-48f3-9605-2e2885c3689b None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:49.645835 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd66609c-32fb-48f3-9605-2e2885c3689b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:49.677869 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-cd66609c-32fb-48f3-9605-2e2885c3689b None None] MFA Rules not processed for user `aa20cfab25fa405db25fc93b7b71a590`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:13:49.679695 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-cd66609c-32fb-48f3-9605-2e2885c3689b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:13:49.753906 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 970/1924] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:13:49 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:13:49.766723 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91143234-257c-4863-8be4-95c1ac8768bb admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:49.787294 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-91143234-257c-4863-8be4-95c1ac8768bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:13:49.829376 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91143234-257c-4863-8be4-95c1ac8768bb admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:49.833183 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844d9db3-661d-4258-b66f-f910dc50fc7c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b014f4c7ba1414cb8a597f5bc4033f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:49.833870 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844d9db3-661d-4258-b66f-f910dc50fc7c service cinder] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:49.834153 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844d9db3-661d-4258-b66f-f910dc50fc7c service cinder] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:49.834432 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844d9db3-661d-4258-b66f-f910dc50fc7c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:49.844967 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844d9db3-661d-4258-b66f-f910dc50fc7c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:49.846458 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844d9db3-661d-4258-b66f-f910dc50fc7c service cinder] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:49.856199 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 955/1925] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:13:49 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 14:13:49.906910 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd66609c-32fb-48f3-9605-2e2885c3689b None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:49.918271 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd66609c-32fb-48f3-9605-2e2885c3689b None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:49.927958 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a2b166-e1c1-43b9-980e-a044f80c5f13 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b014f4c7ba1414cb8a597f5bc4033f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:49.928495 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a2b166-e1c1-43b9-980e-a044f80c5f13 service cinder] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:49.929166 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a2b166-e1c1-43b9-980e-a044f80c5f13 service cinder] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:49.929166 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a2b166-e1c1-43b9-980e-a044f80c5f13 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:49.993232 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a2b166-e1c1-43b9-980e-a044f80c5f13 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:49.994805 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a2b166-e1c1-43b9-980e-a044f80c5f13 service cinder] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:50.004547 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 971/1926] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:13:49 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 14:13:50.276867 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844d9db3-661d-4258-b66f-f910dc50fc7c service cinder] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:50.278367 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-844d9db3-661d-4258-b66f-f910dc50fc7c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:13:50.389373 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844d9db3-661d-4258-b66f-f910dc50fc7c service cinder] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:50.404961 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6919e3e-c75b-4b23-8eba-87bee8fabdad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:50.405990 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6919e3e-c75b-4b23-8eba-87bee8fabdad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:50.406274 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6919e3e-c75b-4b23-8eba-87bee8fabdad admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:50.406549 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6919e3e-c75b-4b23-8eba-87bee8fabdad admin admin] PATH_INFO: `/v3/users/912018de56b44bc4a79eb16ec9c59630` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:50.408771 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6919e3e-c75b-4b23-8eba-87bee8fabdad admin admin] RBAC: Authorizing `identity:delete_user(user_id=912018de56b44bc4a79eb16ec9c59630)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:50.410777 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6919e3e-c75b-4b23-8eba-87bee8fabdad admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:50.475748 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-c6919e3e-c75b-4b23-8eba-87bee8fabdad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '912018de56b44bc4a79eb16ec9c59630'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:50.483492 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-c6919e3e-c75b-4b23-8eba-87bee8fabdad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '912018de56b44bc4a79eb16ec9c59630'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:50.484224 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-c6919e3e-c75b-4b23-8eba-87bee8fabdad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '912018de56b44bc4a79eb16ec9c59630'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:50.501745 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-c6919e3e-c75b-4b23-8eba-87bee8fabdad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '912018de56b44bc4a79eb16ec9c59630'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:50.502588 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-c6919e3e-c75b-4b23-8eba-87bee8fabdad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '912018de56b44bc4a79eb16ec9c59630'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:50.520297 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 956/1927] 10.222.0.36 () {58 vars in 1223 bytes} [Tue May 3 14:13:50 2022] DELETE /identity/v3/users/912018de56b44bc4a79eb16ec9c59630 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:13:50.524265 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8a200f-43ee-45f3-8a49-557646b0ee96 None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:50.524557 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8a200f-43ee-45f3-8a49-557646b0ee96 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:50.524832 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8a200f-43ee-45f3-8a49-557646b0ee96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:50.542198 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-cd8a200f-43ee-45f3-8a49-557646b0ee96 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:13:50.543405 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-cd8a200f-43ee-45f3-8a49-557646b0ee96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:13:50.615978 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 972/1928] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:13:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 14:13:50.625557 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6919e3e-c75b-4b23-8eba-87bee8fabdad admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:50.627017 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-c6919e3e-c75b-4b23-8eba-87bee8fabdad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:13:50.701594 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6919e3e-c75b-4b23-8eba-87bee8fabdad admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:50.706027 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e98fb5-0bff-4760-83ec-8923f2ebd9d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '937bea4f355144b4a7ee11baabc3a4cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:50.706695 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e98fb5-0bff-4760-83ec-8923f2ebd9d0 service neutron] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:50.706978 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e98fb5-0bff-4760-83ec-8923f2ebd9d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:50.707282 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e98fb5-0bff-4760-83ec-8923f2ebd9d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:50.720182 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e98fb5-0bff-4760-83ec-8923f2ebd9d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:50.721664 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e98fb5-0bff-4760-83ec-8923f2ebd9d0 service neutron] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:50.755939 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 957/1929] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:13:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 14:13:51.127340 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8a200f-43ee-45f3-8a49-557646b0ee96 None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:51.131803 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-cd8a200f-43ee-45f3-8a49-557646b0ee96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:13:51.171843 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8a200f-43ee-45f3-8a49-557646b0ee96 None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:51.180569 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d855c38e-d08b-4f4e-ab2c-aeedf772adfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:51.181951 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d855c38e-d08b-4f4e-ab2c-aeedf772adfa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:51.184443 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d855c38e-d08b-4f4e-ab2c-aeedf772adfa admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:51.184969 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d855c38e-d08b-4f4e-ab2c-aeedf772adfa admin admin] PATH_INFO: `/v3/projects/760782ff1ea54af0bd90c5aeec9b46c4` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:51.206865 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d855c38e-d08b-4f4e-ab2c-aeedf772adfa admin admin] RBAC: Authorizing `identity:delete_project(project_id=760782ff1ea54af0bd90c5aeec9b46c4)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:51.213039 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d855c38e-d08b-4f4e-ab2c-aeedf772adfa admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:51.287406 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-d855c38e-d08b-4f4e-ab2c-aeedf772adfa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '760782ff1ea54af0bd90c5aeec9b46c4', 'request_id': 'req-d855c38e-d08b-4f4e-ab2c-aeedf772adfa'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:51.297037 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-d855c38e-d08b-4f4e-ab2c-aeedf772adfa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '760782ff1ea54af0bd90c5aeec9b46c4', 'request_id': 'req-d855c38e-d08b-4f4e-ab2c-aeedf772adfa'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:51.307168 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-d855c38e-d08b-4f4e-ab2c-aeedf772adfa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '760782ff1ea54af0bd90c5aeec9b46c4', 'request_id': 'req-d855c38e-d08b-4f4e-ab2c-aeedf772adfa'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:51.324505 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-d855c38e-d08b-4f4e-ab2c-aeedf772adfa admin admin] The token cache is being invalidate because project 760782ff1ea54af0bd90c5aeec9b46c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80013) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 14:13:51.327860 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-d855c38e-d08b-4f4e-ab2c-aeedf772adfa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:51.328670 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-d855c38e-d08b-4f4e-ab2c-aeedf772adfa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:51.330367 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 973/1930] 10.222.0.36 () {58 vars in 1232 bytes} [Tue May 3 14:13:51 2022] DELETE /identity/v3/projects/760782ff1ea54af0bd90c5aeec9b46c4 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:13:51.334694 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e98fb5-0bff-4760-83ec-8923f2ebd9d0 service neutron] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:51.345811 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e98fb5-0bff-4760-83ec-8923f2ebd9d0 service neutron] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:51.455317 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659a50b7-ef49-4071-96ac-f5c02d1e304a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:51.456801 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659a50b7-ef49-4071-96ac-f5c02d1e304a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:51.457346 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659a50b7-ef49-4071-96ac-f5c02d1e304a admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:51.457815 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659a50b7-ef49-4071-96ac-f5c02d1e304a admin admin] PATH_INFO: `/v3/users/e55fb99f36cd4ffb921b4f380ba59409` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:51.459635 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659a50b7-ef49-4071-96ac-f5c02d1e304a admin admin] RBAC: Authorizing `identity:delete_user(user_id=e55fb99f36cd4ffb921b4f380ba59409)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:51.462618 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659a50b7-ef49-4071-96ac-f5c02d1e304a admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:51.540632 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-659a50b7-ef49-4071-96ac-f5c02d1e304a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e55fb99f36cd4ffb921b4f380ba59409'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:51.550168 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-659a50b7-ef49-4071-96ac-f5c02d1e304a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e55fb99f36cd4ffb921b4f380ba59409'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:51.551287 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-659a50b7-ef49-4071-96ac-f5c02d1e304a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e55fb99f36cd4ffb921b4f380ba59409'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:51.576723 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-659a50b7-ef49-4071-96ac-f5c02d1e304a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e55fb99f36cd4ffb921b4f380ba59409'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:51.577638 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-659a50b7-ef49-4071-96ac-f5c02d1e304a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e55fb99f36cd4ffb921b4f380ba59409'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:51.592028 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 958/1931] 10.222.0.36 () {58 vars in 1223 bytes} [Tue May 3 14:13:51 2022] DELETE /identity/v3/users/e55fb99f36cd4ffb921b4f380ba59409 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:13:51.921968 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d855c38e-d08b-4f4e-ab2c-aeedf772adfa admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:51.923469 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-d855c38e-d08b-4f4e-ab2c-aeedf772adfa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:13:51.936292 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d855c38e-d08b-4f4e-ab2c-aeedf772adfa admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:51.999857 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d722fa-e409-4303-96fe-0f92d188c5f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:52.000729 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d722fa-e409-4303-96fe-0f92d188c5f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:52.001203 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d722fa-e409-4303-96fe-0f92d188c5f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:52.001509 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d722fa-e409-4303-96fe-0f92d188c5f9 admin admin] PATH_INFO: `/v3/projects/17a0998f8d8d4dd0b71f6b36e2e9d2d7` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:52.002740 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d722fa-e409-4303-96fe-0f92d188c5f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=17a0998f8d8d4dd0b71f6b36e2e9d2d7)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:52.004932 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d722fa-e409-4303-96fe-0f92d188c5f9 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:52.071499 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-90d722fa-e409-4303-96fe-0f92d188c5f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17a0998f8d8d4dd0b71f6b36e2e9d2d7', 'request_id': 'req-90d722fa-e409-4303-96fe-0f92d188c5f9'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:52.079272 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-90d722fa-e409-4303-96fe-0f92d188c5f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17a0998f8d8d4dd0b71f6b36e2e9d2d7', 'request_id': 'req-90d722fa-e409-4303-96fe-0f92d188c5f9'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:52.089232 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-90d722fa-e409-4303-96fe-0f92d188c5f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17a0998f8d8d4dd0b71f6b36e2e9d2d7', 'request_id': 'req-90d722fa-e409-4303-96fe-0f92d188c5f9'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:52.100685 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-90d722fa-e409-4303-96fe-0f92d188c5f9 admin admin] The token cache is being invalidate because project 17a0998f8d8d4dd0b71f6b36e2e9d2d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80013) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 14:13:52.100972 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-90d722fa-e409-4303-96fe-0f92d188c5f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:52.101606 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-90d722fa-e409-4303-96fe-0f92d188c5f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:52.103141 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 974/1932] 10.222.0.36 () {58 vars in 1232 bytes} [Tue May 3 14:13:51 2022] DELETE /identity/v3/projects/17a0998f8d8d4dd0b71f6b36e2e9d2d7 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:13:52.108255 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec65240-f9da-4ec9-9296-8f828f9a5bf9 None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:52.108544 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec65240-f9da-4ec9-9296-8f828f9a5bf9 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:52.108846 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec65240-f9da-4ec9-9296-8f828f9a5bf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:52.130725 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-aec65240-f9da-4ec9-9296-8f828f9a5bf9 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:13:52.131930 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-aec65240-f9da-4ec9-9296-8f828f9a5bf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:13:52.200474 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 959/1933] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:13:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 14:13:52.208667 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bb6673-62bc-4e92-b301-b39f1fb27c40 None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:52.209180 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bb6673-62bc-4e92-b301-b39f1fb27c40 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:52.209562 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bb6673-62bc-4e92-b301-b39f1fb27c40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:52.232912 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-86bb6673-62bc-4e92-b301-b39f1fb27c40 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:13:52.233800 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-86bb6673-62bc-4e92-b301-b39f1fb27c40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:13:52.242059 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 975/1934] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:13:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 14:13:52.246378 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec65240-f9da-4ec9-9296-8f828f9a5bf9 None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:52.258632 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec65240-f9da-4ec9-9296-8f828f9a5bf9 None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:52.267962 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02884f2b-1670-4751-9ebd-79bdd971db40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:52.268974 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02884f2b-1670-4751-9ebd-79bdd971db40 admin admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:52.269483 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02884f2b-1670-4751-9ebd-79bdd971db40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:52.270156 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02884f2b-1670-4751-9ebd-79bdd971db40 admin admin] PATH_INFO: `/v3/domains` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:52.271304 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02884f2b-1670-4751-9ebd-79bdd971db40 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80012) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:13:52.271731 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02884f2b-1670-4751-9ebd-79bdd971db40 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:52.273475 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02884f2b-1670-4751-9ebd-79bdd971db40 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:52.292992 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 960/1935] 10.222.0.36 () {58 vars in 1152 bytes} [Tue May 3 14:13:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:13:52.298407 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bb6673-62bc-4e92-b301-b39f1fb27c40 None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:52.310116 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bb6673-62bc-4e92-b301-b39f1fb27c40 None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:52.315785 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb66ced-209a-4bff-88b2-ce6eb4d8a875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:52.316530 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb66ced-209a-4bff-88b2-ce6eb4d8a875 admin admin] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:52.316873 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb66ced-209a-4bff-88b2-ce6eb4d8a875 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:52.317239 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb66ced-209a-4bff-88b2-ce6eb4d8a875 admin admin] PATH_INFO: `/v3/projects` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:52.318052 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb66ced-209a-4bff-88b2-ce6eb4d8a875 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:52.320207 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb66ced-209a-4bff-88b2-ce6eb4d8a875 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:52.375452 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 976/1936] 10.222.0.36 () {60 vars in 1152 bytes} [Tue May 3 14:13:52 2022] POST /identity/v3/projects => generated 381 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 14:13:52.379842 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02884f2b-1670-4751-9ebd-79bdd971db40 admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:52.390039 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02884f2b-1670-4751-9ebd-79bdd971db40 admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:52.444673 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2971d9d-b5af-4ce9-a009-53b19d8b8e7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:52.445686 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2971d9d-b5af-4ce9-a009-53b19d8b8e7b admin admin] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:52.445968 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2971d9d-b5af-4ce9-a009-53b19d8b8e7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:52.446244 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2971d9d-b5af-4ce9-a009-53b19d8b8e7b admin admin] PATH_INFO: `/v3/users` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:52.446942 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2971d9d-b5af-4ce9-a009-53b19d8b8e7b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:52.448926 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2971d9d-b5af-4ce9-a009-53b19d8b8e7b admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:52.470272 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 961/1937] 10.222.0.36 () {60 vars in 1143 bytes} [Tue May 3 14:13:52 2022] POST /identity/v3/users => generated 291 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 14:13:52.474522 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb66ced-209a-4bff-88b2-ce6eb4d8a875 admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:52.484953 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb66ced-209a-4bff-88b2-ce6eb4d8a875 admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:52.489618 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62406eb0-5793-4f52-af43-6979a6f05831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:52.490281 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62406eb0-5793-4f52-af43-6979a6f05831 admin admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:52.490557 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62406eb0-5793-4f52-af43-6979a6f05831 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:52.490824 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62406eb0-5793-4f52-af43-6979a6f05831 admin admin] PATH_INFO: `/v3/roles` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:52.491575 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62406eb0-5793-4f52-af43-6979a6f05831 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:52.493164 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62406eb0-5793-4f52-af43-6979a6f05831 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:52.504314 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 977/1938] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 3 14:13:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 14:13:52.508453 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2971d9d-b5af-4ce9-a009-53b19d8b8e7b admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:52.518598 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2971d9d-b5af-4ce9-a009-53b19d8b8e7b admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:52.523995 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de6d668-d748-4aba-8e4a-e556f241c2bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:52.524659 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de6d668-d748-4aba-8e4a-e556f241c2bf admin admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:52.524942 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de6d668-d748-4aba-8e4a-e556f241c2bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:52.525220 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de6d668-d748-4aba-8e4a-e556f241c2bf admin admin] PATH_INFO: `/v3/roles` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:52.525986 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de6d668-d748-4aba-8e4a-e556f241c2bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:52.527587 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de6d668-d748-4aba-8e4a-e556f241c2bf admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:52.537795 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 962/1939] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 3 14:13:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 14:13:52.541921 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62406eb0-5793-4f52-af43-6979a6f05831 admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:52.552252 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62406eb0-5793-4f52-af43-6979a6f05831 admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:52.557151 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7267e7-3c4c-4350-9dfb-7efb24a10e27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:52.558050 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7267e7-3c4c-4350-9dfb-7efb24a10e27 admin admin] REQUEST_METHOD: `PUT` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:52.558321 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7267e7-3c4c-4350-9dfb-7efb24a10e27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:52.558587 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7267e7-3c4c-4350-9dfb-7efb24a10e27 admin admin] PATH_INFO: `/v3/projects/2b328c8d09ee4af68ee8f14d3b51066b/users/ca14630abb1247c39396f5bd0d96bfb2/roles/441fdc11e95b47f4813f72610e39018b` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:52.573489 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7267e7-3c4c-4350-9dfb-7efb24a10e27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b328c8d09ee4af68ee8f14d3b51066b, user_id=ca14630abb1247c39396f5bd0d96bfb2, role_id=441fdc11e95b47f4813f72610e39018b)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:52.576286 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7267e7-3c4c-4350-9dfb-7efb24a10e27 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:52.595921 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 978/1940] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 3 14:13:52 2022] PUT /identity/v3/projects/2b328c8d09ee4af68ee8f14d3b51066b/users/ca14630abb1247c39396f5bd0d96bfb2/roles/441fdc11e95b47f4813f72610e39018b => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:13:52.606489 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa6269b-7bad-49b3-b045-7c6e5945325f None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:52.606964 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa6269b-7bad-49b3-b045-7c6e5945325f None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:52.607055 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa6269b-7bad-49b3-b045-7c6e5945325f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:52.640469 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-daa6269b-7bad-49b3-b045-7c6e5945325f None None] MFA Rules not processed for user `ca14630abb1247c39396f5bd0d96bfb2`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:13:52.641678 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-daa6269b-7bad-49b3-b045-7c6e5945325f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:13:52.709036 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 963/1941] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:13:52 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:13:52.714042 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7267e7-3c4c-4350-9dfb-7efb24a10e27 admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:52.775934 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7267e7-3c4c-4350-9dfb-7efb24a10e27 admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:52.781499 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c814e5e6-37cc-441f-a41f-0d3f8aafaf39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:52.782237 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c814e5e6-37cc-441f-a41f-0d3f8aafaf39 admin admin] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:52.782513 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c814e5e6-37cc-441f-a41f-0d3f8aafaf39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:52.782860 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c814e5e6-37cc-441f-a41f-0d3f8aafaf39 admin admin] PATH_INFO: `/v3/projects` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:52.783788 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c814e5e6-37cc-441f-a41f-0d3f8aafaf39 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:52.785877 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c814e5e6-37cc-441f-a41f-0d3f8aafaf39 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:52.813910 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 979/1942] 10.222.0.36 () {60 vars in 1152 bytes} [Tue May 3 14:13:52 2022] POST /identity/v3/projects => generated 383 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 14:13:52.818068 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa6269b-7bad-49b3-b045-7c6e5945325f None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:52.829978 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa6269b-7bad-49b3-b045-7c6e5945325f None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:52.889029 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77ccc2a-8814-4fa2-807e-695e898f751f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:52.889741 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77ccc2a-8814-4fa2-807e-695e898f751f admin admin] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:52.890053 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77ccc2a-8814-4fa2-807e-695e898f751f admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:52.890331 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77ccc2a-8814-4fa2-807e-695e898f751f admin admin] PATH_INFO: `/v3/users` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:52.891088 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77ccc2a-8814-4fa2-807e-695e898f751f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:52.892974 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77ccc2a-8814-4fa2-807e-695e898f751f admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:52.913396 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 964/1943] 10.222.0.36 () {60 vars in 1143 bytes} [Tue May 3 14:13:52 2022] POST /identity/v3/users => generated 298 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 14:13:52.917507 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c814e5e6-37cc-441f-a41f-0d3f8aafaf39 admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:52.928390 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c814e5e6-37cc-441f-a41f-0d3f8aafaf39 admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:52.933776 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0c4bd1-1027-4933-99b6-c269df01b521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:52.934445 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0c4bd1-1027-4933-99b6-c269df01b521 admin admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:52.934737 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0c4bd1-1027-4933-99b6-c269df01b521 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:52.934989 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0c4bd1-1027-4933-99b6-c269df01b521 admin admin] PATH_INFO: `/v3/roles` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:52.935794 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0c4bd1-1027-4933-99b6-c269df01b521 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:52.937572 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0c4bd1-1027-4933-99b6-c269df01b521 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:52.948545 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 980/1944] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 3 14:13:52 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 14:13:52.953420 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77ccc2a-8814-4fa2-807e-695e898f751f admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:52.963397 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77ccc2a-8814-4fa2-807e-695e898f751f admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:52.969175 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcf9641-1de5-46f7-a81e-1125f6803a1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:52.970092 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcf9641-1de5-46f7-a81e-1125f6803a1e admin admin] REQUEST_METHOD: `PUT` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:52.970367 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcf9641-1de5-46f7-a81e-1125f6803a1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:52.970634 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcf9641-1de5-46f7-a81e-1125f6803a1e admin admin] PATH_INFO: `/v3/projects/21271a7a6be9429a93b9fce77baaa0af/users/4bdfddf5aa1a44519871ad6302dfe777/roles/36abe9b50fd8479c86c4f8f70fd85aa3` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:52.987201 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcf9641-1de5-46f7-a81e-1125f6803a1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=21271a7a6be9429a93b9fce77baaa0af, user_id=4bdfddf5aa1a44519871ad6302dfe777, role_id=36abe9b50fd8479c86c4f8f70fd85aa3)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:52.990140 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcf9641-1de5-46f7-a81e-1125f6803a1e admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:53.004240 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 965/1945] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 3 14:13:52 2022] PUT /identity/v3/projects/21271a7a6be9429a93b9fce77baaa0af/users/4bdfddf5aa1a44519871ad6302dfe777/roles/36abe9b50fd8479c86c4f8f70fd85aa3 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:13:53.008509 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0c4bd1-1027-4933-99b6-c269df01b521 admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:53.018720 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0c4bd1-1027-4933-99b6-c269df01b521 admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:53.083848 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a817ec0-c8d4-4cfa-92e6-e253874d6db6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:53.084527 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a817ec0-c8d4-4cfa-92e6-e253874d6db6 admin admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:53.086487 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a817ec0-c8d4-4cfa-92e6-e253874d6db6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:53.086487 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a817ec0-c8d4-4cfa-92e6-e253874d6db6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:53.086487 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a817ec0-c8d4-4cfa-92e6-e253874d6db6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:53.087789 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a817ec0-c8d4-4cfa-92e6-e253874d6db6 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:53.097595 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 981/1946] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 3 14:13:53 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 14:13:53.102090 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcf9641-1de5-46f7-a81e-1125f6803a1e admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:53.114422 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcf9641-1de5-46f7-a81e-1125f6803a1e admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:53.119086 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df78e729-7bcc-4e6c-9437-143a8970345b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:53.119981 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df78e729-7bcc-4e6c-9437-143a8970345b admin admin] REQUEST_METHOD: `PUT` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:53.120259 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df78e729-7bcc-4e6c-9437-143a8970345b admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:53.120528 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df78e729-7bcc-4e6c-9437-143a8970345b admin admin] PATH_INFO: `/v3/projects/21271a7a6be9429a93b9fce77baaa0af/users/4bdfddf5aa1a44519871ad6302dfe777/roles/36abe9b50fd8479c86c4f8f70fd85aa3` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:53.122523 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df78e729-7bcc-4e6c-9437-143a8970345b admin admin] RBAC: Authorizing `identity:create_grant(project_id=21271a7a6be9429a93b9fce77baaa0af, user_id=4bdfddf5aa1a44519871ad6302dfe777, role_id=36abe9b50fd8479c86c4f8f70fd85aa3)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:53.125157 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df78e729-7bcc-4e6c-9437-143a8970345b admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:53.135892 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 966/1947] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 3 14:13:53 2022] PUT /identity/v3/projects/21271a7a6be9429a93b9fce77baaa0af/users/4bdfddf5aa1a44519871ad6302dfe777/roles/36abe9b50fd8479c86c4f8f70fd85aa3 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:13:53.147398 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a77b083-b6fe-4b44-ad0e-33d6c114f79c None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:53.147614 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a77b083-b6fe-4b44-ad0e-33d6c114f79c None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:53.147893 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a77b083-b6fe-4b44-ad0e-33d6c114f79c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:53.179839 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-2a77b083-b6fe-4b44-ad0e-33d6c114f79c None None] MFA Rules not processed for user `4bdfddf5aa1a44519871ad6302dfe777`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:13:53.181063 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-2a77b083-b6fe-4b44-ad0e-33d6c114f79c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:13:53.256228 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 982/1948] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:13:53 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:13:53.265492 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df78e729-7bcc-4e6c-9437-143a8970345b admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:53.267297 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-df78e729-7bcc-4e6c-9437-143a8970345b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:13:53.326511 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df78e729-7bcc-4e6c-9437-143a8970345b admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:53.333965 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c544c0-901e-4a90-b7f4-95bfcdc22f9e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b014f4c7ba1414cb8a597f5bc4033f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:53.334833 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c544c0-901e-4a90-b7f4-95bfcdc22f9e service cinder] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:53.335110 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c544c0-901e-4a90-b7f4-95bfcdc22f9e service cinder] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:53.335416 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c544c0-901e-4a90-b7f4-95bfcdc22f9e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:53.351607 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c544c0-901e-4a90-b7f4-95bfcdc22f9e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:53.353047 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c544c0-901e-4a90-b7f4-95bfcdc22f9e service cinder] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:53.363298 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 967/1949] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:13:53 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 14:13:53.448904 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a77b083-b6fe-4b44-ad0e-33d6c114f79c None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:53.450453 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-2a77b083-b6fe-4b44-ad0e-33d6c114f79c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:13:53.463439 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a77b083-b6fe-4b44-ad0e-33d6c114f79c None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:53.467382 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aac05ed-745d-4d23-9c3c-3a44ea485c05 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b014f4c7ba1414cb8a597f5bc4033f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:53.468046 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aac05ed-745d-4d23-9c3c-3a44ea485c05 service cinder] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:53.468327 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aac05ed-745d-4d23-9c3c-3a44ea485c05 service cinder] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:53.468603 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aac05ed-745d-4d23-9c3c-3a44ea485c05 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:53.527353 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aac05ed-745d-4d23-9c3c-3a44ea485c05 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:53.528871 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aac05ed-745d-4d23-9c3c-3a44ea485c05 service cinder] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:53.539914 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 983/1950] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:13:53 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 14:13:53.801647 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c544c0-901e-4a90-b7f4-95bfcdc22f9e service cinder] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:53.859893 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c544c0-901e-4a90-b7f4-95bfcdc22f9e service cinder] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:53.864619 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d90e10-b8ae-4b2c-adb5-2371cf06a522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:53.865523 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d90e10-b8ae-4b2c-adb5-2371cf06a522 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:53.865809 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d90e10-b8ae-4b2c-adb5-2371cf06a522 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:53.866058 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d90e10-b8ae-4b2c-adb5-2371cf06a522 admin admin] PATH_INFO: `/v3/users/ca14630abb1247c39396f5bd0d96bfb2` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:53.867260 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d90e10-b8ae-4b2c-adb5-2371cf06a522 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca14630abb1247c39396f5bd0d96bfb2)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:53.869189 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d90e10-b8ae-4b2c-adb5-2371cf06a522 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:53.920512 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-c8d90e10-b8ae-4b2c-adb5-2371cf06a522 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca14630abb1247c39396f5bd0d96bfb2'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:53.926878 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-c8d90e10-b8ae-4b2c-adb5-2371cf06a522 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca14630abb1247c39396f5bd0d96bfb2'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:53.927623 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-c8d90e10-b8ae-4b2c-adb5-2371cf06a522 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca14630abb1247c39396f5bd0d96bfb2'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:53.940534 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-c8d90e10-b8ae-4b2c-adb5-2371cf06a522 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca14630abb1247c39396f5bd0d96bfb2'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:53.941437 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-c8d90e10-b8ae-4b2c-adb5-2371cf06a522 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca14630abb1247c39396f5bd0d96bfb2'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:53.956987 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 968/1951] 10.222.0.36 () {58 vars in 1223 bytes} [Tue May 3 14:13:53 2022] DELETE /identity/v3/users/ca14630abb1247c39396f5bd0d96bfb2 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:13:53.963086 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8d9dcc-5547-4174-8667-ce0bd94b2004 None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:53.963430 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8d9dcc-5547-4174-8667-ce0bd94b2004 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:53.963954 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8d9dcc-5547-4174-8667-ce0bd94b2004 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:53.987896 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-4e8d9dcc-5547-4174-8667-ce0bd94b2004 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:13:53.989087 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-4e8d9dcc-5547-4174-8667-ce0bd94b2004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:13:54.057428 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 984/1952] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:13:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:13:54.069201 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d90e10-b8ae-4b2c-adb5-2371cf06a522 admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:54.070774 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-c8d90e10-b8ae-4b2c-adb5-2371cf06a522 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:13:54.128384 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d90e10-b8ae-4b2c-adb5-2371cf06a522 admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:54.132729 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437b27d5-7e72-466d-84ff-b41bea16a585 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '937bea4f355144b4a7ee11baabc3a4cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:54.133567 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437b27d5-7e72-466d-84ff-b41bea16a585 service neutron] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:54.133909 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437b27d5-7e72-466d-84ff-b41bea16a585 service neutron] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:54.134321 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437b27d5-7e72-466d-84ff-b41bea16a585 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:54.144243 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437b27d5-7e72-466d-84ff-b41bea16a585 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:54.145854 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437b27d5-7e72-466d-84ff-b41bea16a585 service neutron] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:54.156053 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 969/1953] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:13:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 14:13:54.495849 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8d9dcc-5547-4174-8667-ce0bd94b2004 None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:54.497576 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-4e8d9dcc-5547-4174-8667-ce0bd94b2004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:13:54.509852 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8d9dcc-5547-4174-8667-ce0bd94b2004 None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:54.514495 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22b7171-8bc1-4d1e-ba0c-07a44dfd86c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:54.515388 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22b7171-8bc1-4d1e-ba0c-07a44dfd86c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:54.515664 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22b7171-8bc1-4d1e-ba0c-07a44dfd86c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:54.515954 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22b7171-8bc1-4d1e-ba0c-07a44dfd86c4 admin admin] PATH_INFO: `/v3/projects/2b328c8d09ee4af68ee8f14d3b51066b` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:54.517262 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22b7171-8bc1-4d1e-ba0c-07a44dfd86c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b328c8d09ee4af68ee8f14d3b51066b)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:54.519403 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22b7171-8bc1-4d1e-ba0c-07a44dfd86c4 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:54.567585 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-e22b7171-8bc1-4d1e-ba0c-07a44dfd86c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b328c8d09ee4af68ee8f14d3b51066b', 'request_id': 'req-e22b7171-8bc1-4d1e-ba0c-07a44dfd86c4'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:54.573236 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-e22b7171-8bc1-4d1e-ba0c-07a44dfd86c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b328c8d09ee4af68ee8f14d3b51066b', 'request_id': 'req-e22b7171-8bc1-4d1e-ba0c-07a44dfd86c4'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:54.583087 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-e22b7171-8bc1-4d1e-ba0c-07a44dfd86c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b328c8d09ee4af68ee8f14d3b51066b', 'request_id': 'req-e22b7171-8bc1-4d1e-ba0c-07a44dfd86c4'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:54.594636 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-e22b7171-8bc1-4d1e-ba0c-07a44dfd86c4 admin admin] The token cache is being invalidate because project 2b328c8d09ee4af68ee8f14d3b51066b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80013) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 14:13:54.594918 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-e22b7171-8bc1-4d1e-ba0c-07a44dfd86c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:54.595646 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-e22b7171-8bc1-4d1e-ba0c-07a44dfd86c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:54.597325 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 985/1954] 10.222.0.36 () {58 vars in 1232 bytes} [Tue May 3 14:13:54 2022] DELETE /identity/v3/projects/2b328c8d09ee4af68ee8f14d3b51066b => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:13:54.601462 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437b27d5-7e72-466d-84ff-b41bea16a585 service neutron] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:54.611179 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437b27d5-7e72-466d-84ff-b41bea16a585 service neutron] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:54.670697 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d140b6a4-5750-4c60-990c-220fa4ad7582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:54.671640 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d140b6a4-5750-4c60-990c-220fa4ad7582 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:54.671918 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d140b6a4-5750-4c60-990c-220fa4ad7582 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:54.672193 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d140b6a4-5750-4c60-990c-220fa4ad7582 admin admin] PATH_INFO: `/v3/users/4bdfddf5aa1a44519871ad6302dfe777` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:54.673622 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d140b6a4-5750-4c60-990c-220fa4ad7582 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4bdfddf5aa1a44519871ad6302dfe777)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:54.675572 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d140b6a4-5750-4c60-990c-220fa4ad7582 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:54.727264 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-d140b6a4-5750-4c60-990c-220fa4ad7582 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4bdfddf5aa1a44519871ad6302dfe777'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:54.735882 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-d140b6a4-5750-4c60-990c-220fa4ad7582 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4bdfddf5aa1a44519871ad6302dfe777'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:54.736648 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-d140b6a4-5750-4c60-990c-220fa4ad7582 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4bdfddf5aa1a44519871ad6302dfe777'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:54.752374 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-d140b6a4-5750-4c60-990c-220fa4ad7582 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4bdfddf5aa1a44519871ad6302dfe777'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:54.753217 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-d140b6a4-5750-4c60-990c-220fa4ad7582 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4bdfddf5aa1a44519871ad6302dfe777'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:54.770544 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 970/1955] 10.222.0.36 () {58 vars in 1223 bytes} [Tue May 3 14:13:54 2022] DELETE /identity/v3/users/4bdfddf5aa1a44519871ad6302dfe777 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:13:55.048567 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22b7171-8bc1-4d1e-ba0c-07a44dfd86c4 admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:55.052179 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-e22b7171-8bc1-4d1e-ba0c-07a44dfd86c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:13:55.070551 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22b7171-8bc1-4d1e-ba0c-07a44dfd86c4 admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:55.128747 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b036c4-9b99-4e9e-bd55-ccfed388c22e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:55.129730 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b036c4-9b99-4e9e-bd55-ccfed388c22e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:55.130012 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b036c4-9b99-4e9e-bd55-ccfed388c22e admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:55.130291 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b036c4-9b99-4e9e-bd55-ccfed388c22e admin admin] PATH_INFO: `/v3/projects/21271a7a6be9429a93b9fce77baaa0af` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:55.131637 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b036c4-9b99-4e9e-bd55-ccfed388c22e admin admin] RBAC: Authorizing `identity:delete_project(project_id=21271a7a6be9429a93b9fce77baaa0af)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:55.133723 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b036c4-9b99-4e9e-bd55-ccfed388c22e admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:55.182023 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-d5b036c4-9b99-4e9e-bd55-ccfed388c22e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21271a7a6be9429a93b9fce77baaa0af', 'request_id': 'req-d5b036c4-9b99-4e9e-bd55-ccfed388c22e'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:55.187571 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-d5b036c4-9b99-4e9e-bd55-ccfed388c22e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21271a7a6be9429a93b9fce77baaa0af', 'request_id': 'req-d5b036c4-9b99-4e9e-bd55-ccfed388c22e'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:55.195838 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-d5b036c4-9b99-4e9e-bd55-ccfed388c22e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21271a7a6be9429a93b9fce77baaa0af', 'request_id': 'req-d5b036c4-9b99-4e9e-bd55-ccfed388c22e'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:55.207908 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-d5b036c4-9b99-4e9e-bd55-ccfed388c22e admin admin] The token cache is being invalidate because project 21271a7a6be9429a93b9fce77baaa0af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80013) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 14:13:55.208196 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-d5b036c4-9b99-4e9e-bd55-ccfed388c22e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:55.208849 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-d5b036c4-9b99-4e9e-bd55-ccfed388c22e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:55.210493 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 986/1956] 10.222.0.36 () {58 vars in 1232 bytes} [Tue May 3 14:13:55 2022] DELETE /identity/v3/projects/21271a7a6be9429a93b9fce77baaa0af => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:13:55.217372 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329309bb-65d7-4aa6-8ece-29ca539c6bf5 None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:55.218329 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329309bb-65d7-4aa6-8ece-29ca539c6bf5 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:55.218608 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329309bb-65d7-4aa6-8ece-29ca539c6bf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:55.237546 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-329309bb-65d7-4aa6-8ece-29ca539c6bf5 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:13:55.238763 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-329309bb-65d7-4aa6-8ece-29ca539c6bf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:13:55.301313 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 971/1957] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:13:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:13:55.309068 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218ea4f2-d2a4-42bb-a4ec-3050de9ca024 None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:55.309378 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218ea4f2-d2a4-42bb-a4ec-3050de9ca024 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:55.309653 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218ea4f2-d2a4-42bb-a4ec-3050de9ca024 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:55.329914 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-218ea4f2-d2a4-42bb-a4ec-3050de9ca024 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:13:55.331276 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-218ea4f2-d2a4-42bb-a4ec-3050de9ca024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:13:55.340123 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 987/1958] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:13:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:13:55.344439 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329309bb-65d7-4aa6-8ece-29ca539c6bf5 None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:55.355006 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329309bb-65d7-4aa6-8ece-29ca539c6bf5 None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:55.359932 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d14bb2e-6f97-4539-8f41-6cdaeea9687a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:55.360604 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d14bb2e-6f97-4539-8f41-6cdaeea9687a admin admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:55.360864 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d14bb2e-6f97-4539-8f41-6cdaeea9687a admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:55.361135 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d14bb2e-6f97-4539-8f41-6cdaeea9687a admin admin] PATH_INFO: `/v3/domains` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:55.361913 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d14bb2e-6f97-4539-8f41-6cdaeea9687a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80012) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:13:55.362216 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d14bb2e-6f97-4539-8f41-6cdaeea9687a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:55.363813 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d14bb2e-6f97-4539-8f41-6cdaeea9687a admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:55.376026 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 972/1959] 10.222.0.36 () {58 vars in 1152 bytes} [Tue May 3 14:13:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 14:13:55.380118 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218ea4f2-d2a4-42bb-a4ec-3050de9ca024 None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:55.389686 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218ea4f2-d2a4-42bb-a4ec-3050de9ca024 None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:55.395046 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed1ca07-ee5d-4622-aad1-0200303a1869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:55.395740 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed1ca07-ee5d-4622-aad1-0200303a1869 admin admin] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:55.396058 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed1ca07-ee5d-4622-aad1-0200303a1869 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:55.396314 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed1ca07-ee5d-4622-aad1-0200303a1869 admin admin] PATH_INFO: `/v3/projects` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:55.397096 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed1ca07-ee5d-4622-aad1-0200303a1869 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:55.399031 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed1ca07-ee5d-4622-aad1-0200303a1869 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:55.429917 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 988/1960] 10.222.0.36 () {60 vars in 1152 bytes} [Tue May 3 14:13:55 2022] POST /identity/v3/projects => generated 399 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 14:13:55.434345 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d14bb2e-6f97-4539-8f41-6cdaeea9687a admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:55.446686 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d14bb2e-6f97-4539-8f41-6cdaeea9687a admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:55.524226 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5ae075-30e5-4ccc-af53-c121af654873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:55.524912 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5ae075-30e5-4ccc-af53-c121af654873 admin admin] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:55.526675 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5ae075-30e5-4ccc-af53-c121af654873 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:55.527128 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5ae075-30e5-4ccc-af53-c121af654873 admin admin] PATH_INFO: `/v3/users` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:55.528822 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5ae075-30e5-4ccc-af53-c121af654873 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:55.534334 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5ae075-30e5-4ccc-af53-c121af654873 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:55.572930 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 973/1961] 10.222.0.36 () {60 vars in 1143 bytes} [Tue May 3 14:13:55 2022] POST /identity/v3/users => generated 300 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 14:13:55.581222 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed1ca07-ee5d-4622-aad1-0200303a1869 admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:55.594772 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed1ca07-ee5d-4622-aad1-0200303a1869 admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:55.602814 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1f9200-6963-4da0-b10f-09bdf3147d79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:55.603730 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1f9200-6963-4da0-b10f-09bdf3147d79 admin admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:55.604188 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1f9200-6963-4da0-b10f-09bdf3147d79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:55.604608 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1f9200-6963-4da0-b10f-09bdf3147d79 admin admin] PATH_INFO: `/v3/roles` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:55.605541 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1f9200-6963-4da0-b10f-09bdf3147d79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:55.607373 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1f9200-6963-4da0-b10f-09bdf3147d79 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:55.618785 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 989/1962] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 3 14:13:55 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 14:13:55.626682 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5ae075-30e5-4ccc-af53-c121af654873 admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:55.637433 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5ae075-30e5-4ccc-af53-c121af654873 admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:55.644432 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8860cacc-5848-4162-9b1f-161e76e90429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:55.645806 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8860cacc-5848-4162-9b1f-161e76e90429 admin admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:55.646261 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8860cacc-5848-4162-9b1f-161e76e90429 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:55.647048 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8860cacc-5848-4162-9b1f-161e76e90429 admin admin] PATH_INFO: `/v3/roles` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:55.648345 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8860cacc-5848-4162-9b1f-161e76e90429 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:55.650455 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8860cacc-5848-4162-9b1f-161e76e90429 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:55.667233 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 974/1963] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 3 14:13:55 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 14:13:55.671494 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1f9200-6963-4da0-b10f-09bdf3147d79 admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:55.695174 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1f9200-6963-4da0-b10f-09bdf3147d79 admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:55.701994 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66167f11-7c4f-4f59-bd86-e9c6ae03494e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:55.702904 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66167f11-7c4f-4f59-bd86-e9c6ae03494e admin admin] REQUEST_METHOD: `PUT` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:55.704109 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66167f11-7c4f-4f59-bd86-e9c6ae03494e admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:55.704109 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66167f11-7c4f-4f59-bd86-e9c6ae03494e admin admin] PATH_INFO: `/v3/projects/6f9a9e044f4c4e6b83b39cbaa7b69d6c/users/46538be77902451ca72c7ce16303a32a/roles/441fdc11e95b47f4813f72610e39018b` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:55.733195 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66167f11-7c4f-4f59-bd86-e9c6ae03494e admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f9a9e044f4c4e6b83b39cbaa7b69d6c, user_id=46538be77902451ca72c7ce16303a32a, role_id=441fdc11e95b47f4813f72610e39018b)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:55.736862 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66167f11-7c4f-4f59-bd86-e9c6ae03494e admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:55.751729 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8860cacc-5848-4162-9b1f-161e76e90429 admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:55.753888 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-8860cacc-5848-4162-9b1f-161e76e90429 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:13:55.776261 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 990/1964] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 3 14:13:55 2022] PUT /identity/v3/projects/6f9a9e044f4c4e6b83b39cbaa7b69d6c/users/46538be77902451ca72c7ce16303a32a/roles/441fdc11e95b47f4813f72610e39018b => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 14:13:55.776261 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a92b83f-7822-43a3-a6e4-03e1e154cf7e None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:55.776261 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a92b83f-7822-43a3-a6e4-03e1e154cf7e None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:55.776261 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a92b83f-7822-43a3-a6e4-03e1e154cf7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:55.786682 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8860cacc-5848-4162-9b1f-161e76e90429 admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:55.806901 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-7a92b83f-7822-43a3-a6e4-03e1e154cf7e None None] MFA Rules not processed for user `46538be77902451ca72c7ce16303a32a`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:13:55.808760 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-7a92b83f-7822-43a3-a6e4-03e1e154cf7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:13:55.864603 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0b86b0-7fee-4565-9807-e7d3573d36fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:55.868352 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0b86b0-7fee-4565-9807-e7d3573d36fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:55.868352 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0b86b0-7fee-4565-9807-e7d3573d36fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:55.868352 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0b86b0-7fee-4565-9807-e7d3573d36fa admin admin] PATH_INFO: `/v3/users/bd473562405e49d88e8c97e327107e22` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:55.868352 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0b86b0-7fee-4565-9807-e7d3573d36fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd473562405e49d88e8c97e327107e22)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:55.878483 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0b86b0-7fee-4565-9807-e7d3573d36fa admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:55.884336 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 991/1965] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:13:55 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:13:55.898516 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a92b83f-7822-43a3-a6e4-03e1e154cf7e None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:55.902715 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-7a92b83f-7822-43a3-a6e4-03e1e154cf7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:13:55.954856 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-2a0b86b0-7fee-4565-9807-e7d3573d36fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd473562405e49d88e8c97e327107e22'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:55.963770 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-2a0b86b0-7fee-4565-9807-e7d3573d36fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd473562405e49d88e8c97e327107e22'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:55.964653 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-2a0b86b0-7fee-4565-9807-e7d3573d36fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd473562405e49d88e8c97e327107e22'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:55.978399 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a92b83f-7822-43a3-a6e4-03e1e154cf7e None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:55.980347 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-2a0b86b0-7fee-4565-9807-e7d3573d36fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd473562405e49d88e8c97e327107e22'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:55.981055 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-2a0b86b0-7fee-4565-9807-e7d3573d36fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd473562405e49d88e8c97e327107e22'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:55.982895 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75b1636-db9e-4dbe-a8c9-9f02f0e342ad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b014f4c7ba1414cb8a597f5bc4033f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:55.983982 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75b1636-db9e-4dbe-a8c9-9f02f0e342ad service cinder] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:55.983982 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75b1636-db9e-4dbe-a8c9-9f02f0e342ad service cinder] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:55.984166 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75b1636-db9e-4dbe-a8c9-9f02f0e342ad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:55.986499 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-b75b1636-db9e-4dbe-a8c9-9f02f0e342ad service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:13:56.001869 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75b1636-db9e-4dbe-a8c9-9f02f0e342ad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:56.003345 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75b1636-db9e-4dbe-a8c9-9f02f0e342ad service cinder] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:56.010538 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 975/1966] 10.222.0.36 () {58 vars in 1223 bytes} [Tue May 3 14:13:55 2022] DELETE /identity/v3/users/bd473562405e49d88e8c97e327107e22 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 14:13:56.012778 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 992/1967] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:13:55 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 14:13:56.019078 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b98624-2e2a-4fa7-acbc-fcfbcb03023f None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:56.019457 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b98624-2e2a-4fa7-acbc-fcfbcb03023f None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:56.019898 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b98624-2e2a-4fa7-acbc-fcfbcb03023f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:56.039994 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-d7b98624-2e2a-4fa7-acbc-fcfbcb03023f None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:13:56.041400 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-d7b98624-2e2a-4fa7-acbc-fcfbcb03023f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:13:56.110761 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 976/1968] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:13:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:13:56.120431 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75b1636-db9e-4dbe-a8c9-9f02f0e342ad service cinder] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:56.122293 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-b75b1636-db9e-4dbe-a8c9-9f02f0e342ad service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:13:56.189142 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75b1636-db9e-4dbe-a8c9-9f02f0e342ad service cinder] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:56.242461 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80321ca-ff59-46d4-84fe-b066ede452a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '937bea4f355144b4a7ee11baabc3a4cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:56.243127 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80321ca-ff59-46d4-84fe-b066ede452a3 service neutron] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:56.243408 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80321ca-ff59-46d4-84fe-b066ede452a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:56.243683 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80321ca-ff59-46d4-84fe-b066ede452a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:56.253729 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80321ca-ff59-46d4-84fe-b066ede452a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:56.255181 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80321ca-ff59-46d4-84fe-b066ede452a3 service neutron] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:56.265035 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 993/1969] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:13:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 14:13:56.601306 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b98624-2e2a-4fa7-acbc-fcfbcb03023f None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:56.601306 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-d7b98624-2e2a-4fa7-acbc-fcfbcb03023f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:13:56.609398 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b98624-2e2a-4fa7-acbc-fcfbcb03023f None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:56.615118 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3f926f-daa0-46b7-9ce6-b876f990bbfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:56.616236 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3f926f-daa0-46b7-9ce6-b876f990bbfa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:56.616506 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3f926f-daa0-46b7-9ce6-b876f990bbfa admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:56.616877 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3f926f-daa0-46b7-9ce6-b876f990bbfa admin admin] PATH_INFO: `/v3/projects/be2dd387a7f149d58d5a241d598da1ec` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:56.618277 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3f926f-daa0-46b7-9ce6-b876f990bbfa admin admin] RBAC: Authorizing `identity:delete_project(project_id=be2dd387a7f149d58d5a241d598da1ec)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:56.620534 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3f926f-daa0-46b7-9ce6-b876f990bbfa admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:56.667498 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-fb3f926f-daa0-46b7-9ce6-b876f990bbfa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be2dd387a7f149d58d5a241d598da1ec', 'request_id': 'req-fb3f926f-daa0-46b7-9ce6-b876f990bbfa'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:56.674846 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-fb3f926f-daa0-46b7-9ce6-b876f990bbfa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be2dd387a7f149d58d5a241d598da1ec', 'request_id': 'req-fb3f926f-daa0-46b7-9ce6-b876f990bbfa'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:56.680883 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-fb3f926f-daa0-46b7-9ce6-b876f990bbfa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be2dd387a7f149d58d5a241d598da1ec', 'request_id': 'req-fb3f926f-daa0-46b7-9ce6-b876f990bbfa'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:56.695546 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-fb3f926f-daa0-46b7-9ce6-b876f990bbfa admin admin] The token cache is being invalidate because project be2dd387a7f149d58d5a241d598da1ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80012) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 14:13:56.695832 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-fb3f926f-daa0-46b7-9ce6-b876f990bbfa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:56.696459 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-fb3f926f-daa0-46b7-9ce6-b876f990bbfa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:56.698113 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 977/1970] 10.222.0.36 () {58 vars in 1232 bytes} [Tue May 3 14:13:56 2022] DELETE /identity/v3/projects/be2dd387a7f149d58d5a241d598da1ec => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:13:56.703436 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80321ca-ff59-46d4-84fe-b066ede452a3 service neutron] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:56.715009 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80321ca-ff59-46d4-84fe-b066ede452a3 service neutron] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:56.776240 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c3a31d-af26-4094-9702-a6a3eb6b123e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:56.777133 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c3a31d-af26-4094-9702-a6a3eb6b123e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:56.777442 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c3a31d-af26-4094-9702-a6a3eb6b123e admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:56.777713 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c3a31d-af26-4094-9702-a6a3eb6b123e admin admin] PATH_INFO: `/v3/users/aa20cfab25fa405db25fc93b7b71a590` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:56.778941 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c3a31d-af26-4094-9702-a6a3eb6b123e admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa20cfab25fa405db25fc93b7b71a590)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:56.781230 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c3a31d-af26-4094-9702-a6a3eb6b123e admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:56.834286 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-a8c3a31d-af26-4094-9702-a6a3eb6b123e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa20cfab25fa405db25fc93b7b71a590'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:56.843455 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-a8c3a31d-af26-4094-9702-a6a3eb6b123e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa20cfab25fa405db25fc93b7b71a590'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:56.844235 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-a8c3a31d-af26-4094-9702-a6a3eb6b123e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa20cfab25fa405db25fc93b7b71a590'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:56.854661 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-a8c3a31d-af26-4094-9702-a6a3eb6b123e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa20cfab25fa405db25fc93b7b71a590'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:56.855711 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-a8c3a31d-af26-4094-9702-a6a3eb6b123e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa20cfab25fa405db25fc93b7b71a590'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:56.873983 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 994/1971] 10.222.0.36 () {58 vars in 1223 bytes} [Tue May 3 14:13:56 2022] DELETE /identity/v3/users/aa20cfab25fa405db25fc93b7b71a590 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:13:57.169926 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3f926f-daa0-46b7-9ce6-b876f990bbfa admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:57.171678 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-fb3f926f-daa0-46b7-9ce6-b876f990bbfa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:13:57.186243 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3f926f-daa0-46b7-9ce6-b876f990bbfa admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:57.255709 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09394cc2-3f43-417c-9f03-ed522fda0f9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:57.256554 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09394cc2-3f43-417c-9f03-ed522fda0f9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:57.256839 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09394cc2-3f43-417c-9f03-ed522fda0f9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:57.257112 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09394cc2-3f43-417c-9f03-ed522fda0f9a admin admin] PATH_INFO: `/v3/projects/f8a71d02fa354e6d9ce4aeb58f20c832` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:57.258372 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09394cc2-3f43-417c-9f03-ed522fda0f9a admin admin] RBAC: Authorizing `identity:delete_project(project_id=f8a71d02fa354e6d9ce4aeb58f20c832)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:57.260275 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09394cc2-3f43-417c-9f03-ed522fda0f9a admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:57.311144 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-09394cc2-3f43-417c-9f03-ed522fda0f9a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8a71d02fa354e6d9ce4aeb58f20c832', 'request_id': 'req-09394cc2-3f43-417c-9f03-ed522fda0f9a'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:57.317349 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-09394cc2-3f43-417c-9f03-ed522fda0f9a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8a71d02fa354e6d9ce4aeb58f20c832', 'request_id': 'req-09394cc2-3f43-417c-9f03-ed522fda0f9a'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:57.322539 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-09394cc2-3f43-417c-9f03-ed522fda0f9a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8a71d02fa354e6d9ce4aeb58f20c832', 'request_id': 'req-09394cc2-3f43-417c-9f03-ed522fda0f9a'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:57.335754 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-09394cc2-3f43-417c-9f03-ed522fda0f9a admin admin] The token cache is being invalidate because project f8a71d02fa354e6d9ce4aeb58f20c832 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80012) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 14:13:57.336409 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-09394cc2-3f43-417c-9f03-ed522fda0f9a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:57.337048 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-09394cc2-3f43-417c-9f03-ed522fda0f9a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:13:57.338768 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 978/1972] 10.222.0.36 () {58 vars in 1232 bytes} [Tue May 3 14:13:57 2022] DELETE /identity/v3/projects/f8a71d02fa354e6d9ce4aeb58f20c832 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:13:57.343898 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63036d06-953d-49d6-8dd4-a8f309361914 None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:57.344187 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63036d06-953d-49d6-8dd4-a8f309361914 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:57.344463 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63036d06-953d-49d6-8dd4-a8f309361914 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:57.363000 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-63036d06-953d-49d6-8dd4-a8f309361914 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:13:57.364235 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-63036d06-953d-49d6-8dd4-a8f309361914 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:13:57.434543 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 995/1973] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:13:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:13:57.442938 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743ffebd-abd1-49fc-8a3f-b6066a1f06ba None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:57.443335 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743ffebd-abd1-49fc-8a3f-b6066a1f06ba None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:57.443620 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743ffebd-abd1-49fc-8a3f-b6066a1f06ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:57.471595 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-743ffebd-abd1-49fc-8a3f-b6066a1f06ba None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:13:57.472793 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-743ffebd-abd1-49fc-8a3f-b6066a1f06ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:13:57.482350 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 979/1974] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:13:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:13:57.487198 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63036d06-953d-49d6-8dd4-a8f309361914 None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:57.497701 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63036d06-953d-49d6-8dd4-a8f309361914 None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:57.503393 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ac18de-21e4-4020-874d-b314f7c35c45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:57.504055 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ac18de-21e4-4020-874d-b314f7c35c45 admin admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:57.504333 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ac18de-21e4-4020-874d-b314f7c35c45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:57.504606 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ac18de-21e4-4020-874d-b314f7c35c45 admin admin] PATH_INFO: `/v3/domains` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:57.505328 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ac18de-21e4-4020-874d-b314f7c35c45 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:13:57.505666 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ac18de-21e4-4020-874d-b314f7c35c45 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:57.507339 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ac18de-21e4-4020-874d-b314f7c35c45 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:57.519870 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 996/1975] 10.222.0.36 () {58 vars in 1152 bytes} [Tue May 3 14:13:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:13:57.524701 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743ffebd-abd1-49fc-8a3f-b6066a1f06ba None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:57.535815 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743ffebd-abd1-49fc-8a3f-b6066a1f06ba None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:57.540698 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b905205-43c6-4b4b-b018-7340f6cdd4dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:57.541457 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b905205-43c6-4b4b-b018-7340f6cdd4dd admin admin] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:57.541744 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b905205-43c6-4b4b-b018-7340f6cdd4dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:57.542019 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b905205-43c6-4b4b-b018-7340f6cdd4dd admin admin] PATH_INFO: `/v3/projects` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:57.542724 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b905205-43c6-4b4b-b018-7340f6cdd4dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:57.549029 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b905205-43c6-4b4b-b018-7340f6cdd4dd admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:57.577947 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 980/1976] 10.222.0.36 () {60 vars in 1152 bytes} [Tue May 3 14:13:57 2022] POST /identity/v3/projects => generated 383 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 14:13:57.582596 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ac18de-21e4-4020-874d-b314f7c35c45 admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:57.594243 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ac18de-21e4-4020-874d-b314f7c35c45 admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:57.660375 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d82ae13-c510-421b-bb08-6b967a4f9e11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:57.661067 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d82ae13-c510-421b-bb08-6b967a4f9e11 admin admin] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:57.661379 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d82ae13-c510-421b-bb08-6b967a4f9e11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:57.661639 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d82ae13-c510-421b-bb08-6b967a4f9e11 admin admin] PATH_INFO: `/v3/users` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:57.662343 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d82ae13-c510-421b-bb08-6b967a4f9e11 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:57.664310 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d82ae13-c510-421b-bb08-6b967a4f9e11 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:57.687844 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 997/1977] 10.222.0.36 () {60 vars in 1143 bytes} [Tue May 3 14:13:57 2022] POST /identity/v3/users => generated 292 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 14:13:57.692129 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b905205-43c6-4b4b-b018-7340f6cdd4dd admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:57.708131 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b905205-43c6-4b4b-b018-7340f6cdd4dd admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:57.713174 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45382719-a8ba-4553-b281-7eabab542890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:57.713882 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45382719-a8ba-4553-b281-7eabab542890 admin admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:57.714165 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45382719-a8ba-4553-b281-7eabab542890 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:57.714439 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45382719-a8ba-4553-b281-7eabab542890 admin admin] PATH_INFO: `/v3/roles` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:57.715168 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45382719-a8ba-4553-b281-7eabab542890 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:57.716920 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45382719-a8ba-4553-b281-7eabab542890 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:57.728997 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 981/1978] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 3 14:13:57 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 14:13:57.733498 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d82ae13-c510-421b-bb08-6b967a4f9e11 admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:57.745090 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d82ae13-c510-421b-bb08-6b967a4f9e11 admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:57.760938 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4717465c-eae6-4847-9026-d5b225e4379d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:57.761872 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4717465c-eae6-4847-9026-d5b225e4379d admin admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:57.762210 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4717465c-eae6-4847-9026-d5b225e4379d admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:57.762542 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4717465c-eae6-4847-9026-d5b225e4379d admin admin] PATH_INFO: `/v3/roles` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:57.763509 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4717465c-eae6-4847-9026-d5b225e4379d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:57.765205 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4717465c-eae6-4847-9026-d5b225e4379d admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:57.779073 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 998/1979] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 3 14:13:57 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 14:13:57.783503 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45382719-a8ba-4553-b281-7eabab542890 admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:57.793595 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45382719-a8ba-4553-b281-7eabab542890 admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:57.798497 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed8179e-0232-4743-afcd-8937d0f56d5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:57.799384 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed8179e-0232-4743-afcd-8937d0f56d5e admin admin] REQUEST_METHOD: `PUT` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:57.799661 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed8179e-0232-4743-afcd-8937d0f56d5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:57.799928 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed8179e-0232-4743-afcd-8937d0f56d5e admin admin] PATH_INFO: `/v3/projects/dc76e011af9c49d59993a186b31bdc23/users/596415bddd384070a8417eff20470284/roles/441fdc11e95b47f4813f72610e39018b` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:57.815767 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed8179e-0232-4743-afcd-8937d0f56d5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc76e011af9c49d59993a186b31bdc23, user_id=596415bddd384070a8417eff20470284, role_id=441fdc11e95b47f4813f72610e39018b)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:57.818491 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed8179e-0232-4743-afcd-8937d0f56d5e admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:57.831999 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 982/1980] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 3 14:13:57 2022] PUT /identity/v3/projects/dc76e011af9c49d59993a186b31bdc23/users/596415bddd384070a8417eff20470284/roles/441fdc11e95b47f4813f72610e39018b => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 14:13:57.844864 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06332cdd-33e9-45ea-92c7-71d0895c1911 None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:57.845201 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06332cdd-33e9-45ea-92c7-71d0895c1911 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:57.845627 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06332cdd-33e9-45ea-92c7-71d0895c1911 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:57.876901 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-06332cdd-33e9-45ea-92c7-71d0895c1911 None None] MFA Rules not processed for user `596415bddd384070a8417eff20470284`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:13:57.878147 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-06332cdd-33e9-45ea-92c7-71d0895c1911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:13:57.943431 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 999/1981] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:13:57 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:13:57.948823 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed8179e-0232-4743-afcd-8937d0f56d5e admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:58.011857 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed8179e-0232-4743-afcd-8937d0f56d5e admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:58.017663 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3ae6ba-9edf-4e24-93e7-89bc848d610c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:58.018625 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3ae6ba-9edf-4e24-93e7-89bc848d610c admin admin] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:58.019036 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3ae6ba-9edf-4e24-93e7-89bc848d610c admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:58.019373 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3ae6ba-9edf-4e24-93e7-89bc848d610c admin admin] PATH_INFO: `/v3/projects` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:58.020458 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3ae6ba-9edf-4e24-93e7-89bc848d610c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:58.022924 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3ae6ba-9edf-4e24-93e7-89bc848d610c admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:58.051703 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 983/1982] 10.222.0.36 () {60 vars in 1152 bytes} [Tue May 3 14:13:57 2022] POST /identity/v3/projects => generated 381 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 14:13:58.055838 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06332cdd-33e9-45ea-92c7-71d0895c1911 None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:58.067394 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06332cdd-33e9-45ea-92c7-71d0895c1911 None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:58.133490 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a250264-64dc-42ef-be27-36721dab067b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:58.133607 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a250264-64dc-42ef-be27-36721dab067b admin admin] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:58.133885 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a250264-64dc-42ef-be27-36721dab067b admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:58.134161 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a250264-64dc-42ef-be27-36721dab067b admin admin] PATH_INFO: `/v3/users` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:58.134849 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a250264-64dc-42ef-be27-36721dab067b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:58.136761 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a250264-64dc-42ef-be27-36721dab067b admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:58.158272 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1000/1983] 10.222.0.36 () {60 vars in 1143 bytes} [Tue May 3 14:13:58 2022] POST /identity/v3/users => generated 297 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 14:13:58.162416 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3ae6ba-9edf-4e24-93e7-89bc848d610c admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:58.173048 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3ae6ba-9edf-4e24-93e7-89bc848d610c admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:58.178120 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2065fb-2645-4d1e-88e8-1a1c4aaa181c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:58.184566 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2065fb-2645-4d1e-88e8-1a1c4aaa181c admin admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:58.184566 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2065fb-2645-4d1e-88e8-1a1c4aaa181c admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:58.184566 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2065fb-2645-4d1e-88e8-1a1c4aaa181c admin admin] PATH_INFO: `/v3/roles` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:58.184566 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2065fb-2645-4d1e-88e8-1a1c4aaa181c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:58.184566 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2065fb-2645-4d1e-88e8-1a1c4aaa181c admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:58.193174 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 984/1984] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 3 14:13:58 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 14:13:58.197453 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a250264-64dc-42ef-be27-36721dab067b admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:58.207247 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a250264-64dc-42ef-be27-36721dab067b admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:58.212341 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a14e47-32bb-42c8-b804-bab59aeeeb66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:58.213223 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a14e47-32bb-42c8-b804-bab59aeeeb66 admin admin] REQUEST_METHOD: `PUT` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:58.213531 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a14e47-32bb-42c8-b804-bab59aeeeb66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:58.213809 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a14e47-32bb-42c8-b804-bab59aeeeb66 admin admin] PATH_INFO: `/v3/projects/ceb4093d33a0430891a85ddb8ea7a03f/users/89125dfab1624e6dab45c1db07b9d3f3/roles/36abe9b50fd8479c86c4f8f70fd85aa3` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:58.236504 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a14e47-32bb-42c8-b804-bab59aeeeb66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ceb4093d33a0430891a85ddb8ea7a03f, user_id=89125dfab1624e6dab45c1db07b9d3f3, role_id=36abe9b50fd8479c86c4f8f70fd85aa3)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:58.239415 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a14e47-32bb-42c8-b804-bab59aeeeb66 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:58.254705 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1001/1985] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 3 14:13:58 2022] PUT /identity/v3/projects/ceb4093d33a0430891a85ddb8ea7a03f/users/89125dfab1624e6dab45c1db07b9d3f3/roles/36abe9b50fd8479c86c4f8f70fd85aa3 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:13:58.258803 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2065fb-2645-4d1e-88e8-1a1c4aaa181c admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:58.269510 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2065fb-2645-4d1e-88e8-1a1c4aaa181c admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:58.325459 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b105c26a-7dad-4f3a-ae51-61379aff7164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:58.326200 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b105c26a-7dad-4f3a-ae51-61379aff7164 admin admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:58.326477 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b105c26a-7dad-4f3a-ae51-61379aff7164 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:58.326749 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b105c26a-7dad-4f3a-ae51-61379aff7164 admin admin] PATH_INFO: `/v3/roles` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:58.327472 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b105c26a-7dad-4f3a-ae51-61379aff7164 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:58.329421 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b105c26a-7dad-4f3a-ae51-61379aff7164 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:58.339883 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 985/1986] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 3 14:13:58 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 14:13:58.343961 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a14e47-32bb-42c8-b804-bab59aeeeb66 admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:58.353916 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a14e47-32bb-42c8-b804-bab59aeeeb66 admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:58.358568 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20df0b72-b95f-43b6-b210-f606271b3944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:58.359460 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20df0b72-b95f-43b6-b210-f606271b3944 admin admin] REQUEST_METHOD: `PUT` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:58.359737 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20df0b72-b95f-43b6-b210-f606271b3944 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:58.360004 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20df0b72-b95f-43b6-b210-f606271b3944 admin admin] PATH_INFO: `/v3/projects/ceb4093d33a0430891a85ddb8ea7a03f/users/89125dfab1624e6dab45c1db07b9d3f3/roles/36abe9b50fd8479c86c4f8f70fd85aa3` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:58.361962 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20df0b72-b95f-43b6-b210-f606271b3944 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ceb4093d33a0430891a85ddb8ea7a03f, user_id=89125dfab1624e6dab45c1db07b9d3f3, role_id=36abe9b50fd8479c86c4f8f70fd85aa3)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:58.364582 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20df0b72-b95f-43b6-b210-f606271b3944 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:58.377456 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1002/1987] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 3 14:13:58 2022] PUT /identity/v3/projects/ceb4093d33a0430891a85ddb8ea7a03f/users/89125dfab1624e6dab45c1db07b9d3f3/roles/36abe9b50fd8479c86c4f8f70fd85aa3 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:13:58.387437 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8320a2-2e53-4790-9055-5af7fb76cddf None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:58.387656 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8320a2-2e53-4790-9055-5af7fb76cddf None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:58.387934 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8320a2-2e53-4790-9055-5af7fb76cddf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:58.414073 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-3b8320a2-2e53-4790-9055-5af7fb76cddf None None] MFA Rules not processed for user `89125dfab1624e6dab45c1db07b9d3f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:13:58.415266 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-3b8320a2-2e53-4790-9055-5af7fb76cddf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:13:58.485001 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 986/1988] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:13:58 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:13:58.495984 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20df0b72-b95f-43b6-b210-f606271b3944 admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:58.497833 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-20df0b72-b95f-43b6-b210-f606271b3944 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:13:58.558422 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20df0b72-b95f-43b6-b210-f606271b3944 admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:58.562803 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74230570-34de-4665-a10d-f3af83aacb46 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b014f4c7ba1414cb8a597f5bc4033f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:58.563443 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74230570-34de-4665-a10d-f3af83aacb46 service cinder] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:58.563792 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74230570-34de-4665-a10d-f3af83aacb46 service cinder] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:58.564060 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74230570-34de-4665-a10d-f3af83aacb46 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:58.574847 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74230570-34de-4665-a10d-f3af83aacb46 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:58.576605 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74230570-34de-4665-a10d-f3af83aacb46 service cinder] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:58.586930 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1003/1989] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:13:58 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 14:13:58.690855 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8320a2-2e53-4790-9055-5af7fb76cddf None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:13:58.701274 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8320a2-2e53-4790-9055-5af7fb76cddf None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:13:58.707000 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22c10a8-0af5-4c99-8ff9-f8b682950e7a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b014f4c7ba1414cb8a597f5bc4033f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:13:58.707740 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22c10a8-0af5-4c99-8ff9-f8b682950e7a service cinder] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:13:58.708080 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22c10a8-0af5-4c99-8ff9-f8b682950e7a service cinder] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:13:58.708503 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22c10a8-0af5-4c99-8ff9-f8b682950e7a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:13:58.767051 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22c10a8-0af5-4c99-8ff9-f8b682950e7a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:13:58.768445 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22c10a8-0af5-4c99-8ff9-f8b682950e7a service cinder] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:13:58.788755 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 987/1990] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:13:58 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 14:14:05.608776 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74230570-34de-4665-a10d-f3af83aacb46 service cinder] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:14:05.674939 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74230570-34de-4665-a10d-f3af83aacb46 service cinder] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:14:05.680129 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddfb04a-884c-4259-a9ae-170799a311ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:14:05.680994 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddfb04a-884c-4259-a9ae-170799a311ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:05.681268 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddfb04a-884c-4259-a9ae-170799a311ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:05.681576 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddfb04a-884c-4259-a9ae-170799a311ff admin admin] PATH_INFO: `/v3/users/596415bddd384070a8417eff20470284` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:05.682860 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddfb04a-884c-4259-a9ae-170799a311ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=596415bddd384070a8417eff20470284)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:14:05.684796 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddfb04a-884c-4259-a9ae-170799a311ff admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:14:05.731667 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-3ddfb04a-884c-4259-a9ae-170799a311ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '596415bddd384070a8417eff20470284'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:14:05.738725 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-3ddfb04a-884c-4259-a9ae-170799a311ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '596415bddd384070a8417eff20470284'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:14:05.739401 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-3ddfb04a-884c-4259-a9ae-170799a311ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '596415bddd384070a8417eff20470284'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:14:05.748488 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-3ddfb04a-884c-4259-a9ae-170799a311ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '596415bddd384070a8417eff20470284'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:14:05.749423 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-3ddfb04a-884c-4259-a9ae-170799a311ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '596415bddd384070a8417eff20470284'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:14:05.771092 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1004/1991] 10.222.0.36 () {58 vars in 1223 bytes} [Tue May 3 14:14:05 2022] DELETE /identity/v3/users/596415bddd384070a8417eff20470284 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:14:05.775881 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5c36c6-c4be-4c98-b13c-d8359a703b12 None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:05.776357 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5c36c6-c4be-4c98-b13c-d8359a703b12 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:05.776599 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5c36c6-c4be-4c98-b13c-d8359a703b12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:05.794879 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-9b5c36c6-c4be-4c98-b13c-d8359a703b12 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:14:05.796679 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-9b5c36c6-c4be-4c98-b13c-d8359a703b12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:14:05.870418 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 988/1992] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:14:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:14:05.880869 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddfb04a-884c-4259-a9ae-170799a311ff admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:14:05.882585 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-3ddfb04a-884c-4259-a9ae-170799a311ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:14:05.943561 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddfb04a-884c-4259-a9ae-170799a311ff admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:14:05.947678 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c5d5fc-60a7-475f-b1a9-31814b1e1a90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '937bea4f355144b4a7ee11baabc3a4cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:14:05.948324 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c5d5fc-60a7-475f-b1a9-31814b1e1a90 service neutron] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:05.948603 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c5d5fc-60a7-475f-b1a9-31814b1e1a90 service neutron] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:05.949406 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c5d5fc-60a7-475f-b1a9-31814b1e1a90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:05.959063 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c5d5fc-60a7-475f-b1a9-31814b1e1a90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:14:05.960510 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c5d5fc-60a7-475f-b1a9-31814b1e1a90 service neutron] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:14:05.971025 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1005/1993] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:14:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 14:14:06.248598 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5c36c6-c4be-4c98-b13c-d8359a703b12 None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:14:06.250218 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-9b5c36c6-c4be-4c98-b13c-d8359a703b12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:14:06.262800 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5c36c6-c4be-4c98-b13c-d8359a703b12 None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:14:06.268333 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93414052-55ff-4693-8afe-4344202988eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:14:06.269265 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93414052-55ff-4693-8afe-4344202988eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:06.269588 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93414052-55ff-4693-8afe-4344202988eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:06.269961 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93414052-55ff-4693-8afe-4344202988eb admin admin] PATH_INFO: `/v3/projects/dc76e011af9c49d59993a186b31bdc23` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:06.271069 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93414052-55ff-4693-8afe-4344202988eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc76e011af9c49d59993a186b31bdc23)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:14:06.273034 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93414052-55ff-4693-8afe-4344202988eb admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:14:06.329524 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-93414052-55ff-4693-8afe-4344202988eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc76e011af9c49d59993a186b31bdc23', 'request_id': 'req-93414052-55ff-4693-8afe-4344202988eb'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:14:06.336700 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-93414052-55ff-4693-8afe-4344202988eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc76e011af9c49d59993a186b31bdc23', 'request_id': 'req-93414052-55ff-4693-8afe-4344202988eb'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:14:06.347389 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-93414052-55ff-4693-8afe-4344202988eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc76e011af9c49d59993a186b31bdc23', 'request_id': 'req-93414052-55ff-4693-8afe-4344202988eb'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:14:06.368045 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-93414052-55ff-4693-8afe-4344202988eb admin admin] The token cache is being invalidate because project dc76e011af9c49d59993a186b31bdc23 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80012) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 14:14:06.368338 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-93414052-55ff-4693-8afe-4344202988eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:14:06.369593 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-93414052-55ff-4693-8afe-4344202988eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:14:06.373069 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 989/1994] 10.222.0.36 () {58 vars in 1232 bytes} [Tue May 3 14:14:06 2022] DELETE /identity/v3/projects/dc76e011af9c49d59993a186b31bdc23 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:14:06.377309 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c5d5fc-60a7-475f-b1a9-31814b1e1a90 service neutron] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:14:06.387190 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c5d5fc-60a7-475f-b1a9-31814b1e1a90 service neutron] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:14:06.447282 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f53e60-1383-4885-836f-47c1f50e9b1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:14:06.448202 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f53e60-1383-4885-836f-47c1f50e9b1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:06.448482 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f53e60-1383-4885-836f-47c1f50e9b1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:06.448759 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f53e60-1383-4885-836f-47c1f50e9b1c admin admin] PATH_INFO: `/v3/users/89125dfab1624e6dab45c1db07b9d3f3` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:06.449965 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f53e60-1383-4885-836f-47c1f50e9b1c admin admin] RBAC: Authorizing `identity:delete_user(user_id=89125dfab1624e6dab45c1db07b9d3f3)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:14:06.451912 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f53e60-1383-4885-836f-47c1f50e9b1c admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:14:06.499309 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-50f53e60-1383-4885-836f-47c1f50e9b1c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89125dfab1624e6dab45c1db07b9d3f3'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:14:06.507195 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-50f53e60-1383-4885-836f-47c1f50e9b1c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89125dfab1624e6dab45c1db07b9d3f3'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:14:06.508027 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-50f53e60-1383-4885-836f-47c1f50e9b1c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89125dfab1624e6dab45c1db07b9d3f3'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:14:06.516897 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-50f53e60-1383-4885-836f-47c1f50e9b1c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89125dfab1624e6dab45c1db07b9d3f3'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:14:06.517828 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-50f53e60-1383-4885-836f-47c1f50e9b1c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89125dfab1624e6dab45c1db07b9d3f3'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:14:06.535708 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1006/1995] 10.222.0.36 () {58 vars in 1223 bytes} [Tue May 3 14:14:06 2022] DELETE /identity/v3/users/89125dfab1624e6dab45c1db07b9d3f3 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 14:14:06.808033 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93414052-55ff-4693-8afe-4344202988eb admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:14:06.809760 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-93414052-55ff-4693-8afe-4344202988eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:14:06.823036 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93414052-55ff-4693-8afe-4344202988eb admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:14:06.880712 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573f6497-a348-48c4-8a46-f8f58604b992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:14:06.881614 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573f6497-a348-48c4-8a46-f8f58604b992 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:06.881892 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573f6497-a348-48c4-8a46-f8f58604b992 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:06.882165 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573f6497-a348-48c4-8a46-f8f58604b992 admin admin] PATH_INFO: `/v3/projects/ceb4093d33a0430891a85ddb8ea7a03f` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:06.883324 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573f6497-a348-48c4-8a46-f8f58604b992 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ceb4093d33a0430891a85ddb8ea7a03f)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:14:06.885226 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573f6497-a348-48c4-8a46-f8f58604b992 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:14:06.934075 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-573f6497-a348-48c4-8a46-f8f58604b992 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ceb4093d33a0430891a85ddb8ea7a03f', 'request_id': 'req-573f6497-a348-48c4-8a46-f8f58604b992'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:14:06.940782 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-573f6497-a348-48c4-8a46-f8f58604b992 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ceb4093d33a0430891a85ddb8ea7a03f', 'request_id': 'req-573f6497-a348-48c4-8a46-f8f58604b992'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:14:06.948074 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-573f6497-a348-48c4-8a46-f8f58604b992 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ceb4093d33a0430891a85ddb8ea7a03f', 'request_id': 'req-573f6497-a348-48c4-8a46-f8f58604b992'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:14:06.963166 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-573f6497-a348-48c4-8a46-f8f58604b992 admin admin] The token cache is being invalidate because project ceb4093d33a0430891a85ddb8ea7a03f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80012) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 14:14:06.963471 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-573f6497-a348-48c4-8a46-f8f58604b992 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:14:06.964272 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-573f6497-a348-48c4-8a46-f8f58604b992 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:14:06.966064 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 990/1996] 10.222.0.36 () {58 vars in 1232 bytes} [Tue May 3 14:14:06 2022] DELETE /identity/v3/projects/ceb4093d33a0430891a85ddb8ea7a03f => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:14:06.971347 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1582a1-0530-4ba4-b81e-16d1f7faf36f None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:06.971851 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1582a1-0530-4ba4-b81e-16d1f7faf36f None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:06.971941 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1582a1-0530-4ba4-b81e-16d1f7faf36f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:06.990959 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-2b1582a1-0530-4ba4-b81e-16d1f7faf36f None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:14:06.992162 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-2b1582a1-0530-4ba4-b81e-16d1f7faf36f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:14:07.053892 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1007/1997] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:14:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:14:07.062851 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9addcd1e-91db-4b02-b23d-b4f775196056 None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:07.063346 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9addcd1e-91db-4b02-b23d-b4f775196056 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:07.063629 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9addcd1e-91db-4b02-b23d-b4f775196056 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:07.081744 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-9addcd1e-91db-4b02-b23d-b4f775196056 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:14:07.082916 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-9addcd1e-91db-4b02-b23d-b4f775196056 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:14:07.091829 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 991/1998] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:14:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:14:07.096289 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1582a1-0530-4ba4-b81e-16d1f7faf36f None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:14:07.107330 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1582a1-0530-4ba4-b81e-16d1f7faf36f None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:14:07.113963 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bd3a06-c832-48f3-b287-b3880e5c124c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:14:07.114799 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bd3a06-c832-48f3-b287-b3880e5c124c admin admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:07.115077 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bd3a06-c832-48f3-b287-b3880e5c124c admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:07.115336 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bd3a06-c832-48f3-b287-b3880e5c124c admin admin] PATH_INFO: `/v3/domains` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:07.116079 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bd3a06-c832-48f3-b287-b3880e5c124c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:14:07.116378 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bd3a06-c832-48f3-b287-b3880e5c124c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:14:07.118021 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bd3a06-c832-48f3-b287-b3880e5c124c admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:14:07.130395 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1008/1999] 10.222.0.36 () {58 vars in 1152 bytes} [Tue May 3 14:14:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:14:07.135219 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9addcd1e-91db-4b02-b23d-b4f775196056 None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:14:07.148427 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9addcd1e-91db-4b02-b23d-b4f775196056 None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:14:07.152958 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9a1b74-935f-4bf7-9f32-5db616afcc7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:14:07.153651 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9a1b74-935f-4bf7-9f32-5db616afcc7f admin admin] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:07.153928 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9a1b74-935f-4bf7-9f32-5db616afcc7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:07.154198 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9a1b74-935f-4bf7-9f32-5db616afcc7f admin admin] PATH_INFO: `/v3/projects` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:07.154883 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9a1b74-935f-4bf7-9f32-5db616afcc7f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:14:07.156905 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9a1b74-935f-4bf7-9f32-5db616afcc7f admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:14:07.182855 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 992/2000] 10.222.0.36 () {60 vars in 1152 bytes} [Tue May 3 14:14:07 2022] POST /identity/v3/projects => generated 383 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 14:14:07.187612 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bd3a06-c832-48f3-b287-b3880e5c124c admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:14:07.197951 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bd3a06-c832-48f3-b287-b3880e5c124c admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:14:07.254621 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee9ef71-6173-4739-87e3-43f248038f87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:14:07.255310 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee9ef71-6173-4739-87e3-43f248038f87 admin admin] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:07.255592 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee9ef71-6173-4739-87e3-43f248038f87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:07.255882 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee9ef71-6173-4739-87e3-43f248038f87 admin admin] PATH_INFO: `/v3/users` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:07.256562 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee9ef71-6173-4739-87e3-43f248038f87 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:14:07.258515 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee9ef71-6173-4739-87e3-43f248038f87 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:14:07.279897 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1009/2001] 10.222.0.36 () {60 vars in 1143 bytes} [Tue May 3 14:14:07 2022] POST /identity/v3/users => generated 292 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 14:14:07.284266 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9a1b74-935f-4bf7-9f32-5db616afcc7f admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:14:07.294973 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9a1b74-935f-4bf7-9f32-5db616afcc7f admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:14:07.300273 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e77d031-ea16-4802-b868-e3c5f700d406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:14:07.300992 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e77d031-ea16-4802-b868-e3c5f700d406 admin admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:07.301279 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e77d031-ea16-4802-b868-e3c5f700d406 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:07.301586 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e77d031-ea16-4802-b868-e3c5f700d406 admin admin] PATH_INFO: `/v3/roles` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:07.302314 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e77d031-ea16-4802-b868-e3c5f700d406 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:14:07.303911 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e77d031-ea16-4802-b868-e3c5f700d406 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:14:07.315177 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 993/2002] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 3 14:14:07 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 14:14:07.320865 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee9ef71-6173-4739-87e3-43f248038f87 admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:14:07.331002 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee9ef71-6173-4739-87e3-43f248038f87 admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:14:07.336779 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509ea2de-53c4-413b-8868-ba262a75c5dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:14:07.337482 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509ea2de-53c4-413b-8868-ba262a75c5dd admin admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:07.337756 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509ea2de-53c4-413b-8868-ba262a75c5dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:07.338024 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509ea2de-53c4-413b-8868-ba262a75c5dd admin admin] PATH_INFO: `/v3/roles` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:07.338744 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509ea2de-53c4-413b-8868-ba262a75c5dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:14:07.340337 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509ea2de-53c4-413b-8868-ba262a75c5dd admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:14:07.350681 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1010/2003] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 3 14:14:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 14:14:07.354947 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e77d031-ea16-4802-b868-e3c5f700d406 admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:14:07.366602 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e77d031-ea16-4802-b868-e3c5f700d406 admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:14:07.371963 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f073c2-8a37-47b5-8924-061eb4e7761b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:14:07.372849 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f073c2-8a37-47b5-8924-061eb4e7761b admin admin] REQUEST_METHOD: `PUT` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:07.373121 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f073c2-8a37-47b5-8924-061eb4e7761b admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:07.373428 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f073c2-8a37-47b5-8924-061eb4e7761b admin admin] PATH_INFO: `/v3/projects/b80408cab29d41e5bee10c5979a19741/users/78b7c4c87e9e4efab6753f55fe9887bb/roles/441fdc11e95b47f4813f72610e39018b` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:07.388976 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f073c2-8a37-47b5-8924-061eb4e7761b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b80408cab29d41e5bee10c5979a19741, user_id=78b7c4c87e9e4efab6753f55fe9887bb, role_id=441fdc11e95b47f4813f72610e39018b)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:14:07.391785 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f073c2-8a37-47b5-8924-061eb4e7761b admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:14:07.407412 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 994/2004] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 3 14:14:07 2022] PUT /identity/v3/projects/b80408cab29d41e5bee10c5979a19741/users/78b7c4c87e9e4efab6753f55fe9887bb/roles/441fdc11e95b47f4813f72610e39018b => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 14:14:07.417683 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90194449-da87-43b3-9abd-dc2ef89a124f None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:07.418076 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90194449-da87-43b3-9abd-dc2ef89a124f None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:07.418481 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90194449-da87-43b3-9abd-dc2ef89a124f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:07.446441 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-90194449-da87-43b3-9abd-dc2ef89a124f None None] MFA Rules not processed for user `78b7c4c87e9e4efab6753f55fe9887bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:14:07.447648 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-90194449-da87-43b3-9abd-dc2ef89a124f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:14:07.513159 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1011/2005] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:14:07 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:14:07.524260 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f073c2-8a37-47b5-8924-061eb4e7761b admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:14:07.526111 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-59f073c2-8a37-47b5-8924-061eb4e7761b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:14:07.582868 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f073c2-8a37-47b5-8924-061eb4e7761b admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:14:07.587409 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a14f8aa-0378-4e60-9f3f-cfd9a683428d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b014f4c7ba1414cb8a597f5bc4033f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:14:07.588064 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a14f8aa-0378-4e60-9f3f-cfd9a683428d service cinder] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:07.588339 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a14f8aa-0378-4e60-9f3f-cfd9a683428d service cinder] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:07.588609 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a14f8aa-0378-4e60-9f3f-cfd9a683428d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:07.597012 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a14f8aa-0378-4e60-9f3f-cfd9a683428d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:14:07.598458 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a14f8aa-0378-4e60-9f3f-cfd9a683428d service cinder] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:14:07.607279 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 995/2006] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:14:07 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 03 14:14:09.488377 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90194449-da87-43b3-9abd-dc2ef89a124f None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:14:09.489990 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-90194449-da87-43b3-9abd-dc2ef89a124f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:14:09.586991 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90194449-da87-43b3-9abd-dc2ef89a124f None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:14:09.593256 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47edbbc4-1ebe-4a5d-9867-034613310c14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:14:09.594986 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47edbbc4-1ebe-4a5d-9867-034613310c14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:09.595408 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47edbbc4-1ebe-4a5d-9867-034613310c14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:09.595834 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47edbbc4-1ebe-4a5d-9867-034613310c14 admin admin] PATH_INFO: `/v3/users/46538be77902451ca72c7ce16303a32a` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:09.597851 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47edbbc4-1ebe-4a5d-9867-034613310c14 admin admin] RBAC: Authorizing `identity:delete_user(user_id=46538be77902451ca72c7ce16303a32a)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:14:09.599917 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47edbbc4-1ebe-4a5d-9867-034613310c14 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:14:09.656851 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-47edbbc4-1ebe-4a5d-9867-034613310c14 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46538be77902451ca72c7ce16303a32a'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:14:09.665731 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-47edbbc4-1ebe-4a5d-9867-034613310c14 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46538be77902451ca72c7ce16303a32a'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:14:09.666762 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-47edbbc4-1ebe-4a5d-9867-034613310c14 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46538be77902451ca72c7ce16303a32a'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:14:09.676871 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-47edbbc4-1ebe-4a5d-9867-034613310c14 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46538be77902451ca72c7ce16303a32a'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:14:09.677632 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-47edbbc4-1ebe-4a5d-9867-034613310c14 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46538be77902451ca72c7ce16303a32a'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:14:09.706420 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1012/2007] 10.222.0.36 () {58 vars in 1223 bytes} [Tue May 3 14:14:09 2022] DELETE /identity/v3/users/46538be77902451ca72c7ce16303a32a => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:14:09.711730 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9d5b29-73aa-4456-b406-ebdfbfd12297 None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:09.712722 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9d5b29-73aa-4456-b406-ebdfbfd12297 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:09.713078 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9d5b29-73aa-4456-b406-ebdfbfd12297 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:09.752436 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-af9d5b29-73aa-4456-b406-ebdfbfd12297 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:14:09.753743 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-af9d5b29-73aa-4456-b406-ebdfbfd12297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:14:09.815807 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 996/2008] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:14:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:14:09.828859 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47edbbc4-1ebe-4a5d-9867-034613310c14 admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:14:09.836603 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-47edbbc4-1ebe-4a5d-9867-034613310c14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:14:09.894915 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47edbbc4-1ebe-4a5d-9867-034613310c14 admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:14:09.899437 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77877e15-a43c-47b9-a5d9-7f8fa85a07b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '937bea4f355144b4a7ee11baabc3a4cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:14:09.900176 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77877e15-a43c-47b9-a5d9-7f8fa85a07b2 service neutron] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:09.900456 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77877e15-a43c-47b9-a5d9-7f8fa85a07b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:09.900776 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77877e15-a43c-47b9-a5d9-7f8fa85a07b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:09.910973 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77877e15-a43c-47b9-a5d9-7f8fa85a07b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:14:09.912410 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77877e15-a43c-47b9-a5d9-7f8fa85a07b2 service neutron] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:14:09.921910 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1013/2009] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:14:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 14:14:10.224407 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9d5b29-73aa-4456-b406-ebdfbfd12297 None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:14:10.225870 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-af9d5b29-73aa-4456-b406-ebdfbfd12297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:14:10.242557 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9d5b29-73aa-4456-b406-ebdfbfd12297 None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:14:10.248214 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a2e675-b8cf-4532-a167-bace2e2c0bb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:14:10.249097 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a2e675-b8cf-4532-a167-bace2e2c0bb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:10.249422 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a2e675-b8cf-4532-a167-bace2e2c0bb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:10.249693 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a2e675-b8cf-4532-a167-bace2e2c0bb2 admin admin] PATH_INFO: `/v3/projects/6f9a9e044f4c4e6b83b39cbaa7b69d6c` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:10.251066 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a2e675-b8cf-4532-a167-bace2e2c0bb2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f9a9e044f4c4e6b83b39cbaa7b69d6c)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:14:10.253109 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a2e675-b8cf-4532-a167-bace2e2c0bb2 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:14:10.327205 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-98a2e675-b8cf-4532-a167-bace2e2c0bb2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f9a9e044f4c4e6b83b39cbaa7b69d6c', 'request_id': 'req-98a2e675-b8cf-4532-a167-bace2e2c0bb2'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:14:10.342396 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-98a2e675-b8cf-4532-a167-bace2e2c0bb2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f9a9e044f4c4e6b83b39cbaa7b69d6c', 'request_id': 'req-98a2e675-b8cf-4532-a167-bace2e2c0bb2'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:14:10.350690 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-98a2e675-b8cf-4532-a167-bace2e2c0bb2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f9a9e044f4c4e6b83b39cbaa7b69d6c', 'request_id': 'req-98a2e675-b8cf-4532-a167-bace2e2c0bb2'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:14:10.381922 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-98a2e675-b8cf-4532-a167-bace2e2c0bb2 admin admin] The token cache is being invalidate because project 6f9a9e044f4c4e6b83b39cbaa7b69d6c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80012) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 14:14:10.382215 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-98a2e675-b8cf-4532-a167-bace2e2c0bb2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:14:10.383442 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-98a2e675-b8cf-4532-a167-bace2e2c0bb2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:14:10.385548 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 997/2010] 10.222.0.36 () {58 vars in 1232 bytes} [Tue May 3 14:14:10 2022] DELETE /identity/v3/projects/6f9a9e044f4c4e6b83b39cbaa7b69d6c => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:14:10.390717 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899cf5f7-8b9e-4e02-b713-fd9f190b2d19 None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:10.391164 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899cf5f7-8b9e-4e02-b713-fd9f190b2d19 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:10.391484 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899cf5f7-8b9e-4e02-b713-fd9f190b2d19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:10.414346 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-899cf5f7-8b9e-4e02-b713-fd9f190b2d19 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:14:10.418182 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-899cf5f7-8b9e-4e02-b713-fd9f190b2d19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:14:10.504002 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1014/2011] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:14:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:14:10.514094 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b13abf4-e4a5-40d5-a0d9-6f1e4cb058b3 None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:10.514539 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b13abf4-e4a5-40d5-a0d9-6f1e4cb058b3 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:10.514830 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b13abf4-e4a5-40d5-a0d9-6f1e4cb058b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:10.534067 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-3b13abf4-e4a5-40d5-a0d9-6f1e4cb058b3 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:14:10.535275 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-3b13abf4-e4a5-40d5-a0d9-6f1e4cb058b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:14:10.544068 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 998/2012] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:14:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:14:10.548485 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899cf5f7-8b9e-4e02-b713-fd9f190b2d19 None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:14:10.558995 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899cf5f7-8b9e-4e02-b713-fd9f190b2d19 None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:14:10.565070 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51e337e-0170-4ad1-9dc6-d47e4a1de2fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:14:10.565884 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51e337e-0170-4ad1-9dc6-d47e4a1de2fa admin admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:10.566138 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51e337e-0170-4ad1-9dc6-d47e4a1de2fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:10.566405 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51e337e-0170-4ad1-9dc6-d47e4a1de2fa admin admin] PATH_INFO: `/v3/domains` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:10.567336 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51e337e-0170-4ad1-9dc6-d47e4a1de2fa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:14:10.567648 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51e337e-0170-4ad1-9dc6-d47e4a1de2fa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:14:10.570081 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51e337e-0170-4ad1-9dc6-d47e4a1de2fa admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:14:10.588151 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1015/2013] 10.222.0.36 () {58 vars in 1152 bytes} [Tue May 3 14:14:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 14:14:10.592548 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b13abf4-e4a5-40d5-a0d9-6f1e4cb058b3 None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:14:10.604983 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b13abf4-e4a5-40d5-a0d9-6f1e4cb058b3 None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:14:10.610115 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb294bf-5657-4860-bf7c-656332b82ed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:14:10.610779 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb294bf-5657-4860-bf7c-656332b82ed0 admin admin] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:10.611056 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb294bf-5657-4860-bf7c-656332b82ed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:10.611325 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb294bf-5657-4860-bf7c-656332b82ed0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:10.612051 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb294bf-5657-4860-bf7c-656332b82ed0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:14:10.614096 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb294bf-5657-4860-bf7c-656332b82ed0 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:14:10.646659 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 999/2014] 10.222.0.36 () {60 vars in 1152 bytes} [Tue May 3 14:14:10 2022] POST /identity/v3/projects => generated 385 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 14:14:10.650950 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51e337e-0170-4ad1-9dc6-d47e4a1de2fa admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:14:10.662851 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51e337e-0170-4ad1-9dc6-d47e4a1de2fa admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:14:10.729413 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c831bc6-9e00-49e4-a19d-f240d1870a61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:14:10.730020 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c831bc6-9e00-49e4-a19d-f240d1870a61 admin admin] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:10.730298 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c831bc6-9e00-49e4-a19d-f240d1870a61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:10.730568 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c831bc6-9e00-49e4-a19d-f240d1870a61 admin admin] PATH_INFO: `/v3/users` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:10.731289 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c831bc6-9e00-49e4-a19d-f240d1870a61 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:14:10.733201 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c831bc6-9e00-49e4-a19d-f240d1870a61 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:14:10.756803 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1016/2015] 10.222.0.36 () {60 vars in 1143 bytes} [Tue May 3 14:14:10 2022] POST /identity/v3/users => generated 293 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 14:14:10.760998 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb294bf-5657-4860-bf7c-656332b82ed0 admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:14:10.771859 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb294bf-5657-4860-bf7c-656332b82ed0 admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:14:10.776409 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164b0b3e-682d-4968-8e3a-02556be88a7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:14:10.777140 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164b0b3e-682d-4968-8e3a-02556be88a7f admin admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:10.777458 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164b0b3e-682d-4968-8e3a-02556be88a7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:10.777731 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164b0b3e-682d-4968-8e3a-02556be88a7f admin admin] PATH_INFO: `/v3/roles` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:10.778449 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164b0b3e-682d-4968-8e3a-02556be88a7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:14:10.780047 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164b0b3e-682d-4968-8e3a-02556be88a7f admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:14:10.791630 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1000/2016] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 3 14:14:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 14:14:10.795564 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c831bc6-9e00-49e4-a19d-f240d1870a61 admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:14:10.805776 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c831bc6-9e00-49e4-a19d-f240d1870a61 admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:14:10.810543 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1787f3b6-c493-447c-90b5-5395e7ceb4ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:14:10.811204 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1787f3b6-c493-447c-90b5-5395e7ceb4ef admin admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:10.811477 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1787f3b6-c493-447c-90b5-5395e7ceb4ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:10.811747 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1787f3b6-c493-447c-90b5-5395e7ceb4ef admin admin] PATH_INFO: `/v3/roles` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:10.812627 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1787f3b6-c493-447c-90b5-5395e7ceb4ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:14:10.814387 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1787f3b6-c493-447c-90b5-5395e7ceb4ef admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:14:10.824751 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1017/2017] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 3 14:14:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 14:14:10.829076 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164b0b3e-682d-4968-8e3a-02556be88a7f admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:14:10.839587 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164b0b3e-682d-4968-8e3a-02556be88a7f admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:14:10.844640 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fb3e8a-fbad-40e9-8335-1835b4b97ada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:14:10.845790 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fb3e8a-fbad-40e9-8335-1835b4b97ada admin admin] REQUEST_METHOD: `PUT` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:10.846068 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fb3e8a-fbad-40e9-8335-1835b4b97ada admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:10.846341 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fb3e8a-fbad-40e9-8335-1835b4b97ada admin admin] PATH_INFO: `/v3/projects/1c2479422e8c413e8ee554aa4f355bca/users/39f0797cbeb448769677f54f936b915d/roles/441fdc11e95b47f4813f72610e39018b` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:10.862278 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fb3e8a-fbad-40e9-8335-1835b4b97ada admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c2479422e8c413e8ee554aa4f355bca, user_id=39f0797cbeb448769677f54f936b915d, role_id=441fdc11e95b47f4813f72610e39018b)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:14:10.865090 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fb3e8a-fbad-40e9-8335-1835b4b97ada admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:14:10.880980 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1001/2018] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 3 14:14:10 2022] PUT /identity/v3/projects/1c2479422e8c413e8ee554aa4f355bca/users/39f0797cbeb448769677f54f936b915d/roles/441fdc11e95b47f4813f72610e39018b => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:14:10.886266 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651ab685-c1eb-4ce6-b0c8-bb68fe667d71 None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:10.886626 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651ab685-c1eb-4ce6-b0c8-bb68fe667d71 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:10.887004 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651ab685-c1eb-4ce6-b0c8-bb68fe667d71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:10.905361 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-651ab685-c1eb-4ce6-b0c8-bb68fe667d71 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:14:10.906703 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-651ab685-c1eb-4ce6-b0c8-bb68fe667d71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:14:10.979071 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1018/2019] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:14:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:14:10.990508 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fb3e8a-fbad-40e9-8335-1835b4b97ada admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:14:10.992586 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-91fb3e8a-fbad-40e9-8335-1835b4b97ada admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:14:11.058329 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fb3e8a-fbad-40e9-8335-1835b4b97ada admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:14:11.065655 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a9c2e6-47c7-4366-8b43-3c7920fc4853 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '937bea4f355144b4a7ee11baabc3a4cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:14:11.066323 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a9c2e6-47c7-4366-8b43-3c7920fc4853 service neutron] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:11.066604 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a9c2e6-47c7-4366-8b43-3c7920fc4853 service neutron] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:11.066902 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a9c2e6-47c7-4366-8b43-3c7920fc4853 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:11.077009 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a9c2e6-47c7-4366-8b43-3c7920fc4853 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:14:11.078797 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a9c2e6-47c7-4366-8b43-3c7920fc4853 service neutron] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:14:11.089322 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1002/2020] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:14:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 14:14:13.862825 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651ab685-c1eb-4ce6-b0c8-bb68fe667d71 None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:14:13.865094 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-651ab685-c1eb-4ce6-b0c8-bb68fe667d71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:14:13.892587 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651ab685-c1eb-4ce6-b0c8-bb68fe667d71 None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:14:13.926689 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4573a41-2161-486b-9401-c848b2d0176b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:14:13.927708 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4573a41-2161-486b-9401-c848b2d0176b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:13.931724 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4573a41-2161-486b-9401-c848b2d0176b admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:13.933112 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4573a41-2161-486b-9401-c848b2d0176b admin admin] PATH_INFO: `/v3/users/5548b72c4cac4c35a5455b66c678c7de` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:13.934753 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4573a41-2161-486b-9401-c848b2d0176b admin admin] RBAC: Authorizing `identity:delete_user(user_id=5548b72c4cac4c35a5455b66c678c7de)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:14:13.936717 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4573a41-2161-486b-9401-c848b2d0176b admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:14:14.036530 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-b4573a41-2161-486b-9401-c848b2d0176b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5548b72c4cac4c35a5455b66c678c7de'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:14:14.048557 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-b4573a41-2161-486b-9401-c848b2d0176b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5548b72c4cac4c35a5455b66c678c7de'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:14:14.049408 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-b4573a41-2161-486b-9401-c848b2d0176b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5548b72c4cac4c35a5455b66c678c7de'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:14:14.066362 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-b4573a41-2161-486b-9401-c848b2d0176b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5548b72c4cac4c35a5455b66c678c7de'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:14:14.066362 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-b4573a41-2161-486b-9401-c848b2d0176b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5548b72c4cac4c35a5455b66c678c7de'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:14:14.103329 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1019/2021] 10.222.0.36 () {58 vars in 1223 bytes} [Tue May 3 14:14:13 2022] DELETE /identity/v3/users/5548b72c4cac4c35a5455b66c678c7de => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:14:14.107991 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa0e0c3-ed43-428e-ae83-1a52a689e058 None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:14.108501 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa0e0c3-ed43-428e-ae83-1a52a689e058 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:14.108615 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa0e0c3-ed43-428e-ae83-1a52a689e058 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:14.126843 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-efa0e0c3-ed43-428e-ae83-1a52a689e058 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:14:14.128388 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-efa0e0c3-ed43-428e-ae83-1a52a689e058 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:14:14.200866 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1003/2022] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:14:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:14:14.211165 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4573a41-2161-486b-9401-c848b2d0176b admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:14:14.212754 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-b4573a41-2161-486b-9401-c848b2d0176b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:14:14.275985 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4573a41-2161-486b-9401-c848b2d0176b admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:14:14.282546 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bb2363-00bb-429b-9407-c598467d65bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '937bea4f355144b4a7ee11baabc3a4cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:14:14.283966 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bb2363-00bb-429b-9407-c598467d65bb service neutron] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:14.284250 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bb2363-00bb-429b-9407-c598467d65bb service neutron] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:14.284528 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bb2363-00bb-429b-9407-c598467d65bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:14.294876 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bb2363-00bb-429b-9407-c598467d65bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:14:14.296710 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bb2363-00bb-429b-9407-c598467d65bb service neutron] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:14:14.310821 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1020/2023] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:14:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 14:14:14.939804 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa0e0c3-ed43-428e-ae83-1a52a689e058 None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:14:14.941545 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-efa0e0c3-ed43-428e-ae83-1a52a689e058 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:14:14.962459 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa0e0c3-ed43-428e-ae83-1a52a689e058 None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:14:14.977233 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4083f00-e486-4d9c-b670-751f55c9b82f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:14:14.978364 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4083f00-e486-4d9c-b670-751f55c9b82f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:14.978798 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4083f00-e486-4d9c-b670-751f55c9b82f admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:14.979308 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4083f00-e486-4d9c-b670-751f55c9b82f admin admin] PATH_INFO: `/v3/projects/a9fdda0cde02440c91c1fa1b6a01b732` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:14.980706 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4083f00-e486-4d9c-b670-751f55c9b82f admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9fdda0cde02440c91c1fa1b6a01b732)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:14:14.982846 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4083f00-e486-4d9c-b670-751f55c9b82f admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:14:15.103928 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-a4083f00-e486-4d9c-b670-751f55c9b82f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9fdda0cde02440c91c1fa1b6a01b732', 'request_id': 'req-a4083f00-e486-4d9c-b670-751f55c9b82f'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:14:15.124006 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-a4083f00-e486-4d9c-b670-751f55c9b82f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9fdda0cde02440c91c1fa1b6a01b732', 'request_id': 'req-a4083f00-e486-4d9c-b670-751f55c9b82f'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:14:15.126866 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bb2363-00bb-429b-9407-c598467d65bb service neutron] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:14:15.128992 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-f3bb2363-00bb-429b-9407-c598467d65bb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:14:15.137495 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-a4083f00-e486-4d9c-b670-751f55c9b82f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9fdda0cde02440c91c1fa1b6a01b732', 'request_id': 'req-a4083f00-e486-4d9c-b670-751f55c9b82f'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:14:15.148399 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bb2363-00bb-429b-9407-c598467d65bb service neutron] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:14:15.165208 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-a4083f00-e486-4d9c-b670-751f55c9b82f admin admin] The token cache is being invalidate because project a9fdda0cde02440c91c1fa1b6a01b732 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80012) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 14:14:15.165590 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-a4083f00-e486-4d9c-b670-751f55c9b82f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:14:15.166462 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-a4083f00-e486-4d9c-b670-751f55c9b82f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:14:15.168174 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1004/2024] 10.222.0.36 () {58 vars in 1232 bytes} [Tue May 3 14:14:14 2022] DELETE /identity/v3/projects/a9fdda0cde02440c91c1fa1b6a01b732 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:14:15.173108 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6889942-4745-4870-af84-2eeddca0f3cb None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:15.173620 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6889942-4745-4870-af84-2eeddca0f3cb None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:15.174177 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6889942-4745-4870-af84-2eeddca0f3cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:15.231716 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-d6889942-4745-4870-af84-2eeddca0f3cb None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:14:15.236415 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-d6889942-4745-4870-af84-2eeddca0f3cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:14:15.300135 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25528efe-adc4-4756-8d13-6cdf0abfb61b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:14:15.301229 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25528efe-adc4-4756-8d13-6cdf0abfb61b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:15.301626 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25528efe-adc4-4756-8d13-6cdf0abfb61b admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:15.301996 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25528efe-adc4-4756-8d13-6cdf0abfb61b admin admin] PATH_INFO: `/v3/users/b195a0cfa579445e97f2081bab44e896` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:15.308453 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25528efe-adc4-4756-8d13-6cdf0abfb61b admin admin] RBAC: Authorizing `identity:delete_user(user_id=b195a0cfa579445e97f2081bab44e896)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:14:15.310595 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25528efe-adc4-4756-8d13-6cdf0abfb61b admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:14:15.401967 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-25528efe-adc4-4756-8d13-6cdf0abfb61b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b195a0cfa579445e97f2081bab44e896'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:14:15.429970 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-25528efe-adc4-4756-8d13-6cdf0abfb61b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b195a0cfa579445e97f2081bab44e896'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:14:15.434809 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-25528efe-adc4-4756-8d13-6cdf0abfb61b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b195a0cfa579445e97f2081bab44e896'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:14:15.447892 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-25528efe-adc4-4756-8d13-6cdf0abfb61b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b195a0cfa579445e97f2081bab44e896'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:14:15.448421 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1005/2025] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:14:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:14:15.448556 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-25528efe-adc4-4756-8d13-6cdf0abfb61b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b195a0cfa579445e97f2081bab44e896'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:14:15.458730 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5c9dca-9037-43bf-afc8-31492fffcc98 None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:15.459026 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5c9dca-9037-43bf-afc8-31492fffcc98 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:15.459409 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5c9dca-9037-43bf-afc8-31492fffcc98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:15.482080 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1021/2026] 10.222.0.36 () {58 vars in 1223 bytes} [Tue May 3 14:14:15 2022] DELETE /identity/v3/users/b195a0cfa579445e97f2081bab44e896 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 14:14:15.487165 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-5e5c9dca-9037-43bf-afc8-31492fffcc98 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:14:15.489229 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b61423-69a6-4bcd-ad20-0d6135823560 None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:15.489641 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b61423-69a6-4bcd-ad20-0d6135823560 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:15.489922 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b61423-69a6-4bcd-ad20-0d6135823560 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:15.491501 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-5e5c9dca-9037-43bf-afc8-31492fffcc98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:14:15.535231 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-67b61423-69a6-4bcd-ad20-0d6135823560 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:14:15.537145 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-67b61423-69a6-4bcd-ad20-0d6135823560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:14:15.656200 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1006/2027] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:14:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 14:14:15.658863 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1022/2028] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:14:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:14:15.661932 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5c9dca-9037-43bf-afc8-31492fffcc98 None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:14:15.670277 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b61423-69a6-4bcd-ad20-0d6135823560 None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:14:15.672240 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-67b61423-69a6-4bcd-ad20-0d6135823560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:14:15.672838 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5c9dca-9037-43bf-afc8-31492fffcc98 None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:14:15.681087 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fba3b5-a3ee-4b2e-b4e9-100fe6debd0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:14:15.682140 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fba3b5-a3ee-4b2e-b4e9-100fe6debd0a admin admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:15.683448 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fba3b5-a3ee-4b2e-b4e9-100fe6debd0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:15.685377 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fba3b5-a3ee-4b2e-b4e9-100fe6debd0a admin admin] PATH_INFO: `/v3/domains` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:15.686384 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fba3b5-a3ee-4b2e-b4e9-100fe6debd0a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80012) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:14:15.686902 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fba3b5-a3ee-4b2e-b4e9-100fe6debd0a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:14:15.689063 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fba3b5-a3ee-4b2e-b4e9-100fe6debd0a admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:14:15.705724 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1007/2029] 10.222.0.36 () {58 vars in 1152 bytes} [Tue May 3 14:14:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:14:15.710286 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fba3b5-a3ee-4b2e-b4e9-100fe6debd0a admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:14:15.731599 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fba3b5-a3ee-4b2e-b4e9-100fe6debd0a admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:14:15.738801 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9b44b3-7fda-4830-8f51-8676b86e9263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:14:15.740987 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9b44b3-7fda-4830-8f51-8676b86e9263 admin admin] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:15.741486 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9b44b3-7fda-4830-8f51-8676b86e9263 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:15.741944 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9b44b3-7fda-4830-8f51-8676b86e9263 admin admin] PATH_INFO: `/v3/projects` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:15.742896 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9b44b3-7fda-4830-8f51-8676b86e9263 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:14:15.745309 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9b44b3-7fda-4830-8f51-8676b86e9263 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:14:15.764145 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b61423-69a6-4bcd-ad20-0d6135823560 None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:14:15.768779 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f919f30c-8a6a-49fb-9ce6-0b6f16523f5c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '937bea4f355144b4a7ee11baabc3a4cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:14:15.769723 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f919f30c-8a6a-49fb-9ce6-0b6f16523f5c service neutron] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:15.770185 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f919f30c-8a6a-49fb-9ce6-0b6f16523f5c service neutron] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:15.770541 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f919f30c-8a6a-49fb-9ce6-0b6f16523f5c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:15.787292 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f919f30c-8a6a-49fb-9ce6-0b6f16523f5c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:14:15.789060 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f919f30c-8a6a-49fb-9ce6-0b6f16523f5c service neutron] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:14:15.797870 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1008/2030] 10.222.0.36 () {60 vars in 1152 bytes} [Tue May 3 14:14:15 2022] POST /identity/v3/projects => generated 373 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 14:14:15.801824 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9b44b3-7fda-4830-8f51-8676b86e9263 admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:14:15.816568 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1023/2031] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:14:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 03 14:14:15.890333 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9b44b3-7fda-4830-8f51-8676b86e9263 admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:14:15.896391 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a59c17d-db48-483a-ba0e-3a3781c1ea77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:14:15.897342 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a59c17d-db48-483a-ba0e-3a3781c1ea77 admin admin] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:15.898147 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a59c17d-db48-483a-ba0e-3a3781c1ea77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:15.898147 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a59c17d-db48-483a-ba0e-3a3781c1ea77 admin admin] PATH_INFO: `/v3/users` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:15.912656 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a59c17d-db48-483a-ba0e-3a3781c1ea77 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:14:15.914898 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a59c17d-db48-483a-ba0e-3a3781c1ea77 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:14:16.012688 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f919f30c-8a6a-49fb-9ce6-0b6f16523f5c service neutron] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:14:16.033246 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1009/2032] 10.222.0.36 () {60 vars in 1143 bytes} [Tue May 3 14:14:15 2022] POST /identity/v3/users => generated 287 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 14:14:16.039905 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f919f30c-8a6a-49fb-9ce6-0b6f16523f5c service neutron] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:14:16.053546 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52839e05-3f27-4630-b5b3-f03fcce12d1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:14:16.054397 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52839e05-3f27-4630-b5b3-f03fcce12d1d admin admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:16.056627 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52839e05-3f27-4630-b5b3-f03fcce12d1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:16.056987 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52839e05-3f27-4630-b5b3-f03fcce12d1d admin admin] PATH_INFO: `/v3/roles` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:16.058287 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52839e05-3f27-4630-b5b3-f03fcce12d1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:14:16.067846 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52839e05-3f27-4630-b5b3-f03fcce12d1d admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:14:16.090020 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1024/2033] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 3 14:14:16 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 14:14:16.094334 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a59c17d-db48-483a-ba0e-3a3781c1ea77 admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:14:16.134178 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a59c17d-db48-483a-ba0e-3a3781c1ea77 admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:14:16.147992 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2982d43-7d26-470a-bf88-84c36eef6577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:14:16.148694 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2982d43-7d26-470a-bf88-84c36eef6577 admin admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:16.149038 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2982d43-7d26-470a-bf88-84c36eef6577 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:16.149467 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2982d43-7d26-470a-bf88-84c36eef6577 admin admin] PATH_INFO: `/v3/roles` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:16.150291 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2982d43-7d26-470a-bf88-84c36eef6577 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:14:16.152161 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2982d43-7d26-470a-bf88-84c36eef6577 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:14:16.169358 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1010/2034] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 3 14:14:16 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 14:14:16.181088 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52839e05-3f27-4630-b5b3-f03fcce12d1d admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:14:16.196950 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52839e05-3f27-4630-b5b3-f03fcce12d1d admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:14:16.217237 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a692b332-8bf7-418c-ae88-e6287312ee99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:14:16.218573 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a692b332-8bf7-418c-ae88-e6287312ee99 admin admin] REQUEST_METHOD: `PUT` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:16.219038 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a692b332-8bf7-418c-ae88-e6287312ee99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:16.219447 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a692b332-8bf7-418c-ae88-e6287312ee99 admin admin] PATH_INFO: `/v3/projects/0300580a3e5449a98f15e19172499306/users/f56403dea482485a96799f1cdde1edfd/roles/441fdc11e95b47f4813f72610e39018b` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:16.236470 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a692b332-8bf7-418c-ae88-e6287312ee99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0300580a3e5449a98f15e19172499306, user_id=f56403dea482485a96799f1cdde1edfd, role_id=441fdc11e95b47f4813f72610e39018b)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:14:16.239369 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a692b332-8bf7-418c-ae88-e6287312ee99 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:14:16.280784 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1025/2035] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 3 14:14:16 2022] PUT /identity/v3/projects/0300580a3e5449a98f15e19172499306/users/f56403dea482485a96799f1cdde1edfd/roles/441fdc11e95b47f4813f72610e39018b => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:14:16.286475 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b5e36a-7e5c-428b-83e4-0fc2f71456db None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:16.286741 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b5e36a-7e5c-428b-83e4-0fc2f71456db None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:16.287025 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b5e36a-7e5c-428b-83e4-0fc2f71456db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:16.332058 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-22b5e36a-7e5c-428b-83e4-0fc2f71456db None None] MFA Rules not processed for user `f56403dea482485a96799f1cdde1edfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:14:16.333482 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-22b5e36a-7e5c-428b-83e4-0fc2f71456db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:14:16.433913 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1011/2036] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:14:16 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:14:16.445725 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a692b332-8bf7-418c-ae88-e6287312ee99 admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:14:16.456245 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-a692b332-8bf7-418c-ae88-e6287312ee99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:14:16.603402 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a692b332-8bf7-418c-ae88-e6287312ee99 admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:14:16.607765 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe16d29-f284-4ed4-ba63-e13d610ba867 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b014f4c7ba1414cb8a597f5bc4033f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:14:16.608625 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe16d29-f284-4ed4-ba63-e13d610ba867 service cinder] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:16.609217 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe16d29-f284-4ed4-ba63-e13d610ba867 service cinder] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:16.609953 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe16d29-f284-4ed4-ba63-e13d610ba867 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:16.624175 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe16d29-f284-4ed4-ba63-e13d610ba867 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:14:16.626674 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe16d29-f284-4ed4-ba63-e13d610ba867 service cinder] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:14:16.641054 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1026/2037] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:14:16 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 14:14:17.031535 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b5e36a-7e5c-428b-83e4-0fc2f71456db None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:14:17.033695 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-22b5e36a-7e5c-428b-83e4-0fc2f71456db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:14:17.185813 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b5e36a-7e5c-428b-83e4-0fc2f71456db None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:14:17.194309 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b382964-820d-4428-8a8c-e27a610acb02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:14:17.195740 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b382964-820d-4428-8a8c-e27a610acb02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:17.196133 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b382964-820d-4428-8a8c-e27a610acb02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:17.196496 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b382964-820d-4428-8a8c-e27a610acb02 admin admin] PATH_INFO: `/v3/projects/670ea88096a54967b906469bfda49e14` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:17.198178 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b382964-820d-4428-8a8c-e27a610acb02 admin admin] RBAC: Authorizing `identity:delete_project(project_id=670ea88096a54967b906469bfda49e14)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:14:17.200865 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b382964-820d-4428-8a8c-e27a610acb02 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:14:17.291077 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd597759-619c-40fd-99cc-458be9251a58 None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:17.291651 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-8b382964-820d-4428-8a8c-e27a610acb02 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '670ea88096a54967b906469bfda49e14', 'request_id': 'req-8b382964-820d-4428-8a8c-e27a610acb02'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:14:17.292444 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd597759-619c-40fd-99cc-458be9251a58 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:17.293963 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd597759-619c-40fd-99cc-458be9251a58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:17.298295 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-8b382964-820d-4428-8a8c-e27a610acb02 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '670ea88096a54967b906469bfda49e14', 'request_id': 'req-8b382964-820d-4428-8a8c-e27a610acb02'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:14:17.304609 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-8b382964-820d-4428-8a8c-e27a610acb02 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '670ea88096a54967b906469bfda49e14', 'request_id': 'req-8b382964-820d-4428-8a8c-e27a610acb02'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:14:17.321527 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-8b382964-820d-4428-8a8c-e27a610acb02 admin admin] The token cache is being invalidate because project 670ea88096a54967b906469bfda49e14 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80012) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 14:14:17.322088 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-8b382964-820d-4428-8a8c-e27a610acb02 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:14:17.323827 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-8b382964-820d-4428-8a8c-e27a610acb02 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:14:17.329516 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1012/2038] 10.222.0.36 () {58 vars in 1232 bytes} [Tue May 3 14:14:17 2022] DELETE /identity/v3/projects/670ea88096a54967b906469bfda49e14 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:14:17.331248 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b382964-820d-4428-8a8c-e27a610acb02 admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:14:17.334598 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-8b382964-820d-4428-8a8c-e27a610acb02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:14:17.339334 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-dd597759-619c-40fd-99cc-458be9251a58 None None] MFA Rules not processed for user `39f0797cbeb448769677f54f936b915d`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:14:17.340706 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-dd597759-619c-40fd-99cc-458be9251a58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:14:17.425061 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b382964-820d-4428-8a8c-e27a610acb02 admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:14:17.432149 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dba0dc-3724-40af-a288-37b313316957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:14:17.434006 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dba0dc-3724-40af-a288-37b313316957 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:17.434446 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dba0dc-3724-40af-a288-37b313316957 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:17.434874 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dba0dc-3724-40af-a288-37b313316957 admin admin] PATH_INFO: `/v3/users/6bca643320b94d3ebf8bc6d5824c695e` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:17.436345 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40dba0dc-3724-40af-a288-37b313316957 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6bca643320b94d3ebf8bc6d5824c695e)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:14:17.441470 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40dba0dc-3724-40af-a288-37b313316957 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:14:17.466734 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1027/2039] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:14:17 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 14:14:17.469987 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd597759-619c-40fd-99cc-458be9251a58 None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:14:17.483223 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-dd597759-619c-40fd-99cc-458be9251a58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:14:17.504135 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd597759-619c-40fd-99cc-458be9251a58 None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:14:17.509237 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7baa635a-ee43-4f6f-9bd6-0ad047a25a64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:14:17.510148 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baa635a-ee43-4f6f-9bd6-0ad047a25a64 admin admin] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:17.510537 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baa635a-ee43-4f6f-9bd6-0ad047a25a64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:17.510886 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baa635a-ee43-4f6f-9bd6-0ad047a25a64 admin admin] PATH_INFO: `/v3/projects` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:17.511683 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7baa635a-ee43-4f6f-9bd6-0ad047a25a64 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:14:17.514579 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7baa635a-ee43-4f6f-9bd6-0ad047a25a64 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:14:17.532079 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-40dba0dc-3724-40af-a288-37b313316957 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6bca643320b94d3ebf8bc6d5824c695e'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:14:17.539690 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-40dba0dc-3724-40af-a288-37b313316957 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6bca643320b94d3ebf8bc6d5824c695e'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:14:17.540733 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-40dba0dc-3724-40af-a288-37b313316957 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6bca643320b94d3ebf8bc6d5824c695e'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:14:17.557643 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-40dba0dc-3724-40af-a288-37b313316957 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6bca643320b94d3ebf8bc6d5824c695e'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:14:17.558566 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-40dba0dc-3724-40af-a288-37b313316957 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6bca643320b94d3ebf8bc6d5824c695e'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:14:17.581944 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1013/2040] 10.222.0.36 () {58 vars in 1223 bytes} [Tue May 3 14:14:17 2022] DELETE /identity/v3/users/6bca643320b94d3ebf8bc6d5824c695e => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:14:17.596970 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dba0dc-3724-40af-a288-37b313316957 admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:14:17.598989 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-40dba0dc-3724-40af-a288-37b313316957 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:14:17.601263 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1028/2041] 10.222.0.36 () {60 vars in 1152 bytes} [Tue May 3 14:14:17 2022] POST /identity/v3/projects => generated 383 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 14:14:17.701493 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dba0dc-3724-40af-a288-37b313316957 admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:14:17.737108 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7baa635a-ee43-4f6f-9bd6-0ad047a25a64 admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:14:17.743389 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-7baa635a-ee43-4f6f-9bd6-0ad047a25a64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:14:17.787347 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceed860e-e792-49e1-bdca-b4487ffe3620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:14:17.788171 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceed860e-e792-49e1-bdca-b4487ffe3620 admin admin] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:17.789661 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceed860e-e792-49e1-bdca-b4487ffe3620 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:17.791920 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceed860e-e792-49e1-bdca-b4487ffe3620 admin admin] PATH_INFO: `/v3/users` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:17.792695 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceed860e-e792-49e1-bdca-b4487ffe3620 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:14:17.795038 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceed860e-e792-49e1-bdca-b4487ffe3620 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:14:17.837337 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1014/2042] 10.222.0.36 () {60 vars in 1143 bytes} [Tue May 3 14:14:17 2022] POST /identity/v3/users => generated 298 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 14:14:17.839795 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceed860e-e792-49e1-bdca-b4487ffe3620 admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:14:17.851081 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceed860e-e792-49e1-bdca-b4487ffe3620 admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:14:17.859947 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd49730-f6a9-4a67-8333-648e978feb05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:14:17.861787 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd49730-f6a9-4a67-8333-648e978feb05 admin admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:17.862646 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd49730-f6a9-4a67-8333-648e978feb05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:17.863302 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd49730-f6a9-4a67-8333-648e978feb05 admin admin] PATH_INFO: `/v3/roles` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:17.864356 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd49730-f6a9-4a67-8333-648e978feb05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:14:17.867424 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd49730-f6a9-4a67-8333-648e978feb05 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:14:17.880649 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1015/2043] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 3 14:14:17 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 14:14:17.882709 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7baa635a-ee43-4f6f-9bd6-0ad047a25a64 admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:14:17.884897 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd49730-f6a9-4a67-8333-648e978feb05 admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:14:17.892601 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85589914-d385-4b9b-8f35-2d215d919c6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:14:17.893668 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85589914-d385-4b9b-8f35-2d215d919c6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:17.895282 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85589914-d385-4b9b-8f35-2d215d919c6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:17.895716 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85589914-d385-4b9b-8f35-2d215d919c6d admin admin] PATH_INFO: `/v3/users/78b7c4c87e9e4efab6753f55fe9887bb` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:17.897960 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85589914-d385-4b9b-8f35-2d215d919c6d admin admin] RBAC: Authorizing `identity:delete_user(user_id=78b7c4c87e9e4efab6753f55fe9887bb)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:14:17.902437 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85589914-d385-4b9b-8f35-2d215d919c6d admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:14:17.905521 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd49730-f6a9-4a67-8333-648e978feb05 admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:14:17.910927 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d4a70a-c177-48fb-b5db-89e6aa562ba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:14:17.911832 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d4a70a-c177-48fb-b5db-89e6aa562ba5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:17.912111 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d4a70a-c177-48fb-b5db-89e6aa562ba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:17.912383 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d4a70a-c177-48fb-b5db-89e6aa562ba5 admin admin] PATH_INFO: `/v3/projects/82dd2e372240457991d34104d485914e/users/646959f190b24b3fa5438b72f32b06a5/roles/36abe9b50fd8479c86c4f8f70fd85aa3` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:17.934978 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d4a70a-c177-48fb-b5db-89e6aa562ba5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=82dd2e372240457991d34104d485914e, user_id=646959f190b24b3fa5438b72f32b06a5, role_id=36abe9b50fd8479c86c4f8f70fd85aa3)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:14:17.939070 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d4a70a-c177-48fb-b5db-89e6aa562ba5 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:14:17.962201 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1016/2044] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 3 14:14:17 2022] PUT /identity/v3/projects/82dd2e372240457991d34104d485914e/users/646959f190b24b3fa5438b72f32b06a5/roles/36abe9b50fd8479c86c4f8f70fd85aa3 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 14:14:17.967241 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d4a70a-c177-48fb-b5db-89e6aa562ba5 admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:14:17.986011 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-85589914-d385-4b9b-8f35-2d215d919c6d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78b7c4c87e9e4efab6753f55fe9887bb'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:14:18.004427 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-85589914-d385-4b9b-8f35-2d215d919c6d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78b7c4c87e9e4efab6753f55fe9887bb'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:14:18.005197 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-85589914-d385-4b9b-8f35-2d215d919c6d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78b7c4c87e9e4efab6753f55fe9887bb'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:14:18.019468 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-85589914-d385-4b9b-8f35-2d215d919c6d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78b7c4c87e9e4efab6753f55fe9887bb'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:14:18.020179 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-85589914-d385-4b9b-8f35-2d215d919c6d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78b7c4c87e9e4efab6753f55fe9887bb'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:14:18.053082 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1029/2045] 10.222.0.36 () {58 vars in 1223 bytes} [Tue May 3 14:14:17 2022] DELETE /identity/v3/users/78b7c4c87e9e4efab6753f55fe9887bb => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:14:18.064101 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37803a5-e284-45c6-b210-66511b0de340 None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:18.064471 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37803a5-e284-45c6-b210-66511b0de340 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:18.064726 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37803a5-e284-45c6-b210-66511b0de340 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:18.084099 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d4a70a-c177-48fb-b5db-89e6aa562ba5 admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:14:18.090344 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-e37803a5-e284-45c6-b210-66511b0de340 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:14:18.091948 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-e37803a5-e284-45c6-b210-66511b0de340 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:14:18.193917 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1030/2046] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:14:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 14:14:18.195011 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37803a5-e284-45c6-b210-66511b0de340 None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:14:18.196341 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-e37803a5-e284-45c6-b210-66511b0de340 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:14:18.205988 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4533d6-fc29-4f30-8434-43b9903b2ab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:14:18.207878 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4533d6-fc29-4f30-8434-43b9903b2ab5 admin admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:18.211616 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37803a5-e284-45c6-b210-66511b0de340 None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:14:18.212171 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4533d6-fc29-4f30-8434-43b9903b2ab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:18.212461 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4533d6-fc29-4f30-8434-43b9903b2ab5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:18.213491 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4533d6-fc29-4f30-8434-43b9903b2ab5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:14:18.215559 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4533d6-fc29-4f30-8434-43b9903b2ab5 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:14:18.216839 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084787ce-30e8-4f45-8c90-2a3adcc90f96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:14:18.218255 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084787ce-30e8-4f45-8c90-2a3adcc90f96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:18.218646 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084787ce-30e8-4f45-8c90-2a3adcc90f96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:18.218996 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084787ce-30e8-4f45-8c90-2a3adcc90f96 admin admin] PATH_INFO: `/v3/projects/7a788f7f0ed94b12beb05a43acb87179` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:18.220864 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084787ce-30e8-4f45-8c90-2a3adcc90f96 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a788f7f0ed94b12beb05a43acb87179)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:14:18.222743 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084787ce-30e8-4f45-8c90-2a3adcc90f96 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:14:18.241509 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1017/2047] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 3 14:14:17 2022] GET /identity/v3/roles => generated 1420 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 14:14:18.248231 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4533d6-fc29-4f30-8434-43b9903b2ab5 admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:14:18.253483 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-9c4533d6-fc29-4f30-8434-43b9903b2ab5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:14:18.331698 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-084787ce-30e8-4f45-8c90-2a3adcc90f96 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a788f7f0ed94b12beb05a43acb87179', 'request_id': 'req-084787ce-30e8-4f45-8c90-2a3adcc90f96'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:14:18.345113 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-084787ce-30e8-4f45-8c90-2a3adcc90f96 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a788f7f0ed94b12beb05a43acb87179', 'request_id': 'req-084787ce-30e8-4f45-8c90-2a3adcc90f96'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:14:18.364616 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4533d6-fc29-4f30-8434-43b9903b2ab5 admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:14:18.368884 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-084787ce-30e8-4f45-8c90-2a3adcc90f96 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a788f7f0ed94b12beb05a43acb87179', 'request_id': 'req-084787ce-30e8-4f45-8c90-2a3adcc90f96'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:14:18.392556 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-084787ce-30e8-4f45-8c90-2a3adcc90f96 admin admin] The token cache is being invalidate because project 7a788f7f0ed94b12beb05a43acb87179 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80013) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 14:14:18.392845 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-084787ce-30e8-4f45-8c90-2a3adcc90f96 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:14:18.393538 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-084787ce-30e8-4f45-8c90-2a3adcc90f96 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:14:18.395113 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1031/2048] 10.222.0.36 () {58 vars in 1232 bytes} [Tue May 3 14:14:18 2022] DELETE /identity/v3/projects/7a788f7f0ed94b12beb05a43acb87179 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:14:18.395850 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084787ce-30e8-4f45-8c90-2a3adcc90f96 admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:14:18.402829 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-084787ce-30e8-4f45-8c90-2a3adcc90f96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:14:18.460025 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723f0764-1140-4852-b6f5-8580ebd48be5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '937bea4f355144b4a7ee11baabc3a4cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:14:18.460686 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723f0764-1140-4852-b6f5-8580ebd48be5 service neutron] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:18.461276 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723f0764-1140-4852-b6f5-8580ebd48be5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:18.461584 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723f0764-1140-4852-b6f5-8580ebd48be5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:18.463382 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-723f0764-1140-4852-b6f5-8580ebd48be5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:14:18.516633 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084787ce-30e8-4f45-8c90-2a3adcc90f96 admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:14:18.523135 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6714f807-7d0f-4475-bf72-2f221b305431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:14:18.524164 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6714f807-7d0f-4475-bf72-2f221b305431 admin admin] REQUEST_METHOD: `PUT` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:18.524545 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6714f807-7d0f-4475-bf72-2f221b305431 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:18.524921 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6714f807-7d0f-4475-bf72-2f221b305431 admin admin] PATH_INFO: `/v3/projects/82dd2e372240457991d34104d485914e/users/646959f190b24b3fa5438b72f32b06a5/roles/36abe9b50fd8479c86c4f8f70fd85aa3` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:18.527292 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6714f807-7d0f-4475-bf72-2f221b305431 admin admin] RBAC: Authorizing `identity:create_grant(project_id=82dd2e372240457991d34104d485914e, user_id=646959f190b24b3fa5438b72f32b06a5, role_id=36abe9b50fd8479c86c4f8f70fd85aa3)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:14:18.532659 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6714f807-7d0f-4475-bf72-2f221b305431 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:14:18.567730 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1032/2049] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 3 14:14:18 2022] PUT /identity/v3/projects/82dd2e372240457991d34104d485914e/users/646959f190b24b3fa5438b72f32b06a5/roles/36abe9b50fd8479c86c4f8f70fd85aa3 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:14:18.569632 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fe6602-5cf4-4c40-b204-be6464e8aefa None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:18.570453 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fe6602-5cf4-4c40-b204-be6464e8aefa None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:18.570453 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fe6602-5cf4-4c40-b204-be6464e8aefa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:18.581928 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723f0764-1140-4852-b6f5-8580ebd48be5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:14:18.583351 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723f0764-1140-4852-b6f5-8580ebd48be5 service neutron] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:14:18.596071 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1018/2050] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:14:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 14:14:18.601429 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-d8fe6602-5cf4-4c40-b204-be6464e8aefa None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:14:18.602714 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-d8fe6602-5cf4-4c40-b204-be6464e8aefa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:14:18.687017 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1033/2051] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:14:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:14:18.697076 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695935ce-36bb-45f2-8ccf-538882ee2586 None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:18.697472 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695935ce-36bb-45f2-8ccf-538882ee2586 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:18.697832 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695935ce-36bb-45f2-8ccf-538882ee2586 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:18.719630 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-695935ce-36bb-45f2-8ccf-538882ee2586 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:14:18.721605 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-695935ce-36bb-45f2-8ccf-538882ee2586 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:14:18.733127 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1019/2052] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:14:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:14:18.740254 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fe6602-5cf4-4c40-b204-be6464e8aefa None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:14:18.766284 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fe6602-5cf4-4c40-b204-be6464e8aefa None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:14:18.774103 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd27b427-7954-48fa-b21e-4955d5478969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:14:18.775029 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd27b427-7954-48fa-b21e-4955d5478969 admin admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:18.775436 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd27b427-7954-48fa-b21e-4955d5478969 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:18.775714 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd27b427-7954-48fa-b21e-4955d5478969 admin admin] PATH_INFO: `/v3/domains` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:18.776556 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd27b427-7954-48fa-b21e-4955d5478969 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:14:18.776810 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd27b427-7954-48fa-b21e-4955d5478969 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:14:18.778968 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd27b427-7954-48fa-b21e-4955d5478969 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:14:18.795097 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1034/2053] 10.222.0.36 () {58 vars in 1152 bytes} [Tue May 3 14:14:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:14:18.800056 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695935ce-36bb-45f2-8ccf-538882ee2586 None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:14:18.814431 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695935ce-36bb-45f2-8ccf-538882ee2586 None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:14:18.821032 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5b85f2-1ad8-4c95-a2e1-a2327f790087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:14:18.821746 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5b85f2-1ad8-4c95-a2e1-a2327f790087 admin admin] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:18.822039 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5b85f2-1ad8-4c95-a2e1-a2327f790087 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:18.822340 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5b85f2-1ad8-4c95-a2e1-a2327f790087 admin admin] PATH_INFO: `/v3/projects` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:18.823375 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5b85f2-1ad8-4c95-a2e1-a2327f790087 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:14:18.825691 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5b85f2-1ad8-4c95-a2e1-a2327f790087 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:14:18.871561 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd27b427-7954-48fa-b21e-4955d5478969 admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:14:18.898208 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1020/2054] 10.222.0.36 () {60 vars in 1152 bytes} [Tue May 3 14:14:18 2022] POST /identity/v3/projects => generated 387 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 14:14:18.900744 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd27b427-7954-48fa-b21e-4955d5478969 admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:14:18.990019 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfeb84c-2459-4881-b28c-89aa25e82877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:14:18.990700 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfeb84c-2459-4881-b28c-89aa25e82877 admin admin] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:18.990978 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfeb84c-2459-4881-b28c-89aa25e82877 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:18.991252 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfeb84c-2459-4881-b28c-89aa25e82877 admin admin] PATH_INFO: `/v3/users` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:18.991944 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfeb84c-2459-4881-b28c-89aa25e82877 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:14:18.993958 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfeb84c-2459-4881-b28c-89aa25e82877 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:14:19.022877 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5b85f2-1ad8-4c95-a2e1-a2327f790087 admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:14:19.036106 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1035/2055] 10.222.0.36 () {60 vars in 1143 bytes} [Tue May 3 14:14:18 2022] POST /identity/v3/users => generated 294 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 14:14:19.037446 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5b85f2-1ad8-4c95-a2e1-a2327f790087 admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:14:19.044121 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07405a8b-2987-430f-856e-5e2ed0bc8859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:14:19.045084 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07405a8b-2987-430f-856e-5e2ed0bc8859 admin admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:19.045385 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07405a8b-2987-430f-856e-5e2ed0bc8859 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:19.045764 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07405a8b-2987-430f-856e-5e2ed0bc8859 admin admin] PATH_INFO: `/v3/roles` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:19.047075 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07405a8b-2987-430f-856e-5e2ed0bc8859 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:14:19.048931 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07405a8b-2987-430f-856e-5e2ed0bc8859 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:14:19.068401 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfeb84c-2459-4881-b28c-89aa25e82877 admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:14:19.069936 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1021/2056] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 3 14:14:19 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 14:14:19.081107 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfeb84c-2459-4881-b28c-89aa25e82877 admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:14:19.096694 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f371ea68-edfc-4dd4-937b-acb88442b3c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:14:19.097942 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f371ea68-edfc-4dd4-937b-acb88442b3c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:19.098508 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f371ea68-edfc-4dd4-937b-acb88442b3c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:19.099438 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f371ea68-edfc-4dd4-937b-acb88442b3c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:19.100580 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f371ea68-edfc-4dd4-937b-acb88442b3c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:14:19.103210 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f371ea68-edfc-4dd4-937b-acb88442b3c9 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:14:19.130494 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1036/2057] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 3 14:14:19 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 14:14:19.135826 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07405a8b-2987-430f-856e-5e2ed0bc8859 admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:14:19.156856 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07405a8b-2987-430f-856e-5e2ed0bc8859 admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:14:19.172021 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b261e24e-12f7-4cd4-97e1-390814589698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:14:19.173058 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b261e24e-12f7-4cd4-97e1-390814589698 admin admin] REQUEST_METHOD: `PUT` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:19.173418 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b261e24e-12f7-4cd4-97e1-390814589698 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:19.173758 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b261e24e-12f7-4cd4-97e1-390814589698 admin admin] PATH_INFO: `/v3/projects/e851188a259c4b0b91800301a3ef90d9/users/7799a21fdfa24e11a07d332d98f60063/roles/441fdc11e95b47f4813f72610e39018b` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:19.195252 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b261e24e-12f7-4cd4-97e1-390814589698 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e851188a259c4b0b91800301a3ef90d9, user_id=7799a21fdfa24e11a07d332d98f60063, role_id=441fdc11e95b47f4813f72610e39018b)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:14:19.198526 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b261e24e-12f7-4cd4-97e1-390814589698 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:14:19.228379 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1022/2058] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 3 14:14:19 2022] PUT /identity/v3/projects/e851188a259c4b0b91800301a3ef90d9/users/7799a21fdfa24e11a07d332d98f60063/roles/441fdc11e95b47f4813f72610e39018b => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:14:19.240442 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace049bb-c5f0-4bfa-80bf-d3ad2cc32790 None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:19.240790 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace049bb-c5f0-4bfa-80bf-d3ad2cc32790 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:19.241035 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace049bb-c5f0-4bfa-80bf-d3ad2cc32790 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:19.302617 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-ace049bb-c5f0-4bfa-80bf-d3ad2cc32790 None None] MFA Rules not processed for user `7799a21fdfa24e11a07d332d98f60063`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:14:19.304623 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-ace049bb-c5f0-4bfa-80bf-d3ad2cc32790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:14:19.447146 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1037/2059] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:14:19 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:14:19.452245 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b261e24e-12f7-4cd4-97e1-390814589698 admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:14:19.590174 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b261e24e-12f7-4cd4-97e1-390814589698 admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:14:19.599520 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a0b822-3f7c-424d-b0c7-21f2812fc5a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:14:19.600933 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a0b822-3f7c-424d-b0c7-21f2812fc5a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:19.601310 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a0b822-3f7c-424d-b0c7-21f2812fc5a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:19.601865 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a0b822-3f7c-424d-b0c7-21f2812fc5a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:19.602837 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a0b822-3f7c-424d-b0c7-21f2812fc5a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:14:19.605829 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a0b822-3f7c-424d-b0c7-21f2812fc5a8 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:14:19.698300 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1023/2060] 10.222.0.36 () {60 vars in 1152 bytes} [Tue May 3 14:14:19 2022] POST /identity/v3/projects => generated 387 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 14:14:19.702644 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace049bb-c5f0-4bfa-80bf-d3ad2cc32790 None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:14:19.706026 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a0b822-3f7c-424d-b0c7-21f2812fc5a8 admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:14:19.710427 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-38a0b822-3f7c-424d-b0c7-21f2812fc5a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:14:19.723659 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace049bb-c5f0-4bfa-80bf-d3ad2cc32790 None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:14:19.800149 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a0b822-3f7c-424d-b0c7-21f2812fc5a8 admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:14:19.805665 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a66a72-7546-4491-b917-af780df2c0fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:14:19.806646 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a66a72-7546-4491-b917-af780df2c0fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:19.807000 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a66a72-7546-4491-b917-af780df2c0fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:19.807966 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a66a72-7546-4491-b917-af780df2c0fa admin admin] PATH_INFO: `/v3/projects/b80408cab29d41e5bee10c5979a19741` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:19.809470 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a66a72-7546-4491-b917-af780df2c0fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=b80408cab29d41e5bee10c5979a19741)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:14:19.811992 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a66a72-7546-4491-b917-af780df2c0fa admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:14:19.853185 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178cb3c5-8702-4845-854a-7dd2b794e992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:14:19.854436 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178cb3c5-8702-4845-854a-7dd2b794e992 admin admin] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:19.854776 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178cb3c5-8702-4845-854a-7dd2b794e992 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:19.855096 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178cb3c5-8702-4845-854a-7dd2b794e992 admin admin] PATH_INFO: `/v3/users` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:19.855970 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178cb3c5-8702-4845-854a-7dd2b794e992 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:14:19.858149 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178cb3c5-8702-4845-854a-7dd2b794e992 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:14:19.898981 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1038/2061] 10.222.0.36 () {60 vars in 1143 bytes} [Tue May 3 14:14:19 2022] POST /identity/v3/users => generated 300 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 14:14:19.899565 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-e5a66a72-7546-4491-b917-af780df2c0fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b80408cab29d41e5bee10c5979a19741', 'request_id': 'req-e5a66a72-7546-4491-b917-af780df2c0fa'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:14:19.903820 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178cb3c5-8702-4845-854a-7dd2b794e992 admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:14:19.912972 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-e5a66a72-7546-4491-b917-af780df2c0fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b80408cab29d41e5bee10c5979a19741', 'request_id': 'req-e5a66a72-7546-4491-b917-af780df2c0fa'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:14:19.922790 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178cb3c5-8702-4845-854a-7dd2b794e992 admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:14:19.926968 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-e5a66a72-7546-4491-b917-af780df2c0fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b80408cab29d41e5bee10c5979a19741', 'request_id': 'req-e5a66a72-7546-4491-b917-af780df2c0fa'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:14:19.965622 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-e5a66a72-7546-4491-b917-af780df2c0fa admin admin] The token cache is being invalidate because project b80408cab29d41e5bee10c5979a19741 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80012) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 14:14:19.965941 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-e5a66a72-7546-4491-b917-af780df2c0fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:14:19.966655 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-e5a66a72-7546-4491-b917-af780df2c0fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:14:19.976135 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1024/2062] 10.222.0.36 () {58 vars in 1232 bytes} [Tue May 3 14:14:19 2022] DELETE /identity/v3/projects/b80408cab29d41e5bee10c5979a19741 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 14:14:19.978626 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b68eca3-ae42-42c9-9f7c-28b95b53f676 None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:19.979068 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b68eca3-ae42-42c9-9f7c-28b95b53f676 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:19.979502 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b68eca3-ae42-42c9-9f7c-28b95b53f676 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:20.018856 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-6b68eca3-ae42-42c9-9f7c-28b95b53f676 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:14:20.021778 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-6b68eca3-ae42-42c9-9f7c-28b95b53f676 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:14:20.026594 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fde8621-c99f-4a08-879d-b9781eb92790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:14:20.027467 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fde8621-c99f-4a08-879d-b9781eb92790 admin admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:20.027855 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fde8621-c99f-4a08-879d-b9781eb92790 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:20.028137 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fde8621-c99f-4a08-879d-b9781eb92790 admin admin] PATH_INFO: `/v3/roles` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:20.029075 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fde8621-c99f-4a08-879d-b9781eb92790 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:14:20.031697 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fde8621-c99f-4a08-879d-b9781eb92790 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:14:20.039213 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1025/2063] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:14:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:14:20.053730 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1039/2064] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 3 14:14:19 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 14:14:20.053995 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9feaad1-4657-4235-9def-1a2518f12f13 None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:20.054349 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9feaad1-4657-4235-9def-1a2518f12f13 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:20.054636 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9feaad1-4657-4235-9def-1a2518f12f13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:20.058785 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fde8621-c99f-4a08-879d-b9781eb92790 admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:14:20.065038 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-5fde8621-c99f-4a08-879d-b9781eb92790 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:14:20.090034 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fde8621-c99f-4a08-879d-b9781eb92790 admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:14:20.094990 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0aa28a-ad38-458a-8564-dd3358060a58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:14:20.096022 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0aa28a-ad38-458a-8564-dd3358060a58 admin admin] REQUEST_METHOD: `PUT` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:20.096392 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0aa28a-ad38-458a-8564-dd3358060a58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:20.096757 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0aa28a-ad38-458a-8564-dd3358060a58 admin admin] PATH_INFO: `/v3/projects/156bce042db64802a54a9e8152da2ec7/users/434767dbb57f42b9baeaecb39d7ed40d/roles/36abe9b50fd8479c86c4f8f70fd85aa3` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:20.098720 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-f9feaad1-4657-4235-9def-1a2518f12f13 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:14:20.099978 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-f9feaad1-4657-4235-9def-1a2518f12f13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:14:20.112894 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1026/2065] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:14:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:14:20.114019 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9feaad1-4657-4235-9def-1a2518f12f13 None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:14:20.115320 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0aa28a-ad38-458a-8564-dd3358060a58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=156bce042db64802a54a9e8152da2ec7, user_id=434767dbb57f42b9baeaecb39d7ed40d, role_id=36abe9b50fd8479c86c4f8f70fd85aa3)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:14:20.118149 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0aa28a-ad38-458a-8564-dd3358060a58 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:14:20.136732 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1040/2066] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 3 14:14:20 2022] PUT /identity/v3/projects/156bce042db64802a54a9e8152da2ec7/users/434767dbb57f42b9baeaecb39d7ed40d/roles/36abe9b50fd8479c86c4f8f70fd85aa3 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:14:20.138864 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9feaad1-4657-4235-9def-1a2518f12f13 None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:14:20.140888 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0aa28a-ad38-458a-8564-dd3358060a58 admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:14:20.262205 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0d9cb9-0364-4242-8b39-eccba60f8136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:14:20.263300 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0d9cb9-0364-4242-8b39-eccba60f8136 admin admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:20.263657 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0d9cb9-0364-4242-8b39-eccba60f8136 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:20.264139 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0d9cb9-0364-4242-8b39-eccba60f8136 admin admin] PATH_INFO: `/v3/domains` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:20.264887 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0d9cb9-0364-4242-8b39-eccba60f8136 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80012) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:14:20.265541 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0d9cb9-0364-4242-8b39-eccba60f8136 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:14:20.267448 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0d9cb9-0364-4242-8b39-eccba60f8136 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:14:20.282313 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1027/2067] 10.222.0.36 () {58 vars in 1152 bytes} [Tue May 3 14:14:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:14:20.286919 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0d9cb9-0364-4242-8b39-eccba60f8136 admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:14:20.299614 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0d9cb9-0364-4242-8b39-eccba60f8136 admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:14:20.305357 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee7e08a-84fc-442c-9d4d-d7b77ae6067e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:14:20.306580 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee7e08a-84fc-442c-9d4d-d7b77ae6067e admin admin] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:20.306937 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee7e08a-84fc-442c-9d4d-d7b77ae6067e admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:20.307284 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee7e08a-84fc-442c-9d4d-d7b77ae6067e admin admin] PATH_INFO: `/v3/projects` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:20.308173 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee7e08a-84fc-442c-9d4d-d7b77ae6067e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:14:20.308913 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0aa28a-ad38-458a-8564-dd3358060a58 admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:14:20.310859 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee7e08a-84fc-442c-9d4d-d7b77ae6067e admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:14:20.315933 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8f7824-1060-4459-af5e-7cc3dd60093c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:14:20.316552 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8f7824-1060-4459-af5e-7cc3dd60093c admin admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:20.317039 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8f7824-1060-4459-af5e-7cc3dd60093c admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:20.317416 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8f7824-1060-4459-af5e-7cc3dd60093c admin admin] PATH_INFO: `/v3/roles` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:20.318211 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8f7824-1060-4459-af5e-7cc3dd60093c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:14:20.320281 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8f7824-1060-4459-af5e-7cc3dd60093c admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:14:20.352104 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1041/2068] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 3 14:14:20 2022] GET /identity/v3/roles => generated 1420 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 14:14:20.356500 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8f7824-1060-4459-af5e-7cc3dd60093c admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:14:20.387221 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8f7824-1060-4459-af5e-7cc3dd60093c admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:14:20.393676 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1028/2069] 10.222.0.36 () {60 vars in 1152 bytes} [Tue May 3 14:14:20 2022] POST /identity/v3/projects => generated 375 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 14:14:20.396419 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee7e08a-84fc-442c-9d4d-d7b77ae6067e admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:14:20.402920 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-8ee7e08a-84fc-442c-9d4d-d7b77ae6067e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:14:20.511039 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c6836e-11cc-4e09-8d65-01829fb4b704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:14:20.512441 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee7e08a-84fc-442c-9d4d-d7b77ae6067e admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:14:20.512800 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c6836e-11cc-4e09-8d65-01829fb4b704 admin admin] REQUEST_METHOD: `PUT` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:20.513232 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c6836e-11cc-4e09-8d65-01829fb4b704 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:20.513667 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c6836e-11cc-4e09-8d65-01829fb4b704 admin admin] PATH_INFO: `/v3/projects/156bce042db64802a54a9e8152da2ec7/users/434767dbb57f42b9baeaecb39d7ed40d/roles/36abe9b50fd8479c86c4f8f70fd85aa3` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:20.516138 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c6836e-11cc-4e09-8d65-01829fb4b704 admin admin] RBAC: Authorizing `identity:create_grant(project_id=156bce042db64802a54a9e8152da2ec7, user_id=434767dbb57f42b9baeaecb39d7ed40d, role_id=36abe9b50fd8479c86c4f8f70fd85aa3)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:14:20.520025 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c6836e-11cc-4e09-8d65-01829fb4b704 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:14:20.522928 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f28869-cc26-4c1b-991a-cf20b595bb7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:14:20.524979 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f28869-cc26-4c1b-991a-cf20b595bb7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:20.525271 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f28869-cc26-4c1b-991a-cf20b595bb7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:20.525568 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f28869-cc26-4c1b-991a-cf20b595bb7b admin admin] PATH_INFO: `/v3/users/f56403dea482485a96799f1cdde1edfd` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:20.529756 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f28869-cc26-4c1b-991a-cf20b595bb7b admin admin] RBAC: Authorizing `identity:delete_user(user_id=f56403dea482485a96799f1cdde1edfd)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:14:20.533137 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f28869-cc26-4c1b-991a-cf20b595bb7b admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:14:20.543146 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1042/2070] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 3 14:14:20 2022] PUT /identity/v3/projects/156bce042db64802a54a9e8152da2ec7/users/434767dbb57f42b9baeaecb39d7ed40d/roles/36abe9b50fd8479c86c4f8f70fd85aa3 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:14:20.543146 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c6836e-11cc-4e09-8d65-01829fb4b704 admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:14:20.647895 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-21f28869-cc26-4c1b-991a-cf20b595bb7b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f56403dea482485a96799f1cdde1edfd'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:14:20.671432 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-21f28869-cc26-4c1b-991a-cf20b595bb7b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f56403dea482485a96799f1cdde1edfd'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:14:20.674416 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-21f28869-cc26-4c1b-991a-cf20b595bb7b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f56403dea482485a96799f1cdde1edfd'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:14:20.695663 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c6836e-11cc-4e09-8d65-01829fb4b704 admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:14:20.705641 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ec8eb2-af54-4dc6-b83d-6271df745701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:14:20.706433 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ec8eb2-af54-4dc6-b83d-6271df745701 admin admin] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:20.706718 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ec8eb2-af54-4dc6-b83d-6271df745701 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:20.706998 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ec8eb2-af54-4dc6-b83d-6271df745701 admin admin] PATH_INFO: `/v3/users` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:20.707833 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ec8eb2-af54-4dc6-b83d-6271df745701 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:14:20.709237 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-21f28869-cc26-4c1b-991a-cf20b595bb7b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f56403dea482485a96799f1cdde1edfd'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:14:20.710130 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ec8eb2-af54-4dc6-b83d-6271df745701 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:14:20.711113 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-21f28869-cc26-4c1b-991a-cf20b595bb7b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f56403dea482485a96799f1cdde1edfd'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:14:20.744516 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1029/2071] 10.222.0.36 () {58 vars in 1223 bytes} [Tue May 3 14:14:20 2022] DELETE /identity/v3/users/f56403dea482485a96799f1cdde1edfd => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:14:20.746555 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc331578-af11-4b5a-8b6a-1003f40037fe None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:20.747466 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc331578-af11-4b5a-8b6a-1003f40037fe None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:20.748083 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc331578-af11-4b5a-8b6a-1003f40037fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:20.751745 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1043/2072] 10.222.0.36 () {60 vars in 1143 bytes} [Tue May 3 14:14:20 2022] POST /identity/v3/users => generated 288 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 14:14:20.755738 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df2232f-24e3-44b9-a7a4-45beab607bdf None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:20.757394 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df2232f-24e3-44b9-a7a4-45beab607bdf None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:20.757697 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df2232f-24e3-44b9-a7a4-45beab607bdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:20.792576 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-5df2232f-24e3-44b9-a7a4-45beab607bdf None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:14:20.793997 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-5df2232f-24e3-44b9-a7a4-45beab607bdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:14:20.807897 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-fc331578-af11-4b5a-8b6a-1003f40037fe None None] MFA Rules not processed for user `434767dbb57f42b9baeaecb39d7ed40d`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:14:20.809326 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-fc331578-af11-4b5a-8b6a-1003f40037fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:14:20.915000 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1044/2073] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:14:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:14:20.916183 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df2232f-24e3-44b9-a7a4-45beab607bdf None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:14:20.917886 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-5df2232f-24e3-44b9-a7a4-45beab607bdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:14:20.922223 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1030/2074] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:14:20 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:14:20.927474 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc331578-af11-4b5a-8b6a-1003f40037fe None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:14:20.929366 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-fc331578-af11-4b5a-8b6a-1003f40037fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:14:20.942762 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df2232f-24e3-44b9-a7a4-45beab607bdf None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:14:20.949512 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e60f4e-d1ff-4e25-8ade-00760a41d385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:14:20.950848 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e60f4e-d1ff-4e25-8ade-00760a41d385 admin admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:20.951309 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e60f4e-d1ff-4e25-8ade-00760a41d385 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:20.952455 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e60f4e-d1ff-4e25-8ade-00760a41d385 admin admin] PATH_INFO: `/v3/roles` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:20.953702 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e60f4e-d1ff-4e25-8ade-00760a41d385 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:14:20.955802 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e60f4e-d1ff-4e25-8ade-00760a41d385 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:14:20.970567 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1045/2075] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 3 14:14:20 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 14:14:20.972804 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e60f4e-d1ff-4e25-8ade-00760a41d385 admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:14:20.974822 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-71e60f4e-d1ff-4e25-8ade-00760a41d385 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:14:21.070031 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc331578-af11-4b5a-8b6a-1003f40037fe None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:14:21.078516 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32779b3d-2322-469b-82dd-4b4e4b29edba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '937bea4f355144b4a7ee11baabc3a4cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:14:21.079504 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32779b3d-2322-469b-82dd-4b4e4b29edba service neutron] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:21.080194 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32779b3d-2322-469b-82dd-4b4e4b29edba service neutron] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:21.081811 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32779b3d-2322-469b-82dd-4b4e4b29edba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:21.085055 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e60f4e-d1ff-4e25-8ade-00760a41d385 admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:14:21.096035 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0ed6ad-c07f-46af-8334-ac8b34c8eb50 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b014f4c7ba1414cb8a597f5bc4033f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:14:21.097044 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0ed6ad-c07f-46af-8334-ac8b34c8eb50 service cinder] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:21.097544 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0ed6ad-c07f-46af-8334-ac8b34c8eb50 service cinder] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:21.098462 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0ed6ad-c07f-46af-8334-ac8b34c8eb50 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:21.105920 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32779b3d-2322-469b-82dd-4b4e4b29edba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:14:21.108145 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32779b3d-2322-469b-82dd-4b4e4b29edba service neutron] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:14:21.121441 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0ed6ad-c07f-46af-8334-ac8b34c8eb50 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:14:21.126041 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0ed6ad-c07f-46af-8334-ac8b34c8eb50 service cinder] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:14:21.136256 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1031/2076] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:14:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 14:14:21.137447 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32779b3d-2322-469b-82dd-4b4e4b29edba service neutron] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:14:21.167154 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1046/2077] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:14:20 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 14:14:21.172893 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32779b3d-2322-469b-82dd-4b4e4b29edba service neutron] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:14:21.185815 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3887f242-12ae-4d83-b72d-f986741bdf4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:14:21.187673 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3887f242-12ae-4d83-b72d-f986741bdf4f admin admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:21.188191 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3887f242-12ae-4d83-b72d-f986741bdf4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:21.188718 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3887f242-12ae-4d83-b72d-f986741bdf4f admin admin] PATH_INFO: `/v3/roles` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:21.189816 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3887f242-12ae-4d83-b72d-f986741bdf4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:14:21.208614 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3887f242-12ae-4d83-b72d-f986741bdf4f admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:14:21.249394 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1032/2078] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 3 14:14:21 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 14:14:21.249941 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0ed6ad-c07f-46af-8334-ac8b34c8eb50 service cinder] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:14:21.268528 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0ed6ad-c07f-46af-8334-ac8b34c8eb50 service cinder] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:14:21.277826 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3887f242-12ae-4d83-b72d-f986741bdf4f admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:14:21.283340 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-3887f242-12ae-4d83-b72d-f986741bdf4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:14:21.290306 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687a50c1-4727-4a87-8720-a793a9df6265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:14:21.291817 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687a50c1-4727-4a87-8720-a793a9df6265 admin admin] REQUEST_METHOD: `PUT` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:21.292351 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687a50c1-4727-4a87-8720-a793a9df6265 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:21.292841 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687a50c1-4727-4a87-8720-a793a9df6265 admin admin] PATH_INFO: `/v3/projects/4f473e1921bc4a2cb77e66e2d7461f9b/users/197151cf95e749df9bd5827598bb32e5/roles/441fdc11e95b47f4813f72610e39018b` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:21.311337 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3887f242-12ae-4d83-b72d-f986741bdf4f admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:14:21.322452 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ec6fcb-c60a-43bb-8205-8e4eabc6c766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:14:21.323651 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687a50c1-4727-4a87-8720-a793a9df6265 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f473e1921bc4a2cb77e66e2d7461f9b, user_id=197151cf95e749df9bd5827598bb32e5, role_id=441fdc11e95b47f4813f72610e39018b)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:14:21.324850 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ec6fcb-c60a-43bb-8205-8e4eabc6c766 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:21.328121 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ec6fcb-c60a-43bb-8205-8e4eabc6c766 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:21.331066 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ec6fcb-c60a-43bb-8205-8e4eabc6c766 admin admin] PATH_INFO: `/v3/users/7799a21fdfa24e11a07d332d98f60063` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:21.332680 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ec6fcb-c60a-43bb-8205-8e4eabc6c766 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7799a21fdfa24e11a07d332d98f60063)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:14:21.333187 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687a50c1-4727-4a87-8720-a793a9df6265 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:14:21.338091 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ec6fcb-c60a-43bb-8205-8e4eabc6c766 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:14:21.364738 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1047/2079] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 3 14:14:21 2022] PUT /identity/v3/projects/4f473e1921bc4a2cb77e66e2d7461f9b/users/197151cf95e749df9bd5827598bb32e5/roles/441fdc11e95b47f4813f72610e39018b => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:14:21.376697 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cd0a13-914f-4e81-91f2-d14fb173bbe8 None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:21.377191 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cd0a13-914f-4e81-91f2-d14fb173bbe8 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:21.377494 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cd0a13-914f-4e81-91f2-d14fb173bbe8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:21.432277 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-d2cd0a13-914f-4e81-91f2-d14fb173bbe8 None None] MFA Rules not processed for user `197151cf95e749df9bd5827598bb32e5`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:14:21.433539 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-d2cd0a13-914f-4e81-91f2-d14fb173bbe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:14:21.492583 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-44ec6fcb-c60a-43bb-8205-8e4eabc6c766 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7799a21fdfa24e11a07d332d98f60063'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:14:21.516290 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-44ec6fcb-c60a-43bb-8205-8e4eabc6c766 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7799a21fdfa24e11a07d332d98f60063'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:14:21.518933 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-44ec6fcb-c60a-43bb-8205-8e4eabc6c766 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7799a21fdfa24e11a07d332d98f60063'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:14:21.548631 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-44ec6fcb-c60a-43bb-8205-8e4eabc6c766 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7799a21fdfa24e11a07d332d98f60063'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:14:21.551366 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-44ec6fcb-c60a-43bb-8205-8e4eabc6c766 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7799a21fdfa24e11a07d332d98f60063'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:14:21.585317 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1033/2080] 10.222.0.36 () {58 vars in 1223 bytes} [Tue May 3 14:14:21 2022] DELETE /identity/v3/users/7799a21fdfa24e11a07d332d98f60063 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:14:21.590029 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b2e0c6-6c7e-4326-96fd-747bd2c46503 None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:21.590673 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b2e0c6-6c7e-4326-96fd-747bd2c46503 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:21.591283 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b2e0c6-6c7e-4326-96fd-747bd2c46503 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:21.627571 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-57b2e0c6-6c7e-4326-96fd-747bd2c46503 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:14:21.629321 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-57b2e0c6-6c7e-4326-96fd-747bd2c46503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:14:21.648980 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1048/2081] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:14:21 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 14:14:21.653502 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cd0a13-914f-4e81-91f2-d14fb173bbe8 None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:14:21.654894 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-d2cd0a13-914f-4e81-91f2-d14fb173bbe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:14:21.769230 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1034/2082] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:14:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 14:14:21.772355 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cd0a13-914f-4e81-91f2-d14fb173bbe8 None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:14:21.786825 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5eb7ab-9bbd-4b0e-ae8a-9ec300fc5373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:14:21.787023 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b2e0c6-6c7e-4326-96fd-747bd2c46503 None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:14:21.788055 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5eb7ab-9bbd-4b0e-ae8a-9ec300fc5373 admin admin] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:21.788055 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5eb7ab-9bbd-4b0e-ae8a-9ec300fc5373 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:21.788055 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5eb7ab-9bbd-4b0e-ae8a-9ec300fc5373 admin admin] PATH_INFO: `/v3/projects` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:21.788851 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5eb7ab-9bbd-4b0e-ae8a-9ec300fc5373 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:14:21.789854 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-57b2e0c6-6c7e-4326-96fd-747bd2c46503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:14:21.791033 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5eb7ab-9bbd-4b0e-ae8a-9ec300fc5373 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:14:21.857476 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1049/2083] 10.222.0.36 () {60 vars in 1152 bytes} [Tue May 3 14:14:21 2022] POST /identity/v3/projects => generated 377 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 14:14:21.861670 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5eb7ab-9bbd-4b0e-ae8a-9ec300fc5373 admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:14:21.930541 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b2e0c6-6c7e-4326-96fd-747bd2c46503 None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:14:22.065265 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5eb7ab-9bbd-4b0e-ae8a-9ec300fc5373 admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:14:22.071357 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142aeb1a-2eac-4701-afc7-3a80dd3a0139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:14:22.071807 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142aeb1a-2eac-4701-afc7-3a80dd3a0139 admin admin] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:22.072190 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142aeb1a-2eac-4701-afc7-3a80dd3a0139 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:22.072462 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142aeb1a-2eac-4701-afc7-3a80dd3a0139 admin admin] PATH_INFO: `/v3/users` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:22.072688 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a126db9a-e1b7-447b-9a99-cd6d9d457440 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '937bea4f355144b4a7ee11baabc3a4cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:14:22.073231 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142aeb1a-2eac-4701-afc7-3a80dd3a0139 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:14:22.073414 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a126db9a-e1b7-447b-9a99-cd6d9d457440 service neutron] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:22.073663 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a126db9a-e1b7-447b-9a99-cd6d9d457440 service neutron] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:22.073941 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a126db9a-e1b7-447b-9a99-cd6d9d457440 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:22.076874 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142aeb1a-2eac-4701-afc7-3a80dd3a0139 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:14:22.098218 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a126db9a-e1b7-447b-9a99-cd6d9d457440 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:14:22.100387 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a126db9a-e1b7-447b-9a99-cd6d9d457440 service neutron] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:14:22.124325 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1035/2084] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:14:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 14:14:22.146196 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a126db9a-e1b7-447b-9a99-cd6d9d457440 service neutron] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:14:22.146382 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1050/2085] 10.222.0.36 () {60 vars in 1143 bytes} [Tue May 3 14:14:21 2022] POST /identity/v3/users => generated 289 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 14:14:22.158724 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a126db9a-e1b7-447b-9a99-cd6d9d457440 service neutron] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:14:22.168428 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29006b9d-2296-4920-8495-910b847ae567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:14:22.169841 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29006b9d-2296-4920-8495-910b847ae567 admin admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:22.170494 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29006b9d-2296-4920-8495-910b847ae567 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:22.170955 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29006b9d-2296-4920-8495-910b847ae567 admin admin] PATH_INFO: `/v3/roles` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:22.172103 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29006b9d-2296-4920-8495-910b847ae567 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:14:22.174229 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29006b9d-2296-4920-8495-910b847ae567 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:14:22.190006 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1036/2086] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 3 14:14:22 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 14:14:22.194069 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142aeb1a-2eac-4701-afc7-3a80dd3a0139 admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:14:22.216161 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142aeb1a-2eac-4701-afc7-3a80dd3a0139 admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:14:22.229945 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16213086-2b92-4f06-912d-1eaa3cbd0ab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:14:22.230864 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16213086-2b92-4f06-912d-1eaa3cbd0ab2 admin admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:22.231592 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16213086-2b92-4f06-912d-1eaa3cbd0ab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:22.233013 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16213086-2b92-4f06-912d-1eaa3cbd0ab2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:22.238344 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16213086-2b92-4f06-912d-1eaa3cbd0ab2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:14:22.242097 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16213086-2b92-4f06-912d-1eaa3cbd0ab2 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:14:22.258526 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1051/2087] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 3 14:14:22 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 14:14:22.263021 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29006b9d-2296-4920-8495-910b847ae567 admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:14:22.278641 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29006b9d-2296-4920-8495-910b847ae567 admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:14:22.302236 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568dd4df-162c-4ff0-bace-164a6c132e2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:14:22.305639 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568dd4df-162c-4ff0-bace-164a6c132e2c admin admin] REQUEST_METHOD: `PUT` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:22.305933 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568dd4df-162c-4ff0-bace-164a6c132e2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:22.306229 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568dd4df-162c-4ff0-bace-164a6c132e2c admin admin] PATH_INFO: `/v3/projects/fa2592fcc5c243b38b8bcb6ed285f1d6/users/e320dd54d4d44cd4a3e683e2dda68c35/roles/441fdc11e95b47f4813f72610e39018b` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:22.403802 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568dd4df-162c-4ff0-bace-164a6c132e2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa2592fcc5c243b38b8bcb6ed285f1d6, user_id=e320dd54d4d44cd4a3e683e2dda68c35, role_id=441fdc11e95b47f4813f72610e39018b)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:14:22.414142 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568dd4df-162c-4ff0-bace-164a6c132e2c admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:14:22.456731 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1037/2088] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 3 14:14:22 2022] PUT /identity/v3/projects/fa2592fcc5c243b38b8bcb6ed285f1d6/users/e320dd54d4d44cd4a3e683e2dda68c35/roles/441fdc11e95b47f4813f72610e39018b => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:14:22.467534 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918f9ad4-9d9b-4ca1-ac67-942b9deb28c1 None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:22.468153 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918f9ad4-9d9b-4ca1-ac67-942b9deb28c1 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:22.468625 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918f9ad4-9d9b-4ca1-ac67-942b9deb28c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:22.505389 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-918f9ad4-9d9b-4ca1-ac67-942b9deb28c1 None None] MFA Rules not processed for user `e320dd54d4d44cd4a3e683e2dda68c35`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:14:22.507122 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-918f9ad4-9d9b-4ca1-ac67-942b9deb28c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:14:22.629651 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568dd4df-162c-4ff0-bace-164a6c132e2c admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:14:22.630537 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1052/2089] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:14:22 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:14:22.758223 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568dd4df-162c-4ff0-bace-164a6c132e2c admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:14:22.771782 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bac08d-f2d5-456f-9283-3fb82921709c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:14:22.772466 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bac08d-f2d5-456f-9283-3fb82921709c admin admin] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:22.772887 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bac08d-f2d5-456f-9283-3fb82921709c admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:22.773169 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bac08d-f2d5-456f-9283-3fb82921709c admin admin] PATH_INFO: `/v3/projects` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:22.773914 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bac08d-f2d5-456f-9283-3fb82921709c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:14:22.775875 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bac08d-f2d5-456f-9283-3fb82921709c admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:14:22.826609 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1038/2090] 10.222.0.36 () {60 vars in 1152 bytes} [Tue May 3 14:14:22 2022] POST /identity/v3/projects => generated 375 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 14:14:22.831955 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918f9ad4-9d9b-4ca1-ac67-942b9deb28c1 None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:14:22.845504 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918f9ad4-9d9b-4ca1-ac67-942b9deb28c1 None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:14:22.982634 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8535da36-9a30-42e5-9fd9-12e787a9726e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:14:22.983324 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8535da36-9a30-42e5-9fd9-12e787a9726e admin admin] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:22.983601 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8535da36-9a30-42e5-9fd9-12e787a9726e admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:22.983945 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8535da36-9a30-42e5-9fd9-12e787a9726e admin admin] PATH_INFO: `/v3/users` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:22.984731 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8535da36-9a30-42e5-9fd9-12e787a9726e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:14:22.986931 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8535da36-9a30-42e5-9fd9-12e787a9726e admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:14:23.066158 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bac08d-f2d5-456f-9283-3fb82921709c admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:14:23.080676 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1053/2091] 10.222.0.36 () {60 vars in 1143 bytes} [Tue May 3 14:14:22 2022] POST /identity/v3/users => generated 294 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 14:14:23.088471 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bac08d-f2d5-456f-9283-3fb82921709c admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:14:23.111452 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c072eb-c5dc-432f-9740-dfdcf58ad79b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:14:23.113438 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c072eb-c5dc-432f-9740-dfdcf58ad79b admin admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:23.114040 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c072eb-c5dc-432f-9740-dfdcf58ad79b admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:23.116029 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c072eb-c5dc-432f-9740-dfdcf58ad79b admin admin] PATH_INFO: `/v3/roles` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:23.118258 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c072eb-c5dc-432f-9740-dfdcf58ad79b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:14:23.127617 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c072eb-c5dc-432f-9740-dfdcf58ad79b admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:14:23.162762 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1039/2092] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 3 14:14:23 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 14:14:23.167134 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8535da36-9a30-42e5-9fd9-12e787a9726e admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:14:23.179838 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8535da36-9a30-42e5-9fd9-12e787a9726e admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:14:23.192640 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b18962-74b9-41d2-99fa-09a679900b7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:14:23.193770 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b18962-74b9-41d2-99fa-09a679900b7d admin admin] REQUEST_METHOD: `PUT` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:23.194051 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b18962-74b9-41d2-99fa-09a679900b7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:23.194324 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b18962-74b9-41d2-99fa-09a679900b7d admin admin] PATH_INFO: `/v3/projects/486f2b0a778447a2882143726e634ef4/users/a9e021e987df4294a4c2fb5d580dbd6b/roles/36abe9b50fd8479c86c4f8f70fd85aa3` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:23.229931 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b18962-74b9-41d2-99fa-09a679900b7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=486f2b0a778447a2882143726e634ef4, user_id=a9e021e987df4294a4c2fb5d580dbd6b, role_id=36abe9b50fd8479c86c4f8f70fd85aa3)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:14:23.236370 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b18962-74b9-41d2-99fa-09a679900b7d admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:14:23.269943 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1054/2093] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 3 14:14:23 2022] PUT /identity/v3/projects/486f2b0a778447a2882143726e634ef4/users/a9e021e987df4294a4c2fb5d580dbd6b/roles/36abe9b50fd8479c86c4f8f70fd85aa3 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:14:23.273772 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c072eb-c5dc-432f-9740-dfdcf58ad79b admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:14:23.292964 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c072eb-c5dc-432f-9740-dfdcf58ad79b admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:14:23.446116 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f77456c-f963-4abb-9f30-224cf278f735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:14:23.446116 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f77456c-f963-4abb-9f30-224cf278f735 admin admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:23.447437 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f77456c-f963-4abb-9f30-224cf278f735 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:23.447437 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f77456c-f963-4abb-9f30-224cf278f735 admin admin] PATH_INFO: `/v3/roles` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:23.449633 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f77456c-f963-4abb-9f30-224cf278f735 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:14:23.451806 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f77456c-f963-4abb-9f30-224cf278f735 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:14:23.461542 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b18962-74b9-41d2-99fa-09a679900b7d admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:14:23.463333 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-b3b18962-74b9-41d2-99fa-09a679900b7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:14:23.476873 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1040/2094] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 3 14:14:23 2022] GET /identity/v3/roles => generated 1420 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 14:14:23.482830 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f77456c-f963-4abb-9f30-224cf278f735 admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:14:23.493071 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b18962-74b9-41d2-99fa-09a679900b7d admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:14:23.513895 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f77456c-f963-4abb-9f30-224cf278f735 admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:14:23.523496 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd4e1dd-f783-4ed6-a864-50f72b3c5694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:14:23.524821 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd4e1dd-f783-4ed6-a864-50f72b3c5694 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:23.524821 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd4e1dd-f783-4ed6-a864-50f72b3c5694 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:23.527787 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd4e1dd-f783-4ed6-a864-50f72b3c5694 admin admin] PATH_INFO: `/v3/projects/e851188a259c4b0b91800301a3ef90d9` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:23.529826 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd4e1dd-f783-4ed6-a864-50f72b3c5694 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e851188a259c4b0b91800301a3ef90d9)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:14:23.534829 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd4e1dd-f783-4ed6-a864-50f72b3c5694 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:14:23.540609 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711df6f0-afb7-4b68-913e-177ea1d017f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:14:23.541603 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711df6f0-afb7-4b68-913e-177ea1d017f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:23.541897 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711df6f0-afb7-4b68-913e-177ea1d017f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:23.542162 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711df6f0-afb7-4b68-913e-177ea1d017f0 admin admin] PATH_INFO: `/v3/projects/486f2b0a778447a2882143726e634ef4/users/a9e021e987df4294a4c2fb5d580dbd6b/roles/36abe9b50fd8479c86c4f8f70fd85aa3` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:23.550984 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711df6f0-afb7-4b68-913e-177ea1d017f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=486f2b0a778447a2882143726e634ef4, user_id=a9e021e987df4294a4c2fb5d580dbd6b, role_id=36abe9b50fd8479c86c4f8f70fd85aa3)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:14:23.554769 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711df6f0-afb7-4b68-913e-177ea1d017f0 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:14:23.618366 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1041/2095] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 3 14:14:23 2022] PUT /identity/v3/projects/486f2b0a778447a2882143726e634ef4/users/a9e021e987df4294a4c2fb5d580dbd6b/roles/36abe9b50fd8479c86c4f8f70fd85aa3 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:14:23.635810 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad4089b-9580-4657-8ade-acd83c2794f9 None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:23.636095 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad4089b-9580-4657-8ade-acd83c2794f9 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:23.636377 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad4089b-9580-4657-8ade-acd83c2794f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:23.680573 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-3cd4e1dd-f783-4ed6-a864-50f72b3c5694 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e851188a259c4b0b91800301a3ef90d9', 'request_id': 'req-3cd4e1dd-f783-4ed6-a864-50f72b3c5694'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:14:23.691739 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-3cd4e1dd-f783-4ed6-a864-50f72b3c5694 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e851188a259c4b0b91800301a3ef90d9', 'request_id': 'req-3cd4e1dd-f783-4ed6-a864-50f72b3c5694'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:14:23.700713 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-dad4089b-9580-4657-8ade-acd83c2794f9 None None] MFA Rules not processed for user `a9e021e987df4294a4c2fb5d580dbd6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:14:23.702838 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-dad4089b-9580-4657-8ade-acd83c2794f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:14:23.704849 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-3cd4e1dd-f783-4ed6-a864-50f72b3c5694 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e851188a259c4b0b91800301a3ef90d9', 'request_id': 'req-3cd4e1dd-f783-4ed6-a864-50f72b3c5694'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:14:23.732783 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-3cd4e1dd-f783-4ed6-a864-50f72b3c5694 admin admin] The token cache is being invalidate because project e851188a259c4b0b91800301a3ef90d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80013) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 14:14:23.734241 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-3cd4e1dd-f783-4ed6-a864-50f72b3c5694 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:14:23.736529 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-3cd4e1dd-f783-4ed6-a864-50f72b3c5694 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:14:23.740810 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1055/2096] 10.222.0.36 () {58 vars in 1232 bytes} [Tue May 3 14:14:23 2022] DELETE /identity/v3/projects/e851188a259c4b0b91800301a3ef90d9 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 14:14:23.744939 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd4e1dd-f783-4ed6-a864-50f72b3c5694 admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:14:23.746540 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-3cd4e1dd-f783-4ed6-a864-50f72b3c5694 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:14:23.862202 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd4e1dd-f783-4ed6-a864-50f72b3c5694 admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:14:23.871562 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a790b83-271e-46a4-b7cb-0031eaeaca12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:14:23.872471 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a790b83-271e-46a4-b7cb-0031eaeaca12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:23.872897 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a790b83-271e-46a4-b7cb-0031eaeaca12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:23.873382 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a790b83-271e-46a4-b7cb-0031eaeaca12 admin admin] PATH_INFO: `/v3/users/434767dbb57f42b9baeaecb39d7ed40d` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:23.873857 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1042/2097] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:14:23 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:14:23.874932 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a790b83-271e-46a4-b7cb-0031eaeaca12 admin admin] RBAC: Authorizing `identity:delete_user(user_id=434767dbb57f42b9baeaecb39d7ed40d)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:14:23.879287 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a790b83-271e-46a4-b7cb-0031eaeaca12 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:14:23.886951 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad4089b-9580-4657-8ade-acd83c2794f9 None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:14:23.888398 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-dad4089b-9580-4657-8ade-acd83c2794f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:14:23.958469 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-2a790b83-271e-46a4-b7cb-0031eaeaca12 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '434767dbb57f42b9baeaecb39d7ed40d'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:14:23.966751 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-2a790b83-271e-46a4-b7cb-0031eaeaca12 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '434767dbb57f42b9baeaecb39d7ed40d'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:14:23.967605 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-2a790b83-271e-46a4-b7cb-0031eaeaca12 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '434767dbb57f42b9baeaecb39d7ed40d'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:14:23.982164 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-2a790b83-271e-46a4-b7cb-0031eaeaca12 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '434767dbb57f42b9baeaecb39d7ed40d'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:14:23.983078 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-2a790b83-271e-46a4-b7cb-0031eaeaca12 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '434767dbb57f42b9baeaecb39d7ed40d'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:14:24.014761 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad4089b-9580-4657-8ade-acd83c2794f9 None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:14:24.018625 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1056/2098] 10.222.0.36 () {58 vars in 1223 bytes} [Tue May 3 14:14:23 2022] DELETE /identity/v3/users/434767dbb57f42b9baeaecb39d7ed40d => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:14:24.024043 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9721a5-1db4-425e-bc60-8d1f2d1dae79 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b014f4c7ba1414cb8a597f5bc4033f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:14:24.025014 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9721a5-1db4-425e-bc60-8d1f2d1dae79 service cinder] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:24.025315 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9721a5-1db4-425e-bc60-8d1f2d1dae79 service cinder] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:24.025613 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9721a5-1db4-425e-bc60-8d1f2d1dae79 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:24.027719 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-ab9721a5-1db4-425e-bc60-8d1f2d1dae79 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:14:24.127348 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9721a5-1db4-425e-bc60-8d1f2d1dae79 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:14:24.134184 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9721a5-1db4-425e-bc60-8d1f2d1dae79 service cinder] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:14:24.170002 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a790b83-271e-46a4-b7cb-0031eaeaca12 admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:14:24.171636 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-2a790b83-271e-46a4-b7cb-0031eaeaca12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:14:24.173042 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1043/2099] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:14:23 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 03 14:14:24.296844 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a790b83-271e-46a4-b7cb-0031eaeaca12 admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:14:24.311615 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86d9801-baa1-4542-969b-dcaaac34c7be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:14:24.315327 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86d9801-baa1-4542-969b-dcaaac34c7be admin admin] REQUEST_METHOD: `DELETE` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:24.315327 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86d9801-baa1-4542-969b-dcaaac34c7be admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:24.315327 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86d9801-baa1-4542-969b-dcaaac34c7be admin admin] PATH_INFO: `/v3/projects/0300580a3e5449a98f15e19172499306` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:24.317112 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86d9801-baa1-4542-969b-dcaaac34c7be admin admin] RBAC: Authorizing `identity:delete_project(project_id=0300580a3e5449a98f15e19172499306)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:14:24.321743 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86d9801-baa1-4542-969b-dcaaac34c7be admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:14:24.441747 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-a86d9801-baa1-4542-969b-dcaaac34c7be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0300580a3e5449a98f15e19172499306', 'request_id': 'req-a86d9801-baa1-4542-969b-dcaaac34c7be'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:14:24.454667 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-a86d9801-baa1-4542-969b-dcaaac34c7be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0300580a3e5449a98f15e19172499306', 'request_id': 'req-a86d9801-baa1-4542-969b-dcaaac34c7be'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:14:24.465024 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-a86d9801-baa1-4542-969b-dcaaac34c7be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0300580a3e5449a98f15e19172499306', 'request_id': 'req-a86d9801-baa1-4542-969b-dcaaac34c7be'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:14:24.482820 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-a86d9801-baa1-4542-969b-dcaaac34c7be admin admin] The token cache is being invalidate because project 0300580a3e5449a98f15e19172499306 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80013) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 14:14:24.483411 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-a86d9801-baa1-4542-969b-dcaaac34c7be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:14:24.484683 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-a86d9801-baa1-4542-969b-dcaaac34c7be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:14:24.487889 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1057/2100] 10.222.0.36 () {58 vars in 1232 bytes} [Tue May 3 14:14:24 2022] DELETE /identity/v3/projects/0300580a3e5449a98f15e19172499306 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:14:24.493834 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f269256-a3e9-468e-afd5-0c5bcca0db10 None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:24.494637 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f269256-a3e9-468e-afd5-0c5bcca0db10 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:24.495084 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f269256-a3e9-468e-afd5-0c5bcca0db10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:24.528760 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-1f269256-a3e9-468e-afd5-0c5bcca0db10 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:14:24.530618 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-1f269256-a3e9-468e-afd5-0c5bcca0db10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:14:24.666255 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1044/2101] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:14:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:14:24.679316 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bb4e4d-ea0d-4131-9a3c-16c230c2ced2 None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:24.679613 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bb4e4d-ea0d-4131-9a3c-16c230c2ced2 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:24.679896 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bb4e4d-ea0d-4131-9a3c-16c230c2ced2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:24.722037 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-32bb4e4d-ea0d-4131-9a3c-16c230c2ced2 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:14:24.725152 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-32bb4e4d-ea0d-4131-9a3c-16c230c2ced2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:14:24.741874 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1058/2102] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:14:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:14:24.745894 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f269256-a3e9-468e-afd5-0c5bcca0db10 None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:14:24.762468 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f269256-a3e9-468e-afd5-0c5bcca0db10 None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:14:24.782110 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3158c31a-da2a-42f0-9077-fbc128eed749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:14:24.783249 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3158c31a-da2a-42f0-9077-fbc128eed749 admin admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:24.783698 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3158c31a-da2a-42f0-9077-fbc128eed749 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:24.784309 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3158c31a-da2a-42f0-9077-fbc128eed749 admin admin] PATH_INFO: `/v3/domains` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:24.786833 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3158c31a-da2a-42f0-9077-fbc128eed749 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80012) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:14:24.787339 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3158c31a-da2a-42f0-9077-fbc128eed749 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:14:24.791107 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3158c31a-da2a-42f0-9077-fbc128eed749 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:14:24.818460 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1045/2103] 10.222.0.36 () {58 vars in 1152 bytes} [Tue May 3 14:14:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:14:24.819685 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bb4e4d-ea0d-4131-9a3c-16c230c2ced2 None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:14:24.833487 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bb4e4d-ea0d-4131-9a3c-16c230c2ced2 None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:14:24.850171 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d522953d-6095-4706-9e37-e870ff46c041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:14:24.851047 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d522953d-6095-4706-9e37-e870ff46c041 admin admin] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:24.851327 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d522953d-6095-4706-9e37-e870ff46c041 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:24.853723 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d522953d-6095-4706-9e37-e870ff46c041 admin admin] PATH_INFO: `/v3/projects` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:24.862850 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d522953d-6095-4706-9e37-e870ff46c041 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:14:24.873065 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d522953d-6095-4706-9e37-e870ff46c041 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:14:24.940384 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1059/2104] 10.222.0.36 () {60 vars in 1152 bytes} [Tue May 3 14:14:24 2022] POST /identity/v3/projects => generated 373 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 14:14:24.946631 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3158c31a-da2a-42f0-9077-fbc128eed749 admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:14:24.967219 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3158c31a-da2a-42f0-9077-fbc128eed749 admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:14:25.057621 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f6caf2-ba30-4f95-8b80-9dfbae9a3594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:14:25.058486 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f6caf2-ba30-4f95-8b80-9dfbae9a3594 admin admin] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:25.058865 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f6caf2-ba30-4f95-8b80-9dfbae9a3594 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:25.059234 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f6caf2-ba30-4f95-8b80-9dfbae9a3594 admin admin] PATH_INFO: `/v3/users` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:25.060039 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f6caf2-ba30-4f95-8b80-9dfbae9a3594 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:14:25.063868 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f6caf2-ba30-4f95-8b80-9dfbae9a3594 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:14:25.088453 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1046/2105] 10.222.0.36 () {60 vars in 1143 bytes} [Tue May 3 14:14:24 2022] POST /identity/v3/users => generated 287 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 14:14:25.093579 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d522953d-6095-4706-9e37-e870ff46c041 admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:14:25.107940 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d522953d-6095-4706-9e37-e870ff46c041 admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:14:25.118690 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f98be7-08a1-4f7d-8772-fd11f1cc0c20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:14:25.119465 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f98be7-08a1-4f7d-8772-fd11f1cc0c20 admin admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:25.120185 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f98be7-08a1-4f7d-8772-fd11f1cc0c20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:25.121252 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f98be7-08a1-4f7d-8772-fd11f1cc0c20 admin admin] PATH_INFO: `/v3/roles` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:25.122561 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f98be7-08a1-4f7d-8772-fd11f1cc0c20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:14:25.125224 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f98be7-08a1-4f7d-8772-fd11f1cc0c20 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:14:25.148171 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1060/2106] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 3 14:14:25 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 14:14:25.149001 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f6caf2-ba30-4f95-8b80-9dfbae9a3594 admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:14:25.173082 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f6caf2-ba30-4f95-8b80-9dfbae9a3594 admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:14:25.186010 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52128d9-e4fc-4eb0-ae3c-9b2d75152c83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:14:25.186708 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52128d9-e4fc-4eb0-ae3c-9b2d75152c83 admin admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:25.187387 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52128d9-e4fc-4eb0-ae3c-9b2d75152c83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:25.187678 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52128d9-e4fc-4eb0-ae3c-9b2d75152c83 admin admin] PATH_INFO: `/v3/roles` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:25.188419 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52128d9-e4fc-4eb0-ae3c-9b2d75152c83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:14:25.190314 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52128d9-e4fc-4eb0-ae3c-9b2d75152c83 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:14:25.209559 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1047/2107] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 3 14:14:25 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 14:14:25.211264 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f98be7-08a1-4f7d-8772-fd11f1cc0c20 admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:14:25.223352 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f98be7-08a1-4f7d-8772-fd11f1cc0c20 admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:14:25.242688 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7574b33f-aa74-4d15-bad5-c732ffc33add admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:14:25.243912 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7574b33f-aa74-4d15-bad5-c732ffc33add admin admin] REQUEST_METHOD: `PUT` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:25.244846 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7574b33f-aa74-4d15-bad5-c732ffc33add admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:25.245213 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7574b33f-aa74-4d15-bad5-c732ffc33add admin admin] PATH_INFO: `/v3/projects/109a4f100a7843c190cf3bda917eb5d7/users/3abc3ccd4a4547de9f3bda1af4abab59/roles/441fdc11e95b47f4813f72610e39018b` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:25.279999 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7574b33f-aa74-4d15-bad5-c732ffc33add admin admin] RBAC: Authorizing `identity:create_grant(project_id=109a4f100a7843c190cf3bda917eb5d7, user_id=3abc3ccd4a4547de9f3bda1af4abab59, role_id=441fdc11e95b47f4813f72610e39018b)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:14:25.283686 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7574b33f-aa74-4d15-bad5-c732ffc33add admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:14:25.304007 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1061/2108] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 3 14:14:25 2022] PUT /identity/v3/projects/109a4f100a7843c190cf3bda917eb5d7/users/3abc3ccd4a4547de9f3bda1af4abab59/roles/441fdc11e95b47f4813f72610e39018b => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:14:25.316267 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c1758b-3c52-4c43-867b-c587a524edc9 None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:25.316554 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c1758b-3c52-4c43-867b-c587a524edc9 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:25.316835 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c1758b-3c52-4c43-867b-c587a524edc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:25.356556 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-d4c1758b-3c52-4c43-867b-c587a524edc9 None None] MFA Rules not processed for user `3abc3ccd4a4547de9f3bda1af4abab59`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:14:25.358356 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-d4c1758b-3c52-4c43-867b-c587a524edc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:14:25.496294 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1048/2109] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:14:25 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:14:25.509627 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7574b33f-aa74-4d15-bad5-c732ffc33add admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:14:25.511463 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-7574b33f-aa74-4d15-bad5-c732ffc33add admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:14:25.624842 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7574b33f-aa74-4d15-bad5-c732ffc33add admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:14:25.633179 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a63de0d-7c32-416b-aa92-693e3ee0f3b6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b014f4c7ba1414cb8a597f5bc4033f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:14:25.633971 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a63de0d-7c32-416b-aa92-693e3ee0f3b6 service cinder] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:25.634319 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a63de0d-7c32-416b-aa92-693e3ee0f3b6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:25.634662 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a63de0d-7c32-416b-aa92-693e3ee0f3b6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:25.656469 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a63de0d-7c32-416b-aa92-693e3ee0f3b6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:14:25.658324 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a63de0d-7c32-416b-aa92-693e3ee0f3b6 service cinder] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:14:25.680187 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1062/2110] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:14:25 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 14:14:25.726052 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c1758b-3c52-4c43-867b-c587a524edc9 None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:14:25.849141 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c1758b-3c52-4c43-867b-c587a524edc9 None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:14:25.857669 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5132a2-1425-40c9-aa74-425eb421dbd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:14:25.860045 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5132a2-1425-40c9-aa74-425eb421dbd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:25.860541 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5132a2-1425-40c9-aa74-425eb421dbd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:25.861407 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5132a2-1425-40c9-aa74-425eb421dbd4 admin admin] PATH_INFO: `/v3/users/3abc3ccd4a4547de9f3bda1af4abab59` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:25.863256 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5132a2-1425-40c9-aa74-425eb421dbd4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3abc3ccd4a4547de9f3bda1af4abab59)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:14:25.866884 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5132a2-1425-40c9-aa74-425eb421dbd4 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:14:25.930715 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a63de0d-7c32-416b-aa92-693e3ee0f3b6 service cinder] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:14:25.932364 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-0a63de0d-7c32-416b-aa92-693e3ee0f3b6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:14:25.963501 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a63de0d-7c32-416b-aa92-693e3ee0f3b6 service cinder] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:14:25.983569 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549d9207-9a31-4b4a-9634-ca8c29ceb2c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:14:25.984282 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-df5132a2-1425-40c9-aa74-425eb421dbd4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3abc3ccd4a4547de9f3bda1af4abab59'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:14:25.985113 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549d9207-9a31-4b4a-9634-ca8c29ceb2c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:25.985577 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549d9207-9a31-4b4a-9634-ca8c29ceb2c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:25.985992 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549d9207-9a31-4b4a-9634-ca8c29ceb2c4 admin admin] PATH_INFO: `/v3/projects/156bce042db64802a54a9e8152da2ec7` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:25.989203 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549d9207-9a31-4b4a-9634-ca8c29ceb2c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=156bce042db64802a54a9e8152da2ec7)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:14:25.991161 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549d9207-9a31-4b4a-9634-ca8c29ceb2c4 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:14:26.003595 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-df5132a2-1425-40c9-aa74-425eb421dbd4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3abc3ccd4a4547de9f3bda1af4abab59'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:14:26.006088 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-df5132a2-1425-40c9-aa74-425eb421dbd4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3abc3ccd4a4547de9f3bda1af4abab59'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:14:26.035665 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-df5132a2-1425-40c9-aa74-425eb421dbd4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3abc3ccd4a4547de9f3bda1af4abab59'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:14:26.036832 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-df5132a2-1425-40c9-aa74-425eb421dbd4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3abc3ccd4a4547de9f3bda1af4abab59'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:14:26.067517 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1049/2111] 10.222.0.36 () {58 vars in 1223 bytes} [Tue May 3 14:14:25 2022] DELETE /identity/v3/users/3abc3ccd4a4547de9f3bda1af4abab59 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:14:26.068415 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5132a2-1425-40c9-aa74-425eb421dbd4 admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:14:26.071624 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-df5132a2-1425-40c9-aa74-425eb421dbd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:14:26.086486 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-549d9207-9a31-4b4a-9634-ca8c29ceb2c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '156bce042db64802a54a9e8152da2ec7', 'request_id': 'req-549d9207-9a31-4b4a-9634-ca8c29ceb2c4'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:14:26.092356 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-549d9207-9a31-4b4a-9634-ca8c29ceb2c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '156bce042db64802a54a9e8152da2ec7', 'request_id': 'req-549d9207-9a31-4b4a-9634-ca8c29ceb2c4'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:14:26.137107 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-549d9207-9a31-4b4a-9634-ca8c29ceb2c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '156bce042db64802a54a9e8152da2ec7', 'request_id': 'req-549d9207-9a31-4b4a-9634-ca8c29ceb2c4'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:14:26.154616 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5132a2-1425-40c9-aa74-425eb421dbd4 admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:14:26.173574 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-549d9207-9a31-4b4a-9634-ca8c29ceb2c4 admin admin] The token cache is being invalidate because project 156bce042db64802a54a9e8152da2ec7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80013) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 14:14:26.173945 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-549d9207-9a31-4b4a-9634-ca8c29ceb2c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:14:26.174916 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-549d9207-9a31-4b4a-9634-ca8c29ceb2c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:14:26.176940 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1063/2112] 10.222.0.36 () {58 vars in 1232 bytes} [Tue May 3 14:14:25 2022] DELETE /identity/v3/projects/156bce042db64802a54a9e8152da2ec7 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 14:14:26.180267 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac8fbd4-9c6b-406c-910e-e2d502fcdc1c None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:26.181593 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac8fbd4-9c6b-406c-910e-e2d502fcdc1c None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:26.182283 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac8fbd4-9c6b-406c-910e-e2d502fcdc1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:26.212747 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-cac8fbd4-9c6b-406c-910e-e2d502fcdc1c None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:14:26.214014 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-cac8fbd4-9c6b-406c-910e-e2d502fcdc1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:14:26.236287 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602c22cd-40c7-45ef-98f4-ea5d50911231 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b014f4c7ba1414cb8a597f5bc4033f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:14:26.236964 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602c22cd-40c7-45ef-98f4-ea5d50911231 service cinder] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:26.237252 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602c22cd-40c7-45ef-98f4-ea5d50911231 service cinder] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:26.237676 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602c22cd-40c7-45ef-98f4-ea5d50911231 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:26.241383 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-602c22cd-40c7-45ef-98f4-ea5d50911231 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:14:26.310812 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1064/2113] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:14:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:14:26.320378 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d103c74-66e0-4f32-9bbe-d0f1db0e2edd None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:26.320736 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d103c74-66e0-4f32-9bbe-d0f1db0e2edd None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:26.321024 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d103c74-66e0-4f32-9bbe-d0f1db0e2edd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:26.349520 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-3d103c74-66e0-4f32-9bbe-d0f1db0e2edd None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:14:26.350899 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-3d103c74-66e0-4f32-9bbe-d0f1db0e2edd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:14:26.361615 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602c22cd-40c7-45ef-98f4-ea5d50911231 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:14:26.365171 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602c22cd-40c7-45ef-98f4-ea5d50911231 service cinder] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:14:26.365437 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1065/2114] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:14:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:14:26.366394 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d103c74-66e0-4f32-9bbe-d0f1db0e2edd None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:14:26.373081 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-3d103c74-66e0-4f32-9bbe-d0f1db0e2edd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:14:26.391859 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1050/2115] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:14:26 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 14:14:26.394456 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6951acbb-f646-445e-b52a-8f30587b8745 None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:26.398922 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6951acbb-f646-445e-b52a-8f30587b8745 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:26.399459 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6951acbb-f646-445e-b52a-8f30587b8745 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:26.477045 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-6951acbb-f646-445e-b52a-8f30587b8745 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:14:26.485622 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-6951acbb-f646-445e-b52a-8f30587b8745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:14:26.520650 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1051/2116] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:14:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:14:26.525282 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6951acbb-f646-445e-b52a-8f30587b8745 None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:14:26.536580 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6951acbb-f646-445e-b52a-8f30587b8745 None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:14:26.546606 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc9bfad-34f7-427d-bae2-ac491098e41a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:14:26.547704 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc9bfad-34f7-427d-bae2-ac491098e41a admin admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:26.547988 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc9bfad-34f7-427d-bae2-ac491098e41a admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:26.548263 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc9bfad-34f7-427d-bae2-ac491098e41a admin admin] PATH_INFO: `/v3/domains` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:26.549211 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc9bfad-34f7-427d-bae2-ac491098e41a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80012) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:14:26.551658 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc9bfad-34f7-427d-bae2-ac491098e41a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:14:26.553427 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d103c74-66e0-4f32-9bbe-d0f1db0e2edd None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:14:26.554683 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc9bfad-34f7-427d-bae2-ac491098e41a admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:14:26.566391 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d65a1b6-fb08-4316-ab0f-19e47490ffd5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '937bea4f355144b4a7ee11baabc3a4cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:14:26.567182 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d65a1b6-fb08-4316-ab0f-19e47490ffd5 service neutron] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:26.572752 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1052/2117] 10.222.0.36 () {58 vars in 1152 bytes} [Tue May 3 14:14:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:14:26.573270 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d65a1b6-fb08-4316-ab0f-19e47490ffd5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:26.573671 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc9bfad-34f7-427d-bae2-ac491098e41a admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:14:26.576054 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d65a1b6-fb08-4316-ab0f-19e47490ffd5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:26.598861 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc9bfad-34f7-427d-bae2-ac491098e41a admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:14:26.603003 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d65a1b6-fb08-4316-ab0f-19e47490ffd5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:14:26.604875 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d65a1b6-fb08-4316-ab0f-19e47490ffd5 service neutron] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:14:26.610768 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7b3763-975a-449d-8708-15f10afc5aad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:14:26.611459 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7b3763-975a-449d-8708-15f10afc5aad admin admin] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:26.611763 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7b3763-975a-449d-8708-15f10afc5aad admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:26.612522 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7b3763-975a-449d-8708-15f10afc5aad admin admin] PATH_INFO: `/v3/projects` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:26.612719 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7b3763-975a-449d-8708-15f10afc5aad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:14:26.614625 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7b3763-975a-449d-8708-15f10afc5aad admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:14:26.618616 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1066/2118] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:14:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 14:14:26.684427 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1053/2119] 10.222.0.36 () {60 vars in 1152 bytes} [Tue May 3 14:14:26 2022] POST /identity/v3/projects => generated 385 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 14:14:26.685935 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d65a1b6-fb08-4316-ab0f-19e47490ffd5 service neutron] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:14:26.706504 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d65a1b6-fb08-4316-ab0f-19e47490ffd5 service neutron] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:14:26.907134 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a44a71-b132-4c31-a2af-f5690e7a4862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:14:26.907829 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a44a71-b132-4c31-a2af-f5690e7a4862 admin admin] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:26.908153 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a44a71-b132-4c31-a2af-f5690e7a4862 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:26.916904 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a44a71-b132-4c31-a2af-f5690e7a4862 admin admin] PATH_INFO: `/v3/users` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:26.917707 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a44a71-b132-4c31-a2af-f5690e7a4862 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:14:26.919728 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a44a71-b132-4c31-a2af-f5690e7a4862 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:14:26.975819 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1067/2120] 10.222.0.36 () {60 vars in 1143 bytes} [Tue May 3 14:14:26 2022] POST /identity/v3/users => generated 293 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 14:14:26.980210 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7b3763-975a-449d-8708-15f10afc5aad admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:14:27.003591 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7b3763-975a-449d-8708-15f10afc5aad admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:14:27.021961 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb10e0e-7127-42db-aaa9-239b4a082767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:14:27.023183 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb10e0e-7127-42db-aaa9-239b4a082767 admin admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:27.023669 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb10e0e-7127-42db-aaa9-239b4a082767 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:27.024255 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb10e0e-7127-42db-aaa9-239b4a082767 admin admin] PATH_INFO: `/v3/roles` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:27.025685 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb10e0e-7127-42db-aaa9-239b4a082767 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:14:27.027861 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb10e0e-7127-42db-aaa9-239b4a082767 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:14:27.047562 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1054/2121] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 3 14:14:26 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 14:14:27.052768 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a44a71-b132-4c31-a2af-f5690e7a4862 admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:14:27.068188 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a44a71-b132-4c31-a2af-f5690e7a4862 admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:14:27.081203 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7502e870-2c54-48ea-a518-5f81b5e9d980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:14:27.082301 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7502e870-2c54-48ea-a518-5f81b5e9d980 admin admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:27.083184 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7502e870-2c54-48ea-a518-5f81b5e9d980 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:27.083901 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7502e870-2c54-48ea-a518-5f81b5e9d980 admin admin] PATH_INFO: `/v3/roles` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:27.085243 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7502e870-2c54-48ea-a518-5f81b5e9d980 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:14:27.090916 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7502e870-2c54-48ea-a518-5f81b5e9d980 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:14:27.118120 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1068/2122] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 3 14:14:27 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 14:14:27.122283 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb10e0e-7127-42db-aaa9-239b4a082767 admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:14:27.140134 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb10e0e-7127-42db-aaa9-239b4a082767 admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:14:27.155049 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5856d5b6-638e-41d7-b4c1-725c8f3e1166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:14:27.157509 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5856d5b6-638e-41d7-b4c1-725c8f3e1166 admin admin] REQUEST_METHOD: `PUT` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:27.157755 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5856d5b6-638e-41d7-b4c1-725c8f3e1166 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:27.158045 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5856d5b6-638e-41d7-b4c1-725c8f3e1166 admin admin] PATH_INFO: `/v3/projects/de9c6f0cd4d24452b03a2977ea695c77/users/c7ff726ea559407383ef312e3f5c1767/roles/441fdc11e95b47f4813f72610e39018b` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:27.192456 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5856d5b6-638e-41d7-b4c1-725c8f3e1166 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de9c6f0cd4d24452b03a2977ea695c77, user_id=c7ff726ea559407383ef312e3f5c1767, role_id=441fdc11e95b47f4813f72610e39018b)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:14:27.196398 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5856d5b6-638e-41d7-b4c1-725c8f3e1166 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:14:27.224476 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1055/2123] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 3 14:14:27 2022] PUT /identity/v3/projects/de9c6f0cd4d24452b03a2977ea695c77/users/c7ff726ea559407383ef312e3f5c1767/roles/441fdc11e95b47f4813f72610e39018b => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:14:27.235603 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceada33b-7c70-4e2d-9e5c-532a085b7727 None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:27.235897 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceada33b-7c70-4e2d-9e5c-532a085b7727 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:27.236188 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceada33b-7c70-4e2d-9e5c-532a085b7727 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:27.291079 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-ceada33b-7c70-4e2d-9e5c-532a085b7727 None None] MFA Rules not processed for user `c7ff726ea559407383ef312e3f5c1767`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:14:27.291888 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-ceada33b-7c70-4e2d-9e5c-532a085b7727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:14:27.450974 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5856d5b6-638e-41d7-b4c1-725c8f3e1166 admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:14:27.452920 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-5856d5b6-638e-41d7-b4c1-725c8f3e1166 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:14:27.484782 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1069/2124] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:14:27 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:14:27.490008 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceada33b-7c70-4e2d-9e5c-532a085b7727 None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:14:27.563037 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5856d5b6-638e-41d7-b4c1-725c8f3e1166 admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:14:27.571823 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9ccd82-eb19-467d-a40d-5f8ab9a7a354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:14:27.573093 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9ccd82-eb19-467d-a40d-5f8ab9a7a354 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:27.574135 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9ccd82-eb19-467d-a40d-5f8ab9a7a354 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:27.574622 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9ccd82-eb19-467d-a40d-5f8ab9a7a354 admin admin] PATH_INFO: `/v3/projects/109a4f100a7843c190cf3bda917eb5d7` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:27.576592 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9ccd82-eb19-467d-a40d-5f8ab9a7a354 admin admin] RBAC: Authorizing `identity:delete_project(project_id=109a4f100a7843c190cf3bda917eb5d7)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:14:27.581845 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9ccd82-eb19-467d-a40d-5f8ab9a7a354 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:14:27.598272 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceada33b-7c70-4e2d-9e5c-532a085b7727 None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:14:27.605686 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c14adc-79ba-4c05-9b7f-cec048bf01aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:14:27.606613 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c14adc-79ba-4c05-9b7f-cec048bf01aa admin admin] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:27.607076 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c14adc-79ba-4c05-9b7f-cec048bf01aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:27.607557 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c14adc-79ba-4c05-9b7f-cec048bf01aa admin admin] PATH_INFO: `/v3/projects` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:27.608436 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c14adc-79ba-4c05-9b7f-cec048bf01aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:14:27.612509 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c14adc-79ba-4c05-9b7f-cec048bf01aa admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:14:27.656463 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1070/2125] 10.222.0.36 () {60 vars in 1152 bytes} [Tue May 3 14:14:27 2022] POST /identity/v3/projects => generated 387 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 14:14:27.656463 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c14adc-79ba-4c05-9b7f-cec048bf01aa admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:14:27.670699 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-54c14adc-79ba-4c05-9b7f-cec048bf01aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:14:27.670925 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-4f9ccd82-eb19-467d-a40d-5f8ab9a7a354 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '109a4f100a7843c190cf3bda917eb5d7', 'request_id': 'req-4f9ccd82-eb19-467d-a40d-5f8ab9a7a354'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:14:27.679930 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-4f9ccd82-eb19-467d-a40d-5f8ab9a7a354 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '109a4f100a7843c190cf3bda917eb5d7', 'request_id': 'req-4f9ccd82-eb19-467d-a40d-5f8ab9a7a354'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:14:27.688069 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-4f9ccd82-eb19-467d-a40d-5f8ab9a7a354 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '109a4f100a7843c190cf3bda917eb5d7', 'request_id': 'req-4f9ccd82-eb19-467d-a40d-5f8ab9a7a354'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:14:27.710569 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-4f9ccd82-eb19-467d-a40d-5f8ab9a7a354 admin admin] The token cache is being invalidate because project 109a4f100a7843c190cf3bda917eb5d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80012) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 14:14:27.711218 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-4f9ccd82-eb19-467d-a40d-5f8ab9a7a354 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:14:27.711814 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-4f9ccd82-eb19-467d-a40d-5f8ab9a7a354 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:14:27.721772 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1056/2126] 10.222.0.36 () {58 vars in 1232 bytes} [Tue May 3 14:14:27 2022] DELETE /identity/v3/projects/109a4f100a7843c190cf3bda917eb5d7 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 14:14:27.726143 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9ccd82-eb19-467d-a40d-5f8ab9a7a354 admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:14:27.731658 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-4f9ccd82-eb19-467d-a40d-5f8ab9a7a354 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:14:27.786081 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c14adc-79ba-4c05-9b7f-cec048bf01aa admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:14:27.790252 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6028b2fa-efaf-45b9-8c68-5b3fa06d98fc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b014f4c7ba1414cb8a597f5bc4033f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:14:27.791711 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6028b2fa-efaf-45b9-8c68-5b3fa06d98fc service cinder] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:27.792143 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6028b2fa-efaf-45b9-8c68-5b3fa06d98fc service cinder] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:27.792561 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6028b2fa-efaf-45b9-8c68-5b3fa06d98fc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:27.794610 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-6028b2fa-efaf-45b9-8c68-5b3fa06d98fc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:14:27.848841 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9ccd82-eb19-467d-a40d-5f8ab9a7a354 admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:14:27.891274 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6028b2fa-efaf-45b9-8c68-5b3fa06d98fc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:14:27.893049 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6028b2fa-efaf-45b9-8c68-5b3fa06d98fc service cinder] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:14:27.905825 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1071/2127] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:14:27 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 14:14:27.907845 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cd7f67-15a2-4f7b-bbde-ada15a2374ab None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:27.908140 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cd7f67-15a2-4f7b-bbde-ada15a2374ab None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:27.908637 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cd7f67-15a2-4f7b-bbde-ada15a2374ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:27.929997 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-48cd7f67-15a2-4f7b-bbde-ada15a2374ab None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:14:27.931344 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-48cd7f67-15a2-4f7b-bbde-ada15a2374ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:14:28.096658 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe0ccc2-cb77-4ed3-a566-7ae0f1ec9815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:14:28.098656 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe0ccc2-cb77-4ed3-a566-7ae0f1ec9815 admin admin] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:28.099149 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe0ccc2-cb77-4ed3-a566-7ae0f1ec9815 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:28.100642 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe0ccc2-cb77-4ed3-a566-7ae0f1ec9815 admin admin] PATH_INFO: `/v3/users` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:28.101138 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1072/2128] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:14:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:14:28.103340 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe0ccc2-cb77-4ed3-a566-7ae0f1ec9815 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:14:28.108358 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe0ccc2-cb77-4ed3-a566-7ae0f1ec9815 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:14:28.108756 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91051b9-55cb-4347-a70c-a5b49136bcb7 None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:28.109149 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91051b9-55cb-4347-a70c-a5b49136bcb7 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:28.109822 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91051b9-55cb-4347-a70c-a5b49136bcb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:28.147374 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1057/2129] 10.222.0.36 () {60 vars in 1143 bytes} [Tue May 3 14:14:27 2022] POST /identity/v3/users => generated 300 bytes in 422 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 14:14:28.151768 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-f91051b9-55cb-4347-a70c-a5b49136bcb7 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:14:28.153031 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-f91051b9-55cb-4347-a70c-a5b49136bcb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:14:28.154878 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe0ccc2-cb77-4ed3-a566-7ae0f1ec9815 admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:14:28.179101 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1073/2130] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:14:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:14:28.182547 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe0ccc2-cb77-4ed3-a566-7ae0f1ec9815 admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:14:28.183737 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91051b9-55cb-4347-a70c-a5b49136bcb7 None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:14:28.189016 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0330573c-5b87-4f83-8799-ab975a046e27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:14:28.189889 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0330573c-5b87-4f83-8799-ab975a046e27 admin admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:28.190362 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0330573c-5b87-4f83-8799-ab975a046e27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:28.190729 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0330573c-5b87-4f83-8799-ab975a046e27 admin admin] PATH_INFO: `/v3/roles` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:28.191681 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0330573c-5b87-4f83-8799-ab975a046e27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:14:28.193450 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0330573c-5b87-4f83-8799-ab975a046e27 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:14:28.205659 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91051b9-55cb-4347-a70c-a5b49136bcb7 None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:14:28.210131 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1058/2131] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 3 14:14:28 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 14:14:28.211230 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0330573c-5b87-4f83-8799-ab975a046e27 admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:14:28.223618 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0330573c-5b87-4f83-8799-ab975a046e27 admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:14:28.224572 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01c71ec-f231-4498-8d41-70d6ab6b470e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:14:28.225278 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01c71ec-f231-4498-8d41-70d6ab6b470e admin admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:28.226014 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01c71ec-f231-4498-8d41-70d6ab6b470e admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:28.226156 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01c71ec-f231-4498-8d41-70d6ab6b470e admin admin] PATH_INFO: `/v3/domains` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:28.228224 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01c71ec-f231-4498-8d41-70d6ab6b470e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:14:28.229401 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50aec81f-8c5b-4d1e-b5e7-fc3d70c53a11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:14:28.230423 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50aec81f-8c5b-4d1e-b5e7-fc3d70c53a11 admin admin] REQUEST_METHOD: `PUT` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:28.230799 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50aec81f-8c5b-4d1e-b5e7-fc3d70c53a11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:28.231168 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50aec81f-8c5b-4d1e-b5e7-fc3d70c53a11 admin admin] PATH_INFO: `/v3/projects/2ccca70ff1b44021b48e9614fb4de32d/users/35845124985e40b3aa88050d2abdc88b/roles/36abe9b50fd8479c86c4f8f70fd85aa3` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:28.234903 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01c71ec-f231-4498-8d41-70d6ab6b470e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:14:28.236422 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01c71ec-f231-4498-8d41-70d6ab6b470e admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:14:28.249861 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50aec81f-8c5b-4d1e-b5e7-fc3d70c53a11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ccca70ff1b44021b48e9614fb4de32d, user_id=35845124985e40b3aa88050d2abdc88b, role_id=36abe9b50fd8479c86c4f8f70fd85aa3)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:14:28.253465 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50aec81f-8c5b-4d1e-b5e7-fc3d70c53a11 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:14:28.283405 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1059/2132] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 3 14:14:28 2022] PUT /identity/v3/projects/2ccca70ff1b44021b48e9614fb4de32d/users/35845124985e40b3aa88050d2abdc88b/roles/36abe9b50fd8479c86c4f8f70fd85aa3 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:14:28.284648 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50aec81f-8c5b-4d1e-b5e7-fc3d70c53a11 admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:14:28.297139 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1074/2133] 10.222.0.36 () {58 vars in 1152 bytes} [Tue May 3 14:14:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:14:28.299442 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01c71ec-f231-4498-8d41-70d6ab6b470e admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:14:28.311102 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01c71ec-f231-4498-8d41-70d6ab6b470e admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:14:28.383695 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70575e28-03d0-4e41-a916-86bba40e37f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:14:28.384381 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70575e28-03d0-4e41-a916-86bba40e37f6 admin admin] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:28.384689 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70575e28-03d0-4e41-a916-86bba40e37f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:28.384960 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70575e28-03d0-4e41-a916-86bba40e37f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:28.385708 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70575e28-03d0-4e41-a916-86bba40e37f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:14:28.387984 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70575e28-03d0-4e41-a916-86bba40e37f6 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:14:28.417781 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50aec81f-8c5b-4d1e-b5e7-fc3d70c53a11 admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:14:28.425830 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d06b126-b077-45a1-9583-5f8c504d5598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:14:28.426838 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d06b126-b077-45a1-9583-5f8c504d5598 admin admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:28.427220 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d06b126-b077-45a1-9583-5f8c504d5598 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:28.427625 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d06b126-b077-45a1-9583-5f8c504d5598 admin admin] PATH_INFO: `/v3/roles` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:28.428486 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d06b126-b077-45a1-9583-5f8c504d5598 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:14:28.430827 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d06b126-b077-45a1-9583-5f8c504d5598 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:14:28.441556 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1075/2134] 10.222.0.36 () {60 vars in 1152 bytes} [Tue May 3 14:14:28 2022] POST /identity/v3/projects => generated 379 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 14:14:28.444930 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70575e28-03d0-4e41-a916-86bba40e37f6 admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:14:28.450362 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1060/2135] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 3 14:14:28 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 14:14:28.459264 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d06b126-b077-45a1-9583-5f8c504d5598 admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:14:28.489722 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d06b126-b077-45a1-9583-5f8c504d5598 admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:14:28.617914 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70575e28-03d0-4e41-a916-86bba40e37f6 admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:14:28.626886 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145fa0e6-7d44-4978-9dd4-9a18236ff66f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:14:28.627593 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145fa0e6-7d44-4978-9dd4-9a18236ff66f admin admin] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:28.627873 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145fa0e6-7d44-4978-9dd4-9a18236ff66f admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:28.628146 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145fa0e6-7d44-4978-9dd4-9a18236ff66f admin admin] PATH_INFO: `/v3/users` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:28.628847 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145fa0e6-7d44-4978-9dd4-9a18236ff66f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:14:28.631002 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145fa0e6-7d44-4978-9dd4-9a18236ff66f admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:14:28.631834 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df166483-7e9e-4c43-b6a8-32fdf52dad3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:14:28.633800 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df166483-7e9e-4c43-b6a8-32fdf52dad3e admin admin] REQUEST_METHOD: `PUT` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:28.634187 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df166483-7e9e-4c43-b6a8-32fdf52dad3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:28.634561 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df166483-7e9e-4c43-b6a8-32fdf52dad3e admin admin] PATH_INFO: `/v3/projects/2ccca70ff1b44021b48e9614fb4de32d/users/35845124985e40b3aa88050d2abdc88b/roles/36abe9b50fd8479c86c4f8f70fd85aa3` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:28.637920 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df166483-7e9e-4c43-b6a8-32fdf52dad3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ccca70ff1b44021b48e9614fb4de32d, user_id=35845124985e40b3aa88050d2abdc88b, role_id=36abe9b50fd8479c86c4f8f70fd85aa3)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:14:28.641273 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df166483-7e9e-4c43-b6a8-32fdf52dad3e admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:14:28.663898 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1061/2136] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 3 14:14:28 2022] PUT /identity/v3/projects/2ccca70ff1b44021b48e9614fb4de32d/users/35845124985e40b3aa88050d2abdc88b/roles/36abe9b50fd8479c86c4f8f70fd85aa3 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:14:28.666658 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f314ff2-6dc4-42a0-aa68-bcbcc0aa53bb None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:28.667025 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f314ff2-6dc4-42a0-aa68-bcbcc0aa53bb None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:28.667438 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f314ff2-6dc4-42a0-aa68-bcbcc0aa53bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:28.682732 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1076/2137] 10.222.0.36 () {60 vars in 1143 bytes} [Tue May 3 14:14:28 2022] POST /identity/v3/users => generated 290 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 14:14:28.683766 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145fa0e6-7d44-4978-9dd4-9a18236ff66f admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:14:28.703328 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145fa0e6-7d44-4978-9dd4-9a18236ff66f admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:14:28.710440 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-9f314ff2-6dc4-42a0-aa68-bcbcc0aa53bb None None] MFA Rules not processed for user `35845124985e40b3aa88050d2abdc88b`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:14:28.712120 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-9f314ff2-6dc4-42a0-aa68-bcbcc0aa53bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:14:28.847813 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95948a31-529b-4b58-98f6-fa6e347cdae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:14:28.848533 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95948a31-529b-4b58-98f6-fa6e347cdae3 admin admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:28.848810 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95948a31-529b-4b58-98f6-fa6e347cdae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:28.849086 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95948a31-529b-4b58-98f6-fa6e347cdae3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:28.850330 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95948a31-529b-4b58-98f6-fa6e347cdae3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:14:28.852057 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95948a31-529b-4b58-98f6-fa6e347cdae3 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:14:28.870934 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1077/2138] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 3 14:14:28 2022] GET /identity/v3/roles => generated 1420 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 14:14:28.874871 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95948a31-529b-4b58-98f6-fa6e347cdae3 admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:14:28.878421 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1062/2139] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:14:28 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:14:28.892443 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f314ff2-6dc4-42a0-aa68-bcbcc0aa53bb None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:14:28.893944 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-9f314ff2-6dc4-42a0-aa68-bcbcc0aa53bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:14:28.903017 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95948a31-529b-4b58-98f6-fa6e347cdae3 admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:14:28.921188 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d6ab82-374c-4f60-a48d-5f9e2ffb9320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:14:28.921906 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d6ab82-374c-4f60-a48d-5f9e2ffb9320 admin admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:28.922187 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d6ab82-374c-4f60-a48d-5f9e2ffb9320 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:28.922465 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d6ab82-374c-4f60-a48d-5f9e2ffb9320 admin admin] PATH_INFO: `/v3/roles` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:28.923202 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d6ab82-374c-4f60-a48d-5f9e2ffb9320 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:14:28.924928 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d6ab82-374c-4f60-a48d-5f9e2ffb9320 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:14:28.948169 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1078/2140] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 3 14:14:28 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 14:14:28.950667 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d6ab82-374c-4f60-a48d-5f9e2ffb9320 admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:14:28.961668 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d6ab82-374c-4f60-a48d-5f9e2ffb9320 admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:14:28.967342 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10ee572-3cea-4e69-ad7b-ad1fdf42d75b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:14:28.968490 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10ee572-3cea-4e69-ad7b-ad1fdf42d75b admin admin] REQUEST_METHOD: `PUT` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:28.968772 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10ee572-3cea-4e69-ad7b-ad1fdf42d75b admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:28.969050 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10ee572-3cea-4e69-ad7b-ad1fdf42d75b admin admin] PATH_INFO: `/v3/projects/593f1ab9823f41ffa40d6155bebaca54/users/7b05c6d36153485c9859ce7b749ab40c/roles/441fdc11e95b47f4813f72610e39018b` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:28.982761 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f314ff2-6dc4-42a0-aa68-bcbcc0aa53bb None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:14:28.988116 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5440b14-2d3a-4dc3-8e31-1d4881c7036d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b014f4c7ba1414cb8a597f5bc4033f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:14:28.988936 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5440b14-2d3a-4dc3-8e31-1d4881c7036d service cinder] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:28.989365 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5440b14-2d3a-4dc3-8e31-1d4881c7036d service cinder] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:28.989704 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10ee572-3cea-4e69-ad7b-ad1fdf42d75b admin admin] RBAC: Authorizing `identity:create_grant(project_id=593f1ab9823f41ffa40d6155bebaca54, user_id=7b05c6d36153485c9859ce7b749ab40c, role_id=441fdc11e95b47f4813f72610e39018b)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:14:28.989820 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5440b14-2d3a-4dc3-8e31-1d4881c7036d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:28.993534 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10ee572-3cea-4e69-ad7b-ad1fdf42d75b admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:14:29.004470 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5440b14-2d3a-4dc3-8e31-1d4881c7036d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:14:29.006633 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5440b14-2d3a-4dc3-8e31-1d4881c7036d service cinder] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:14:29.013007 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1079/2141] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 3 14:14:28 2022] PUT /identity/v3/projects/593f1ab9823f41ffa40d6155bebaca54/users/7b05c6d36153485c9859ce7b749ab40c/roles/441fdc11e95b47f4813f72610e39018b => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 14:14:29.019956 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5404481-9d38-4152-b137-3510cd3ccd09 None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:29.020406 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5404481-9d38-4152-b137-3510cd3ccd09 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:29.021101 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5404481-9d38-4152-b137-3510cd3ccd09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:29.023843 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1063/2142] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:14:28 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 14:14:29.042836 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-f5404481-9d38-4152-b137-3510cd3ccd09 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:14:29.044267 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-f5404481-9d38-4152-b137-3510cd3ccd09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:14:29.147055 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1080/2143] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:14:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:14:29.156342 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5440b14-2d3a-4dc3-8e31-1d4881c7036d service cinder] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:14:29.158627 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-e5440b14-2d3a-4dc3-8e31-1d4881c7036d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:14:29.249577 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5404481-9d38-4152-b137-3510cd3ccd09 None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:14:29.251041 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-f5404481-9d38-4152-b137-3510cd3ccd09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:14:29.276434 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5404481-9d38-4152-b137-3510cd3ccd09 None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:14:29.282121 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277cdc32-e347-49b4-af77-61836476fe33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:14:29.283129 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277cdc32-e347-49b4-af77-61836476fe33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:29.283406 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277cdc32-e347-49b4-af77-61836476fe33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:29.283673 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277cdc32-e347-49b4-af77-61836476fe33 admin admin] PATH_INFO: `/v3/users/d337d68a44de4d4290e70e4200bdba83` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:29.285075 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277cdc32-e347-49b4-af77-61836476fe33 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d337d68a44de4d4290e70e4200bdba83)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:14:29.287059 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277cdc32-e347-49b4-af77-61836476fe33 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:14:29.300939 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5440b14-2d3a-4dc3-8e31-1d4881c7036d service cinder] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:14:29.384865 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c3948a-59db-47ef-8a2a-009275143003 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '937bea4f355144b4a7ee11baabc3a4cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:14:29.385558 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c3948a-59db-47ef-8a2a-009275143003 service neutron] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:29.385836 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c3948a-59db-47ef-8a2a-009275143003 service neutron] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:29.386113 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c3948a-59db-47ef-8a2a-009275143003 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:29.405689 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c3948a-59db-47ef-8a2a-009275143003 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:14:29.406058 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-277cdc32-e347-49b4-af77-61836476fe33 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd337d68a44de4d4290e70e4200bdba83'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:14:29.407159 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c3948a-59db-47ef-8a2a-009275143003 service neutron] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:14:29.415901 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-277cdc32-e347-49b4-af77-61836476fe33 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd337d68a44de4d4290e70e4200bdba83'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:14:29.417916 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-277cdc32-e347-49b4-af77-61836476fe33 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd337d68a44de4d4290e70e4200bdba83'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:14:29.428193 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1064/2144] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:14:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 14:14:29.431854 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-277cdc32-e347-49b4-af77-61836476fe33 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd337d68a44de4d4290e70e4200bdba83'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:14:29.434993 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-277cdc32-e347-49b4-af77-61836476fe33 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd337d68a44de4d4290e70e4200bdba83'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:14:29.463385 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1081/2145] 10.222.0.36 () {58 vars in 1223 bytes} [Tue May 3 14:14:29 2022] DELETE /identity/v3/users/d337d68a44de4d4290e70e4200bdba83 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 14:14:29.889161 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c3948a-59db-47ef-8a2a-009275143003 service neutron] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:14:29.902687 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c3948a-59db-47ef-8a2a-009275143003 service neutron] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:14:30.059682 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2e69eb-d97b-4678-8f8d-4279f49f76bd None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:30.062195 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61a1988-1d7c-4f87-bc9d-cf96d46427f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:14:30.062650 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2e69eb-d97b-4678-8f8d-4279f49f76bd None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:30.063010 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2e69eb-d97b-4678-8f8d-4279f49f76bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:30.063975 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61a1988-1d7c-4f87-bc9d-cf96d46427f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:30.065604 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61a1988-1d7c-4f87-bc9d-cf96d46427f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:30.065952 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61a1988-1d7c-4f87-bc9d-cf96d46427f5 admin admin] PATH_INFO: `/v3/projects/831ebb047e5b4805875d2606cb8e08c0` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:30.070024 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61a1988-1d7c-4f87-bc9d-cf96d46427f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=831ebb047e5b4805875d2606cb8e08c0)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:14:30.075478 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61a1988-1d7c-4f87-bc9d-cf96d46427f5 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:14:30.107216 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-4d2e69eb-d97b-4678-8f8d-4279f49f76bd None None] MFA Rules not processed for user `646959f190b24b3fa5438b72f32b06a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:14:30.108643 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-4d2e69eb-d97b-4678-8f8d-4279f49f76bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:14:30.152074 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-e61a1988-1d7c-4f87-bc9d-cf96d46427f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '831ebb047e5b4805875d2606cb8e08c0', 'request_id': 'req-e61a1988-1d7c-4f87-bc9d-cf96d46427f5'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:14:30.161932 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-e61a1988-1d7c-4f87-bc9d-cf96d46427f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '831ebb047e5b4805875d2606cb8e08c0', 'request_id': 'req-e61a1988-1d7c-4f87-bc9d-cf96d46427f5'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:14:30.178055 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-e61a1988-1d7c-4f87-bc9d-cf96d46427f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '831ebb047e5b4805875d2606cb8e08c0', 'request_id': 'req-e61a1988-1d7c-4f87-bc9d-cf96d46427f5'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:14:30.198957 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-e61a1988-1d7c-4f87-bc9d-cf96d46427f5 admin admin] The token cache is being invalidate because project 831ebb047e5b4805875d2606cb8e08c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80012) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 14:14:30.199712 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-e61a1988-1d7c-4f87-bc9d-cf96d46427f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:14:30.200620 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-e61a1988-1d7c-4f87-bc9d-cf96d46427f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:14:30.206452 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1065/2146] 10.222.0.36 () {58 vars in 1232 bytes} [Tue May 3 14:14:29 2022] DELETE /identity/v3/projects/831ebb047e5b4805875d2606cb8e08c0 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:14:30.206452 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61a1988-1d7c-4f87-bc9d-cf96d46427f5 admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:14:30.207614 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-e61a1988-1d7c-4f87-bc9d-cf96d46427f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:14:30.227209 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1082/2147] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:14:30 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:14:30.229969 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f4323e-d392-49e2-a81c-ba7d35d1d116 None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:30.230396 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f4323e-d392-49e2-a81c-ba7d35d1d116 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:30.230889 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f4323e-d392-49e2-a81c-ba7d35d1d116 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:30.255182 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-85f4323e-d392-49e2-a81c-ba7d35d1d116 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:14:30.256982 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-85f4323e-d392-49e2-a81c-ba7d35d1d116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:14:30.318189 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61a1988-1d7c-4f87-bc9d-cf96d46427f5 admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:14:30.333340 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d94485-44a3-4b3c-bf6e-aa746068f769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:14:30.334271 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d94485-44a3-4b3c-bf6e-aa746068f769 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:30.334556 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d94485-44a3-4b3c-bf6e-aa746068f769 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:30.334834 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d94485-44a3-4b3c-bf6e-aa746068f769 admin admin] PATH_INFO: `/v3/users/c7ff726ea559407383ef312e3f5c1767` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:30.336854 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d94485-44a3-4b3c-bf6e-aa746068f769 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7ff726ea559407383ef312e3f5c1767)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:14:30.339236 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d94485-44a3-4b3c-bf6e-aa746068f769 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:14:30.357384 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1083/2148] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:14:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:14:30.358733 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f4323e-d392-49e2-a81c-ba7d35d1d116 None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:14:30.364320 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-85f4323e-d392-49e2-a81c-ba7d35d1d116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:14:30.396998 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-f6d94485-44a3-4b3c-bf6e-aa746068f769 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7ff726ea559407383ef312e3f5c1767'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:14:30.406980 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-f6d94485-44a3-4b3c-bf6e-aa746068f769 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7ff726ea559407383ef312e3f5c1767'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:14:30.408471 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-f6d94485-44a3-4b3c-bf6e-aa746068f769 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7ff726ea559407383ef312e3f5c1767'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:14:30.422119 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-f6d94485-44a3-4b3c-bf6e-aa746068f769 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7ff726ea559407383ef312e3f5c1767'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:14:30.422894 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-f6d94485-44a3-4b3c-bf6e-aa746068f769 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7ff726ea559407383ef312e3f5c1767'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:14:30.438065 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f4323e-d392-49e2-a81c-ba7d35d1d116 None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:14:30.441438 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1066/2149] 10.222.0.36 () {58 vars in 1223 bytes} [Tue May 3 14:14:30 2022] DELETE /identity/v3/users/c7ff726ea559407383ef312e3f5c1767 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:14:30.445925 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49078b2-f84d-45fb-bc8e-97b52a8c3cab None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:30.446218 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49078b2-f84d-45fb-bc8e-97b52a8c3cab None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:30.446494 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49078b2-f84d-45fb-bc8e-97b52a8c3cab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:30.447560 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6017be-b48c-4271-aa4a-aa8fc788a377 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '616de5e7daed46849efc75ad77ea054e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:14:30.448629 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6017be-b48c-4271-aa4a-aa8fc788a377 service glance] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:30.449211 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6017be-b48c-4271-aa4a-aa8fc788a377 service glance] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:30.449773 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6017be-b48c-4271-aa4a-aa8fc788a377 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:30.452925 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-6c6017be-b48c-4271-aa4a-aa8fc788a377 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:14:30.472318 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-b49078b2-f84d-45fb-bc8e-97b52a8c3cab None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:14:30.473853 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-b49078b2-f84d-45fb-bc8e-97b52a8c3cab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:14:30.534143 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6017be-b48c-4271-aa4a-aa8fc788a377 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:14:30.535684 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6017be-b48c-4271-aa4a-aa8fc788a377 service glance] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:14:30.549630 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1084/2150] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:14:30 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 14:14:30.551379 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3ddfd5-272b-44ab-9530-fc9f0ec07cc0 None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:30.551897 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3ddfd5-272b-44ab-9530-fc9f0ec07cc0 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:30.552380 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3ddfd5-272b-44ab-9530-fc9f0ec07cc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:30.569446 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1067/2151] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:14:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:14:30.571772 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49078b2-f84d-45fb-bc8e-97b52a8c3cab None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:14:30.577942 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-aa3ddfd5-272b-44ab-9530-fc9f0ec07cc0 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:14:30.580304 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-aa3ddfd5-272b-44ab-9530-fc9f0ec07cc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:14:30.581574 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49078b2-f84d-45fb-bc8e-97b52a8c3cab None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:14:30.597119 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1085/2152] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:14:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:14:30.597639 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4460ada7-de88-4998-87c2-be6a08703e50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:14:30.599736 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4460ada7-de88-4998-87c2-be6a08703e50 admin admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:30.606196 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4460ada7-de88-4998-87c2-be6a08703e50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:30.607337 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4460ada7-de88-4998-87c2-be6a08703e50 admin admin] PATH_INFO: `/v3/domains` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:30.607337 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4460ada7-de88-4998-87c2-be6a08703e50 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80012) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:14:30.607531 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4460ada7-de88-4998-87c2-be6a08703e50 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:14:30.609245 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4460ada7-de88-4998-87c2-be6a08703e50 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:14:30.614652 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3ddfd5-272b-44ab-9530-fc9f0ec07cc0 None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:14:30.617027 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-aa3ddfd5-272b-44ab-9530-fc9f0ec07cc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:14:30.629393 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1068/2153] 10.222.0.36 () {58 vars in 1152 bytes} [Tue May 3 14:14:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:14:30.631222 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4460ada7-de88-4998-87c2-be6a08703e50 admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:14:30.651021 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4460ada7-de88-4998-87c2-be6a08703e50 admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:14:30.657630 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4703b6ec-fb28-4315-9301-119ebf994f7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:14:30.658414 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4703b6ec-fb28-4315-9301-119ebf994f7c admin admin] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:30.658795 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4703b6ec-fb28-4315-9301-119ebf994f7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:30.659145 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4703b6ec-fb28-4315-9301-119ebf994f7c admin admin] PATH_INFO: `/v3/projects` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:30.660322 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4703b6ec-fb28-4315-9301-119ebf994f7c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:14:30.662544 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4703b6ec-fb28-4315-9301-119ebf994f7c admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:14:30.741022 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1069/2154] 10.222.0.36 () {60 vars in 1152 bytes} [Tue May 3 14:14:30 2022] POST /identity/v3/projects => generated 385 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 14:14:30.746351 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4703b6ec-fb28-4315-9301-119ebf994f7c admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:14:30.789358 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3ddfd5-272b-44ab-9530-fc9f0ec07cc0 None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:14:30.900738 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4703b6ec-fb28-4315-9301-119ebf994f7c admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:14:30.914169 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba037384-7aad-428c-9b3e-3345e40476c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:14:30.916157 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba037384-7aad-428c-9b3e-3345e40476c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:30.916402 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba037384-7aad-428c-9b3e-3345e40476c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:30.916890 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba037384-7aad-428c-9b3e-3345e40476c8 admin admin] PATH_INFO: `/v3/users` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:30.918076 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90db4cf-504e-4656-8db6-ad04f20d6ec0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '937bea4f355144b4a7ee11baabc3a4cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:14:30.918205 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba037384-7aad-428c-9b3e-3345e40476c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:14:30.919209 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90db4cf-504e-4656-8db6-ad04f20d6ec0 service neutron] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:30.919209 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90db4cf-504e-4656-8db6-ad04f20d6ec0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:30.919209 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90db4cf-504e-4656-8db6-ad04f20d6ec0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:30.921004 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba037384-7aad-428c-9b3e-3345e40476c8 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:14:30.936008 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90db4cf-504e-4656-8db6-ad04f20d6ec0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:14:30.937872 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90db4cf-504e-4656-8db6-ad04f20d6ec0 service neutron] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:14:30.949611 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1086/2155] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:14:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 03 14:14:30.952056 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3ebb37-a413-4835-9ca7-266b21a496fa None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:30.952457 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3ebb37-a413-4835-9ca7-266b21a496fa None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:30.953703 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3ebb37-a413-4835-9ca7-266b21a496fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:30.955673 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1070/2156] 10.222.0.36 () {60 vars in 1143 bytes} [Tue May 3 14:14:30 2022] POST /identity/v3/users => generated 293 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 14:14:30.960252 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba037384-7aad-428c-9b3e-3345e40476c8 admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:14:30.991481 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba037384-7aad-428c-9b3e-3345e40476c8 admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:14:30.992013 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-bb3ebb37-a413-4835-9ca7-266b21a496fa None None] MFA Rules not processed for user `dec39ff0b6544a738e5aae06e9a8cb38`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:14:30.994089 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-bb3ebb37-a413-4835-9ca7-266b21a496fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:14:31.020016 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b91915-45d3-40e8-8c34-05e215e5578c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:14:31.021765 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b91915-45d3-40e8-8c34-05e215e5578c admin admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:31.022182 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b91915-45d3-40e8-8c34-05e215e5578c admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:31.022539 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b91915-45d3-40e8-8c34-05e215e5578c admin admin] PATH_INFO: `/v3/roles` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:31.025140 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b91915-45d3-40e8-8c34-05e215e5578c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:14:31.026875 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b91915-45d3-40e8-8c34-05e215e5578c admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:14:31.071336 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1071/2157] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 3 14:14:30 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 14:14:31.074606 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b91915-45d3-40e8-8c34-05e215e5578c admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:14:31.104895 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b91915-45d3-40e8-8c34-05e215e5578c admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:14:31.107920 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1087/2158] 10.222.0.36 () {58 vars in 1009 bytes} [Tue May 3 14:14:30 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:14:31.126279 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a514cd-8d28-4c5e-b5a8-c16204d295ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:14:31.129257 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a514cd-8d28-4c5e-b5a8-c16204d295ec admin admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:31.129892 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a514cd-8d28-4c5e-b5a8-c16204d295ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:31.130415 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a514cd-8d28-4c5e-b5a8-c16204d295ec admin admin] PATH_INFO: `/v3/roles` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:31.132631 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a514cd-8d28-4c5e-b5a8-c16204d295ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:14:31.135347 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a514cd-8d28-4c5e-b5a8-c16204d295ec admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:14:31.157821 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1072/2159] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 3 14:14:31 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 14:14:31.161732 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3ebb37-a413-4835-9ca7-266b21a496fa None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:14:31.180333 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3ebb37-a413-4835-9ca7-266b21a496fa None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:14:31.184844 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a514cd-8d28-4c5e-b5a8-c16204d295ec admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:14:31.187046 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-a9a514cd-8d28-4c5e-b5a8-c16204d295ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:14:31.197422 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9672d53-f61f-402f-bad9-fce3b08b9a7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:14:31.199620 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9672d53-f61f-402f-bad9-fce3b08b9a7f admin admin] REQUEST_METHOD: `PUT` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:31.199977 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9672d53-f61f-402f-bad9-fce3b08b9a7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:31.201500 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9672d53-f61f-402f-bad9-fce3b08b9a7f admin admin] PATH_INFO: `/v3/projects/e666804deea54d8ea4f3b2b7bcf263cd/users/f19a5630cfc645559e6c87f4bc9ac91d/roles/441fdc11e95b47f4813f72610e39018b` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:31.243760 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9672d53-f61f-402f-bad9-fce3b08b9a7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e666804deea54d8ea4f3b2b7bcf263cd, user_id=f19a5630cfc645559e6c87f4bc9ac91d, role_id=441fdc11e95b47f4813f72610e39018b)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:14:31.251014 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9672d53-f61f-402f-bad9-fce3b08b9a7f admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:14:31.273327 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1088/2160] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 3 14:14:31 2022] PUT /identity/v3/projects/e666804deea54d8ea4f3b2b7bcf263cd/users/f19a5630cfc645559e6c87f4bc9ac91d/roles/441fdc11e95b47f4813f72610e39018b => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 14:14:31.284277 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06ae42b-bd1b-4658-8634-52bffdd94aa5 None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:31.285123 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06ae42b-bd1b-4658-8634-52bffdd94aa5 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:31.285536 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06ae42b-bd1b-4658-8634-52bffdd94aa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:31.324523 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a514cd-8d28-4c5e-b5a8-c16204d295ec admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:14:31.332880 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-c06ae42b-bd1b-4658-8634-52bffdd94aa5 None None] MFA Rules not processed for user `f19a5630cfc645559e6c87f4bc9ac91d`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:14:31.333954 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-c06ae42b-bd1b-4658-8634-52bffdd94aa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:14:31.431618 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6abe060-9f24-47b5-a62d-44331170d2f2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1180e29180d44418390cf22d3e0bd6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:14:31.432457 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6abe060-9f24-47b5-a62d-44331170d2f2 service swift] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:31.432735 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6abe060-9f24-47b5-a62d-44331170d2f2 service swift] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:31.433014 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6abe060-9f24-47b5-a62d-44331170d2f2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:31.465659 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1089/2161] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:14:31 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 14:14:31.477856 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06ae42b-bd1b-4658-8634-52bffdd94aa5 None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:14:31.479985 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-c06ae42b-bd1b-4658-8634-52bffdd94aa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:14:31.555838 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6abe060-9f24-47b5-a62d-44331170d2f2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:14:31.557672 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6abe060-9f24-47b5-a62d-44331170d2f2 service swift] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:14:31.568964 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1073/2162] 10.222.0.36 () {60 vars in 1384 bytes} [Tue May 3 14:14:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 03 14:14:31.604815 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06ae42b-bd1b-4658-8634-52bffdd94aa5 None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:14:31.621624 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a0aed6-9e80-4c8f-9e6f-6927d76cdbc9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63489e658c094a2598a2ac62159d2fda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:14:31.622690 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a0aed6-9e80-4c8f-9e6f-6927d76cdbc9 service nova] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:31.623169 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a0aed6-9e80-4c8f-9e6f-6927d76cdbc9 service nova] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:31.623570 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a0aed6-9e80-4c8f-9e6f-6927d76cdbc9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:31.637363 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a0aed6-9e80-4c8f-9e6f-6927d76cdbc9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:14:31.639260 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a0aed6-9e80-4c8f-9e6f-6927d76cdbc9 service nova] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:14:31.655204 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1090/2163] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:14:31 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 14:14:32.138743 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6abe060-9f24-47b5-a62d-44331170d2f2 service swift] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:14:32.140870 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-c6abe060-9f24-47b5-a62d-44331170d2f2 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:14:32.352441 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6abe060-9f24-47b5-a62d-44331170d2f2 service swift] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:14:32.368128 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdd3a52-a4d7-42ca-b172-070c70c0c07f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:14:32.371975 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdd3a52-a4d7-42ca-b172-070c70c0c07f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:32.372291 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdd3a52-a4d7-42ca-b172-070c70c0c07f admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:32.372528 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdd3a52-a4d7-42ca-b172-070c70c0c07f admin admin] PATH_INFO: `/v3/projects/de9c6f0cd4d24452b03a2977ea695c77` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:32.377970 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdd3a52-a4d7-42ca-b172-070c70c0c07f admin admin] RBAC: Authorizing `identity:delete_project(project_id=de9c6f0cd4d24452b03a2977ea695c77)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:14:32.384907 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdd3a52-a4d7-42ca-b172-070c70c0c07f admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:14:32.484679 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-1fdd3a52-a4d7-42ca-b172-070c70c0c07f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de9c6f0cd4d24452b03a2977ea695c77', 'request_id': 'req-1fdd3a52-a4d7-42ca-b172-070c70c0c07f'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:14:32.493332 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-1fdd3a52-a4d7-42ca-b172-070c70c0c07f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de9c6f0cd4d24452b03a2977ea695c77', 'request_id': 'req-1fdd3a52-a4d7-42ca-b172-070c70c0c07f'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:14:32.500790 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-1fdd3a52-a4d7-42ca-b172-070c70c0c07f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de9c6f0cd4d24452b03a2977ea695c77', 'request_id': 'req-1fdd3a52-a4d7-42ca-b172-070c70c0c07f'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:14:32.522169 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-1fdd3a52-a4d7-42ca-b172-070c70c0c07f admin admin] The token cache is being invalidate because project de9c6f0cd4d24452b03a2977ea695c77 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80012) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 14:14:32.522925 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-1fdd3a52-a4d7-42ca-b172-070c70c0c07f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:14:32.524847 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-1fdd3a52-a4d7-42ca-b172-070c70c0c07f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:14:32.530904 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1074/2164] 10.222.0.36 () {58 vars in 1232 bytes} [Tue May 3 14:14:32 2022] DELETE /identity/v3/projects/de9c6f0cd4d24452b03a2977ea695c77 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:14:32.536470 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a0aed6-9e80-4c8f-9e6f-6927d76cdbc9 service nova] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:14:32.551553 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a0aed6-9e80-4c8f-9e6f-6927d76cdbc9 service nova] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:14:32.594051 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdd3a52-a4d7-42ca-b172-070c70c0c07f admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:14:32.596167 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-1fdd3a52-a4d7-42ca-b172-070c70c0c07f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:14:32.728371 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8669ffe-b95a-4061-8499-25c5f159c371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:14:32.729499 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8669ffe-b95a-4061-8499-25c5f159c371 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:32.729783 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8669ffe-b95a-4061-8499-25c5f159c371 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:32.730060 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8669ffe-b95a-4061-8499-25c5f159c371 admin admin] PATH_INFO: `/v3/users/35845124985e40b3aa88050d2abdc88b` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:32.732075 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8669ffe-b95a-4061-8499-25c5f159c371 admin admin] RBAC: Authorizing `identity:delete_user(user_id=35845124985e40b3aa88050d2abdc88b)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:14:32.734669 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8669ffe-b95a-4061-8499-25c5f159c371 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:14:32.780083 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdd3a52-a4d7-42ca-b172-070c70c0c07f admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:14:32.799954 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df71480b-2af2-46c9-9cd6-fd2fd7468681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:14:32.802075 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df71480b-2af2-46c9-9cd6-fd2fd7468681 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:32.803324 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df71480b-2af2-46c9-9cd6-fd2fd7468681 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:32.812862 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df71480b-2af2-46c9-9cd6-fd2fd7468681 admin admin] PATH_INFO: `/v3/users/197151cf95e749df9bd5827598bb32e5` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:32.819542 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df71480b-2af2-46c9-9cd6-fd2fd7468681 admin admin] RBAC: Authorizing `identity:delete_user(user_id=197151cf95e749df9bd5827598bb32e5)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:14:32.822007 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df71480b-2af2-46c9-9cd6-fd2fd7468681 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:14:32.873797 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-b8669ffe-b95a-4061-8499-25c5f159c371 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35845124985e40b3aa88050d2abdc88b'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:14:32.912613 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-b8669ffe-b95a-4061-8499-25c5f159c371 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35845124985e40b3aa88050d2abdc88b'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:14:32.914631 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-b8669ffe-b95a-4061-8499-25c5f159c371 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35845124985e40b3aa88050d2abdc88b'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:14:32.937501 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-b8669ffe-b95a-4061-8499-25c5f159c371 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35845124985e40b3aa88050d2abdc88b'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:14:32.938152 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-b8669ffe-b95a-4061-8499-25c5f159c371 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35845124985e40b3aa88050d2abdc88b'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:14:32.965519 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-df71480b-2af2-46c9-9cd6-fd2fd7468681 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '197151cf95e749df9bd5827598bb32e5'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:14:32.993253 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-df71480b-2af2-46c9-9cd6-fd2fd7468681 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '197151cf95e749df9bd5827598bb32e5'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:14:32.997610 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-df71480b-2af2-46c9-9cd6-fd2fd7468681 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '197151cf95e749df9bd5827598bb32e5'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:14:33.005717 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1091/2165] 10.222.0.36 () {58 vars in 1223 bytes} [Tue May 3 14:14:32 2022] DELETE /identity/v3/users/35845124985e40b3aa88050d2abdc88b => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:14:33.027746 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-df71480b-2af2-46c9-9cd6-fd2fd7468681 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '197151cf95e749df9bd5827598bb32e5'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:14:33.034384 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-df71480b-2af2-46c9-9cd6-fd2fd7468681 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '197151cf95e749df9bd5827598bb32e5'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:14:33.069091 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1075/2166] 10.222.0.36 () {58 vars in 1223 bytes} [Tue May 3 14:14:32 2022] DELETE /identity/v3/users/197151cf95e749df9bd5827598bb32e5 => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 14:14:33.073918 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948e61ba-4137-4868-ab67-8892e8aa0ce7 None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:33.074307 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948e61ba-4137-4868-ab67-8892e8aa0ce7 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:33.074652 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948e61ba-4137-4868-ab67-8892e8aa0ce7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:33.103750 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-948e61ba-4137-4868-ab67-8892e8aa0ce7 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:14:33.105516 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-948e61ba-4137-4868-ab67-8892e8aa0ce7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:14:33.240931 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1092/2167] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:14:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:14:33.252970 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df71480b-2af2-46c9-9cd6-fd2fd7468681 admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:14:33.254618 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-df71480b-2af2-46c9-9cd6-fd2fd7468681 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:14:33.398167 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df71480b-2af2-46c9-9cd6-fd2fd7468681 admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:14:33.406920 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b351ee-6124-4a5a-98fa-afdc4e417ecf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '937bea4f355144b4a7ee11baabc3a4cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:14:33.407596 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b351ee-6124-4a5a-98fa-afdc4e417ecf service neutron] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:33.407876 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b351ee-6124-4a5a-98fa-afdc4e417ecf service neutron] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:33.408151 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b351ee-6124-4a5a-98fa-afdc4e417ecf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:33.444963 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b351ee-6124-4a5a-98fa-afdc4e417ecf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:14:33.446521 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b351ee-6124-4a5a-98fa-afdc4e417ecf service neutron] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:14:33.473838 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1076/2168] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:14:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 14:14:34.356884 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948e61ba-4137-4868-ab67-8892e8aa0ce7 None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:14:34.358954 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-948e61ba-4137-4868-ab67-8892e8aa0ce7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:14:34.373117 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948e61ba-4137-4868-ab67-8892e8aa0ce7 None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:14:34.386793 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a390ee1-613d-4a99-b403-4d7e91a1ea71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:14:34.388285 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a390ee1-613d-4a99-b403-4d7e91a1ea71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:34.388922 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a390ee1-613d-4a99-b403-4d7e91a1ea71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:34.388922 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a390ee1-613d-4a99-b403-4d7e91a1ea71 admin admin] PATH_INFO: `/v3/projects/2ccca70ff1b44021b48e9614fb4de32d` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:34.390742 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a390ee1-613d-4a99-b403-4d7e91a1ea71 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ccca70ff1b44021b48e9614fb4de32d)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:14:34.392800 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a390ee1-613d-4a99-b403-4d7e91a1ea71 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:14:34.466489 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-7a390ee1-613d-4a99-b403-4d7e91a1ea71 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ccca70ff1b44021b48e9614fb4de32d', 'request_id': 'req-7a390ee1-613d-4a99-b403-4d7e91a1ea71'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:14:34.477833 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-7a390ee1-613d-4a99-b403-4d7e91a1ea71 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ccca70ff1b44021b48e9614fb4de32d', 'request_id': 'req-7a390ee1-613d-4a99-b403-4d7e91a1ea71'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:14:34.499854 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-7a390ee1-613d-4a99-b403-4d7e91a1ea71 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ccca70ff1b44021b48e9614fb4de32d', 'request_id': 'req-7a390ee1-613d-4a99-b403-4d7e91a1ea71'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:14:34.515290 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-7a390ee1-613d-4a99-b403-4d7e91a1ea71 admin admin] The token cache is being invalidate because project 2ccca70ff1b44021b48e9614fb4de32d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80013) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 14:14:34.515557 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-7a390ee1-613d-4a99-b403-4d7e91a1ea71 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:14:34.521368 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-7a390ee1-613d-4a99-b403-4d7e91a1ea71 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:14:34.532785 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1093/2169] 10.222.0.36 () {58 vars in 1232 bytes} [Tue May 3 14:14:34 2022] DELETE /identity/v3/projects/2ccca70ff1b44021b48e9614fb4de32d => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:14:34.535380 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8652be11-cebd-48dc-b689-b6969d5c2d82 None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:34.535934 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8652be11-cebd-48dc-b689-b6969d5c2d82 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:34.536325 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8652be11-cebd-48dc-b689-b6969d5c2d82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:34.593817 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-8652be11-cebd-48dc-b689-b6969d5c2d82 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:14:34.595064 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-8652be11-cebd-48dc-b689-b6969d5c2d82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:14:34.759965 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1077/2170] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:14:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:14:34.769046 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980e32b9-1e0a-4d5a-95e5-01987dfb2462 None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:34.769665 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980e32b9-1e0a-4d5a-95e5-01987dfb2462 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:34.769982 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980e32b9-1e0a-4d5a-95e5-01987dfb2462 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:34.796153 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-980e32b9-1e0a-4d5a-95e5-01987dfb2462 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:14:34.798133 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-980e32b9-1e0a-4d5a-95e5-01987dfb2462 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:14:34.816149 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1094/2171] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:14:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:14:34.817543 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8652be11-cebd-48dc-b689-b6969d5c2d82 None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:14:34.829547 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8652be11-cebd-48dc-b689-b6969d5c2d82 None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:14:34.838048 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52e2658-8a49-4415-9c63-018fa055f511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:14:34.838733 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52e2658-8a49-4415-9c63-018fa055f511 admin admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:34.839129 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52e2658-8a49-4415-9c63-018fa055f511 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:34.839409 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52e2658-8a49-4415-9c63-018fa055f511 admin admin] PATH_INFO: `/v3/domains` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:34.840325 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52e2658-8a49-4415-9c63-018fa055f511 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80012) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:14:34.840630 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52e2658-8a49-4415-9c63-018fa055f511 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:14:34.843129 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52e2658-8a49-4415-9c63-018fa055f511 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:14:34.862379 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1078/2172] 10.222.0.36 () {58 vars in 1152 bytes} [Tue May 3 14:14:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:14:34.864178 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980e32b9-1e0a-4d5a-95e5-01987dfb2462 None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:14:34.874317 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980e32b9-1e0a-4d5a-95e5-01987dfb2462 None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:14:34.885869 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d2b0f1-6d48-497a-a1c7-0fe379683e3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:14:34.886718 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d2b0f1-6d48-497a-a1c7-0fe379683e3e admin admin] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:34.887091 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d2b0f1-6d48-497a-a1c7-0fe379683e3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:34.887460 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d2b0f1-6d48-497a-a1c7-0fe379683e3e admin admin] PATH_INFO: `/v3/projects` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:34.888817 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d2b0f1-6d48-497a-a1c7-0fe379683e3e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:14:34.890934 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d2b0f1-6d48-497a-a1c7-0fe379683e3e admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:14:34.944484 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1095/2173] 10.222.0.36 () {60 vars in 1152 bytes} [Tue May 3 14:14:34 2022] POST /identity/v3/projects => generated 385 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 14:14:34.948331 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52e2658-8a49-4415-9c63-018fa055f511 admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:14:34.975922 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52e2658-8a49-4415-9c63-018fa055f511 admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:14:35.037534 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d2b0f1-6d48-497a-a1c7-0fe379683e3e admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:14:35.039333 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-14d2b0f1-6d48-497a-a1c7-0fe379683e3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:14:35.140879 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b84fe9-bbbe-4320-914a-0181e0534de7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:14:35.141592 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b84fe9-bbbe-4320-914a-0181e0534de7 admin admin] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:35.141877 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b84fe9-bbbe-4320-914a-0181e0534de7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:35.142151 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b84fe9-bbbe-4320-914a-0181e0534de7 admin admin] PATH_INFO: `/v3/users` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:35.142859 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b84fe9-bbbe-4320-914a-0181e0534de7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:14:35.144826 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b84fe9-bbbe-4320-914a-0181e0534de7 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:14:35.208180 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1079/2174] 10.222.0.36 () {60 vars in 1143 bytes} [Tue May 3 14:14:34 2022] POST /identity/v3/users => generated 293 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 14:14:35.212256 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b84fe9-bbbe-4320-914a-0181e0534de7 admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:14:35.241168 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b84fe9-bbbe-4320-914a-0181e0534de7 admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:14:35.243301 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d2b0f1-6d48-497a-a1c7-0fe379683e3e admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:14:35.251944 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3727f80f-27de-43f3-89ce-9be3855e034c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:14:35.253629 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3727f80f-27de-43f3-89ce-9be3855e034c admin admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:35.257375 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3727f80f-27de-43f3-89ce-9be3855e034c admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:35.257966 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3727f80f-27de-43f3-89ce-9be3855e034c admin admin] PATH_INFO: `/v3/roles` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:35.258143 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb94c8d6-ea1e-4700-b784-03e825e33a59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:14:35.259046 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb94c8d6-ea1e-4700-b784-03e825e33a59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:35.259322 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb94c8d6-ea1e-4700-b784-03e825e33a59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:35.259589 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb94c8d6-ea1e-4700-b784-03e825e33a59 admin admin] PATH_INFO: `/v3/projects/4f473e1921bc4a2cb77e66e2d7461f9b` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:35.260315 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3727f80f-27de-43f3-89ce-9be3855e034c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:14:35.261562 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb94c8d6-ea1e-4700-b784-03e825e33a59 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f473e1921bc4a2cb77e66e2d7461f9b)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:14:35.263509 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb94c8d6-ea1e-4700-b784-03e825e33a59 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:14:35.264607 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3727f80f-27de-43f3-89ce-9be3855e034c admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:14:35.312315 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1080/2175] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 3 14:14:35 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 14:14:35.313599 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3727f80f-27de-43f3-89ce-9be3855e034c admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:14:35.343125 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3727f80f-27de-43f3-89ce-9be3855e034c admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:14:35.361443 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-cb94c8d6-ea1e-4700-b784-03e825e33a59 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f473e1921bc4a2cb77e66e2d7461f9b', 'request_id': 'req-cb94c8d6-ea1e-4700-b784-03e825e33a59'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:14:35.372291 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-cb94c8d6-ea1e-4700-b784-03e825e33a59 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f473e1921bc4a2cb77e66e2d7461f9b', 'request_id': 'req-cb94c8d6-ea1e-4700-b784-03e825e33a59'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:14:35.388453 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-cb94c8d6-ea1e-4700-b784-03e825e33a59 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f473e1921bc4a2cb77e66e2d7461f9b', 'request_id': 'req-cb94c8d6-ea1e-4700-b784-03e825e33a59'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:14:35.404443 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-cb94c8d6-ea1e-4700-b784-03e825e33a59 admin admin] The token cache is being invalidate because project 4f473e1921bc4a2cb77e66e2d7461f9b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80013) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 14:14:35.404731 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-cb94c8d6-ea1e-4700-b784-03e825e33a59 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:14:35.405995 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-cb94c8d6-ea1e-4700-b784-03e825e33a59 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:14:35.414052 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1096/2176] 10.222.0.36 () {58 vars in 1232 bytes} [Tue May 3 14:14:35 2022] DELETE /identity/v3/projects/4f473e1921bc4a2cb77e66e2d7461f9b => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:14:35.415324 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb94c8d6-ea1e-4700-b784-03e825e33a59 admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:14:35.420925 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-cb94c8d6-ea1e-4700-b784-03e825e33a59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:14:35.495107 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78e45fb-bf7d-47c5-b831-5186d47dcfb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:14:35.496001 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78e45fb-bf7d-47c5-b831-5186d47dcfb9 admin admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:35.496382 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78e45fb-bf7d-47c5-b831-5186d47dcfb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:35.496765 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78e45fb-bf7d-47c5-b831-5186d47dcfb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:35.497664 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78e45fb-bf7d-47c5-b831-5186d47dcfb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:14:35.499643 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78e45fb-bf7d-47c5-b831-5186d47dcfb9 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:14:35.530886 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1081/2177] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 3 14:14:35 2022] GET /identity/v3/roles => generated 1420 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 14:14:35.539197 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78e45fb-bf7d-47c5-b831-5186d47dcfb9 admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:14:35.542587 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-f78e45fb-bf7d-47c5-b831-5186d47dcfb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:14:35.593079 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78e45fb-bf7d-47c5-b831-5186d47dcfb9 admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:14:35.607210 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87748bbb-6e52-4d99-a148-8fb110b0bd91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:14:35.608130 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87748bbb-6e52-4d99-a148-8fb110b0bd91 admin admin] REQUEST_METHOD: `PUT` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:35.609610 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87748bbb-6e52-4d99-a148-8fb110b0bd91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:35.609898 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87748bbb-6e52-4d99-a148-8fb110b0bd91 admin admin] PATH_INFO: `/v3/projects/488949c83c2b44d096c3b722aed4768e/users/262f0d54cef1441f9caa56c679c91080/roles/441fdc11e95b47f4813f72610e39018b` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:35.645418 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb94c8d6-ea1e-4700-b784-03e825e33a59 admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:14:35.662405 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87748bbb-6e52-4d99-a148-8fb110b0bd91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=488949c83c2b44d096c3b722aed4768e, user_id=262f0d54cef1441f9caa56c679c91080, role_id=441fdc11e95b47f4813f72610e39018b)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:14:35.662854 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2631fa85-85c4-44f6-a884-91949ffda0b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:14:35.663821 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2631fa85-85c4-44f6-a884-91949ffda0b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:35.664102 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2631fa85-85c4-44f6-a884-91949ffda0b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:35.664375 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2631fa85-85c4-44f6-a884-91949ffda0b2 admin admin] PATH_INFO: `/v3/users/e320dd54d4d44cd4a3e683e2dda68c35` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:35.672628 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2631fa85-85c4-44f6-a884-91949ffda0b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e320dd54d4d44cd4a3e683e2dda68c35)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:14:35.680212 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2631fa85-85c4-44f6-a884-91949ffda0b2 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:14:35.681347 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87748bbb-6e52-4d99-a148-8fb110b0bd91 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:14:35.714658 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1082/2178] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 3 14:14:35 2022] PUT /identity/v3/projects/488949c83c2b44d096c3b722aed4768e/users/262f0d54cef1441f9caa56c679c91080/roles/441fdc11e95b47f4813f72610e39018b => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 14:14:35.716579 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0369f721-bc45-4707-8717-783f09cb6c0b None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:35.721513 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0369f721-bc45-4707-8717-783f09cb6c0b None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:35.725876 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0369f721-bc45-4707-8717-783f09cb6c0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:35.791832 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-2631fa85-85c4-44f6-a884-91949ffda0b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e320dd54d4d44cd4a3e683e2dda68c35'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:14:35.806415 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-0369f721-bc45-4707-8717-783f09cb6c0b None None] MFA Rules not processed for user `262f0d54cef1441f9caa56c679c91080`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:14:35.810612 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-0369f721-bc45-4707-8717-783f09cb6c0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:14:35.819453 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-2631fa85-85c4-44f6-a884-91949ffda0b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e320dd54d4d44cd4a3e683e2dda68c35'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:14:35.820958 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-2631fa85-85c4-44f6-a884-91949ffda0b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e320dd54d4d44cd4a3e683e2dda68c35'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:14:35.835149 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-2631fa85-85c4-44f6-a884-91949ffda0b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e320dd54d4d44cd4a3e683e2dda68c35'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:14:35.838366 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-2631fa85-85c4-44f6-a884-91949ffda0b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e320dd54d4d44cd4a3e683e2dda68c35'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:14:35.883890 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1097/2179] 10.222.0.36 () {58 vars in 1223 bytes} [Tue May 3 14:14:35 2022] DELETE /identity/v3/users/e320dd54d4d44cd4a3e683e2dda68c35 => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:14:35.997203 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1083/2180] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:14:35 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:14:36.006641 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2631fa85-85c4-44f6-a884-91949ffda0b2 admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:14:36.008193 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-2631fa85-85c4-44f6-a884-91949ffda0b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:14:36.185165 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2631fa85-85c4-44f6-a884-91949ffda0b2 admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:14:36.199893 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a627f2bc-d2c0-4a40-a24d-b95f9749a990 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b014f4c7ba1414cb8a597f5bc4033f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:14:36.200766 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a627f2bc-d2c0-4a40-a24d-b95f9749a990 service cinder] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:36.201554 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a627f2bc-d2c0-4a40-a24d-b95f9749a990 service cinder] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:36.202074 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a627f2bc-d2c0-4a40-a24d-b95f9749a990 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:36.411948 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a627f2bc-d2c0-4a40-a24d-b95f9749a990 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:14:36.420368 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a627f2bc-d2c0-4a40-a24d-b95f9749a990 service cinder] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:14:36.466450 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0369f721-bc45-4707-8717-783f09cb6c0b None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:14:36.469196 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-0369f721-bc45-4707-8717-783f09cb6c0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:14:36.475190 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1098/2181] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:14:36 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 14:14:36.545786 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a627f2bc-d2c0-4a40-a24d-b95f9749a990 service cinder] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:14:36.548071 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-a627f2bc-d2c0-4a40-a24d-b95f9749a990 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:14:36.684630 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0369f721-bc45-4707-8717-783f09cb6c0b None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:14:36.727752 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a627f2bc-d2c0-4a40-a24d-b95f9749a990 service cinder] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:14:36.737954 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1494067-a8ae-4dac-be73-2411a85a5094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:14:36.739744 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1494067-a8ae-4dac-be73-2411a85a5094 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:36.740033 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1494067-a8ae-4dac-be73-2411a85a5094 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:36.740310 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1494067-a8ae-4dac-be73-2411a85a5094 admin admin] PATH_INFO: `/v3/users/262f0d54cef1441f9caa56c679c91080` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:36.744848 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1494067-a8ae-4dac-be73-2411a85a5094 admin admin] RBAC: Authorizing `identity:delete_user(user_id=262f0d54cef1441f9caa56c679c91080)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:14:36.750577 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1494067-a8ae-4dac-be73-2411a85a5094 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:14:36.860485 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-b1494067-a8ae-4dac-be73-2411a85a5094 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '262f0d54cef1441f9caa56c679c91080'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:14:36.875670 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-b1494067-a8ae-4dac-be73-2411a85a5094 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '262f0d54cef1441f9caa56c679c91080'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:14:36.876455 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-b1494067-a8ae-4dac-be73-2411a85a5094 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '262f0d54cef1441f9caa56c679c91080'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:14:36.883358 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e933217-0005-42b7-b2ea-8148ea8ea51a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:14:36.886612 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e933217-0005-42b7-b2ea-8148ea8ea51a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:36.886922 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e933217-0005-42b7-b2ea-8148ea8ea51a admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:36.887222 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e933217-0005-42b7-b2ea-8148ea8ea51a admin admin] PATH_INFO: `/v3/projects/fa2592fcc5c243b38b8bcb6ed285f1d6` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:36.893073 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e933217-0005-42b7-b2ea-8148ea8ea51a admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa2592fcc5c243b38b8bcb6ed285f1d6)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:14:36.897616 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e933217-0005-42b7-b2ea-8148ea8ea51a admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:14:36.903743 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-b1494067-a8ae-4dac-be73-2411a85a5094 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '262f0d54cef1441f9caa56c679c91080'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:14:36.904874 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-b1494067-a8ae-4dac-be73-2411a85a5094 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '262f0d54cef1441f9caa56c679c91080'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:14:36.956762 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1099/2182] 10.222.0.36 () {58 vars in 1223 bytes} [Tue May 3 14:14:36 2022] DELETE /identity/v3/users/262f0d54cef1441f9caa56c679c91080 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:14:36.963026 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d37507-98b9-479c-92b7-75e65de3ecaf None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:36.963933 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d37507-98b9-479c-92b7-75e65de3ecaf None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:36.965262 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d37507-98b9-479c-92b7-75e65de3ecaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:37.011432 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-01d37507-98b9-479c-92b7-75e65de3ecaf None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:14:37.012723 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-01d37507-98b9-479c-92b7-75e65de3ecaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:14:37.042307 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-8e933217-0005-42b7-b2ea-8148ea8ea51a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa2592fcc5c243b38b8bcb6ed285f1d6', 'request_id': 'req-8e933217-0005-42b7-b2ea-8148ea8ea51a'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:14:37.054795 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-8e933217-0005-42b7-b2ea-8148ea8ea51a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa2592fcc5c243b38b8bcb6ed285f1d6', 'request_id': 'req-8e933217-0005-42b7-b2ea-8148ea8ea51a'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:14:37.087111 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-8e933217-0005-42b7-b2ea-8148ea8ea51a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa2592fcc5c243b38b8bcb6ed285f1d6', 'request_id': 'req-8e933217-0005-42b7-b2ea-8148ea8ea51a'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:14:37.118214 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-8e933217-0005-42b7-b2ea-8148ea8ea51a admin admin] The token cache is being invalidate because project fa2592fcc5c243b38b8bcb6ed285f1d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80012) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 14:14:37.118580 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-8e933217-0005-42b7-b2ea-8148ea8ea51a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:14:37.121441 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-8e933217-0005-42b7-b2ea-8148ea8ea51a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:14:37.127793 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1084/2183] 10.222.0.36 () {58 vars in 1232 bytes} [Tue May 3 14:14:36 2022] DELETE /identity/v3/projects/fa2592fcc5c243b38b8bcb6ed285f1d6 => generated 0 bytes in 659 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:14:37.129352 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e933217-0005-42b7-b2ea-8148ea8ea51a admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:14:37.131484 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-8e933217-0005-42b7-b2ea-8148ea8ea51a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:14:37.289542 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1100/2184] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:14:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:14:37.290887 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d37507-98b9-479c-92b7-75e65de3ecaf None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:14:37.297720 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-01d37507-98b9-479c-92b7-75e65de3ecaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:14:37.426194 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d37507-98b9-479c-92b7-75e65de3ecaf None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:14:37.429928 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4225d5-8965-411b-ba32-d61d1564bebb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '937bea4f355144b4a7ee11baabc3a4cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:14:37.430624 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4225d5-8965-411b-ba32-d61d1564bebb service neutron] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:37.432501 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4225d5-8965-411b-ba32-d61d1564bebb service neutron] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:37.432794 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4225d5-8965-411b-ba32-d61d1564bebb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:37.440791 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e933217-0005-42b7-b2ea-8148ea8ea51a admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:14:37.460088 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4225d5-8965-411b-ba32-d61d1564bebb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:14:37.480931 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d59b71-9d14-43b9-a865-7baf8c449fc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:14:37.481887 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d59b71-9d14-43b9-a865-7baf8c449fc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:37.482149 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d59b71-9d14-43b9-a865-7baf8c449fc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:37.482425 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d59b71-9d14-43b9-a865-7baf8c449fc5 admin admin] PATH_INFO: `/v3/users/a9e021e987df4294a4c2fb5d580dbd6b` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:37.483095 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4225d5-8965-411b-ba32-d61d1564bebb service neutron] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:14:37.484736 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d59b71-9d14-43b9-a865-7baf8c449fc5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9e021e987df4294a4c2fb5d580dbd6b)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:14:37.488649 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d59b71-9d14-43b9-a865-7baf8c449fc5 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:14:37.536450 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1101/2185] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:14:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 14:14:37.673839 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-13d59b71-9d14-43b9-a865-7baf8c449fc5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9e021e987df4294a4c2fb5d580dbd6b'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:14:37.695213 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-13d59b71-9d14-43b9-a865-7baf8c449fc5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9e021e987df4294a4c2fb5d580dbd6b'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:14:37.695999 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-13d59b71-9d14-43b9-a865-7baf8c449fc5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9e021e987df4294a4c2fb5d580dbd6b'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:14:37.725689 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-13d59b71-9d14-43b9-a865-7baf8c449fc5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9e021e987df4294a4c2fb5d580dbd6b'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:14:37.731254 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-13d59b71-9d14-43b9-a865-7baf8c449fc5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9e021e987df4294a4c2fb5d580dbd6b'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:14:37.753020 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1085/2186] 10.222.0.36 () {58 vars in 1223 bytes} [Tue May 3 14:14:37 2022] DELETE /identity/v3/users/a9e021e987df4294a4c2fb5d580dbd6b => generated 0 bytes in 624 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:14:38.122268 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4225d5-8965-411b-ba32-d61d1564bebb service neutron] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:14:38.123556 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-8f4225d5-8965-411b-ba32-d61d1564bebb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:14:38.192529 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4225d5-8965-411b-ba32-d61d1564bebb service neutron] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:14:38.342205 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb35528d-8a3e-4928-8676-a59b9806c6cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:14:38.343306 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb35528d-8a3e-4928-8676-a59b9806c6cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:38.344075 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb35528d-8a3e-4928-8676-a59b9806c6cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:38.345256 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb35528d-8a3e-4928-8676-a59b9806c6cb admin admin] PATH_INFO: `/v3/projects/488949c83c2b44d096c3b722aed4768e` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:38.346611 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb35528d-8a3e-4928-8676-a59b9806c6cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=488949c83c2b44d096c3b722aed4768e)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:14:38.349353 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb35528d-8a3e-4928-8676-a59b9806c6cb admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:14:38.430563 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-bb35528d-8a3e-4928-8676-a59b9806c6cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '488949c83c2b44d096c3b722aed4768e', 'request_id': 'req-bb35528d-8a3e-4928-8676-a59b9806c6cb'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:14:38.437016 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-bb35528d-8a3e-4928-8676-a59b9806c6cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '488949c83c2b44d096c3b722aed4768e', 'request_id': 'req-bb35528d-8a3e-4928-8676-a59b9806c6cb'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:14:38.465170 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-bb35528d-8a3e-4928-8676-a59b9806c6cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '488949c83c2b44d096c3b722aed4768e', 'request_id': 'req-bb35528d-8a3e-4928-8676-a59b9806c6cb'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:14:38.498226 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-bb35528d-8a3e-4928-8676-a59b9806c6cb admin admin] The token cache is being invalidate because project 488949c83c2b44d096c3b722aed4768e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80013) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 14:14:38.498715 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-bb35528d-8a3e-4928-8676-a59b9806c6cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:14:38.501359 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-bb35528d-8a3e-4928-8676-a59b9806c6cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:14:38.507787 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1102/2187] 10.222.0.36 () {58 vars in 1232 bytes} [Tue May 3 14:14:38 2022] DELETE /identity/v3/projects/488949c83c2b44d096c3b722aed4768e => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:14:38.514248 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b33d531-0d39-4ea2-9ad1-1536e4d22305 None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:38.521386 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b33d531-0d39-4ea2-9ad1-1536e4d22305 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:38.522766 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b33d531-0d39-4ea2-9ad1-1536e4d22305 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:38.578526 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-1b33d531-0d39-4ea2-9ad1-1536e4d22305 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:14:38.579834 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-1b33d531-0d39-4ea2-9ad1-1536e4d22305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:14:38.745652 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1086/2188] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:14:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:14:38.748807 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb35528d-8a3e-4928-8676-a59b9806c6cb admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:14:38.754093 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-bb35528d-8a3e-4928-8676-a59b9806c6cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:14:38.757037 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafaed71-3856-4e01-a0a5-c369cd5543dc None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:38.757037 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafaed71-3856-4e01-a0a5-c369cd5543dc None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:38.757037 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafaed71-3856-4e01-a0a5-c369cd5543dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:38.804288 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-eafaed71-3856-4e01-a0a5-c369cd5543dc None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:14:38.805163 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-eafaed71-3856-4e01-a0a5-c369cd5543dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:14:38.821343 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb35528d-8a3e-4928-8676-a59b9806c6cb admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:14:38.837142 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b0e877-22de-4793-9403-e3b2c8e60783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:14:38.838270 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b0e877-22de-4793-9403-e3b2c8e60783 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:38.838657 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b0e877-22de-4793-9403-e3b2c8e60783 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:38.839068 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b0e877-22de-4793-9403-e3b2c8e60783 admin admin] PATH_INFO: `/v3/projects/486f2b0a778447a2882143726e634ef4` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:38.840902 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b0e877-22de-4793-9403-e3b2c8e60783 admin admin] RBAC: Authorizing `identity:delete_project(project_id=486f2b0a778447a2882143726e634ef4)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:14:38.853738 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b0e877-22de-4793-9403-e3b2c8e60783 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:14:38.858428 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1087/2189] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:14:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:14:38.863952 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafaed71-3856-4e01-a0a5-c369cd5543dc None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:14:38.896690 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafaed71-3856-4e01-a0a5-c369cd5543dc None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:14:38.910555 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55522108-abe2-4faa-b927-d9e1bc905f45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:14:38.911242 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55522108-abe2-4faa-b927-d9e1bc905f45 admin admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:38.911522 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55522108-abe2-4faa-b927-d9e1bc905f45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:38.911798 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55522108-abe2-4faa-b927-d9e1bc905f45 admin admin] PATH_INFO: `/v3/domains` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:38.912795 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55522108-abe2-4faa-b927-d9e1bc905f45 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80012) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:14:38.913413 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55522108-abe2-4faa-b927-d9e1bc905f45 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:14:38.915215 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55522108-abe2-4faa-b927-d9e1bc905f45 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:14:38.943868 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1088/2190] 10.222.0.36 () {58 vars in 1152 bytes} [Tue May 3 14:14:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:14:38.950765 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55522108-abe2-4faa-b927-d9e1bc905f45 admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:14:38.982095 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-76b0e877-22de-4793-9403-e3b2c8e60783 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '486f2b0a778447a2882143726e634ef4', 'request_id': 'req-76b0e877-22de-4793-9403-e3b2c8e60783'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:14:38.989274 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-76b0e877-22de-4793-9403-e3b2c8e60783 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '486f2b0a778447a2882143726e634ef4', 'request_id': 'req-76b0e877-22de-4793-9403-e3b2c8e60783'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:14:38.999678 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-76b0e877-22de-4793-9403-e3b2c8e60783 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '486f2b0a778447a2882143726e634ef4', 'request_id': 'req-76b0e877-22de-4793-9403-e3b2c8e60783'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:14:39.002994 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55522108-abe2-4faa-b927-d9e1bc905f45 admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:14:39.015248 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-76b0e877-22de-4793-9403-e3b2c8e60783 admin admin] The token cache is being invalidate because project 486f2b0a778447a2882143726e634ef4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80013) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 14:14:39.015862 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-76b0e877-22de-4793-9403-e3b2c8e60783 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:14:39.016638 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-76b0e877-22de-4793-9403-e3b2c8e60783 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:14:39.022424 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1103/2191] 10.222.0.36 () {58 vars in 1232 bytes} [Tue May 3 14:14:38 2022] DELETE /identity/v3/projects/486f2b0a778447a2882143726e634ef4 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:14:39.024387 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3682195-fa53-4000-a120-1bf0f94b7b02 None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:39.024788 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3682195-fa53-4000-a120-1bf0f94b7b02 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:39.025176 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3682195-fa53-4000-a120-1bf0f94b7b02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:39.090881 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-b3682195-fa53-4000-a120-1bf0f94b7b02 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:14:39.095669 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-b3682195-fa53-4000-a120-1bf0f94b7b02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:14:39.286511 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12eaf140-3520-4273-a0f5-7d9663a197a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:14:39.288425 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eaf140-3520-4273-a0f5-7d9663a197a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:39.288965 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eaf140-3520-4273-a0f5-7d9663a197a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:39.290185 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eaf140-3520-4273-a0f5-7d9663a197a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:39.291395 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12eaf140-3520-4273-a0f5-7d9663a197a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:14:39.294965 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12eaf140-3520-4273-a0f5-7d9663a197a8 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:14:39.322345 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1104/2192] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:14:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:14:39.343103 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1514a3-149d-4eb8-a57f-b2883918f350 None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:39.343773 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1514a3-149d-4eb8-a57f-b2883918f350 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:39.344316 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1514a3-149d-4eb8-a57f-b2883918f350 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:39.390172 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-bc1514a3-149d-4eb8-a57f-b2883918f350 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:14:39.392561 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-bc1514a3-149d-4eb8-a57f-b2883918f350 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:14:39.417523 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1089/2193] 10.222.0.36 () {60 vars in 1152 bytes} [Tue May 3 14:14:38 2022] POST /identity/v3/projects => generated 367 bytes in 462 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 14:14:39.431561 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12eaf140-3520-4273-a0f5-7d9663a197a8 admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:14:39.441528 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1105/2194] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:14:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 14:14:39.442114 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-12eaf140-3520-4273-a0f5-7d9663a197a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:14:39.463597 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1514a3-149d-4eb8-a57f-b2883918f350 None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:14:39.501799 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1514a3-149d-4eb8-a57f-b2883918f350 None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:14:39.640014 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfced9cc-9122-43be-aeed-7578c8f7a141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:14:39.640797 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfced9cc-9122-43be-aeed-7578c8f7a141 admin admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:39.643206 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfced9cc-9122-43be-aeed-7578c8f7a141 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:39.643496 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfced9cc-9122-43be-aeed-7578c8f7a141 admin admin] PATH_INFO: `/v3/domains` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:39.645387 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfced9cc-9122-43be-aeed-7578c8f7a141 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:14:39.645387 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfced9cc-9122-43be-aeed-7578c8f7a141 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:14:39.646251 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfced9cc-9122-43be-aeed-7578c8f7a141 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:14:39.675863 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1106/2195] 10.222.0.36 () {58 vars in 1152 bytes} [Tue May 3 14:14:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:14:39.677127 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20fed8e-ec61-4653-bc09-b531d6035116 None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:39.677440 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20fed8e-ec61-4653-bc09-b531d6035116 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:39.677739 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20fed8e-ec61-4653-bc09-b531d6035116 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:39.689460 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12eaf140-3520-4273-a0f5-7d9663a197a8 admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:14:39.703286 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9859b3a0-666d-4424-84e6-5816c4b50087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:14:39.705127 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9859b3a0-666d-4424-84e6-5816c4b50087 admin admin] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:39.705873 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9859b3a0-666d-4424-84e6-5816c4b50087 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:39.706439 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9859b3a0-666d-4424-84e6-5816c4b50087 admin admin] PATH_INFO: `/v3/users` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:39.707426 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9859b3a0-666d-4424-84e6-5816c4b50087 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:14:39.709968 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9859b3a0-666d-4424-84e6-5816c4b50087 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:14:39.729934 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-e20fed8e-ec61-4653-bc09-b531d6035116 None None] MFA Rules not processed for user `7b05c6d36153485c9859ce7b749ab40c`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:14:39.731294 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-e20fed8e-ec61-4653-bc09-b531d6035116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:14:39.745693 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1090/2196] 10.222.0.36 () {60 vars in 1143 bytes} [Tue May 3 14:14:39 2022] POST /identity/v3/users => generated 284 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 14:14:39.747714 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9859b3a0-666d-4424-84e6-5816c4b50087 admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:14:39.769357 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9859b3a0-666d-4424-84e6-5816c4b50087 admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:14:39.778818 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2ba5af-dba8-4299-a78b-83b21117655e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:14:39.784297 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2ba5af-dba8-4299-a78b-83b21117655e admin admin] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:39.786328 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2ba5af-dba8-4299-a78b-83b21117655e admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:39.786950 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2ba5af-dba8-4299-a78b-83b21117655e admin admin] PATH_INFO: `/v3/projects` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:39.790025 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2ba5af-dba8-4299-a78b-83b21117655e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:14:39.794424 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2ba5af-dba8-4299-a78b-83b21117655e admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:14:39.821009 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1107/2197] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:14:39 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:14:39.821979 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20fed8e-ec61-4653-bc09-b531d6035116 None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:14:39.846353 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20fed8e-ec61-4653-bc09-b531d6035116 None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:14:39.849528 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1091/2198] 10.222.0.36 () {60 vars in 1152 bytes} [Tue May 3 14:14:39 2022] POST /identity/v3/projects => generated 373 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 14:14:39.850590 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2ba5af-dba8-4299-a78b-83b21117655e admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:14:39.854584 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-3c2ba5af-dba8-4299-a78b-83b21117655e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:14:39.855784 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762f2457-398a-45ff-ada5-27d73b08d58d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:14:39.856476 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762f2457-398a-45ff-ada5-27d73b08d58d admin admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:39.856803 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762f2457-398a-45ff-ada5-27d73b08d58d admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:39.857102 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762f2457-398a-45ff-ada5-27d73b08d58d admin admin] PATH_INFO: `/v3/roles` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:39.858037 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762f2457-398a-45ff-ada5-27d73b08d58d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:14:39.860069 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762f2457-398a-45ff-ada5-27d73b08d58d admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:14:39.872248 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1108/2199] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 3 14:14:39 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 14:14:39.876698 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762f2457-398a-45ff-ada5-27d73b08d58d admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:14:39.895503 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762f2457-398a-45ff-ada5-27d73b08d58d admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:14:39.932626 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2ba5af-dba8-4299-a78b-83b21117655e admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:14:39.940197 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84a0f6a-dd24-4735-ab66-1b1f8fff3b51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:14:39.941218 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84a0f6a-dd24-4735-ab66-1b1f8fff3b51 admin admin] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:39.941726 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84a0f6a-dd24-4735-ab66-1b1f8fff3b51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:39.942180 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84a0f6a-dd24-4735-ab66-1b1f8fff3b51 admin admin] PATH_INFO: `/v3/projects` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:39.943055 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84a0f6a-dd24-4735-ab66-1b1f8fff3b51 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:14:39.945354 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84a0f6a-dd24-4735-ab66-1b1f8fff3b51 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:14:39.975374 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ee07e0-6d04-42ce-9afc-179638af6425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:14:39.976203 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ee07e0-6d04-42ce-9afc-179638af6425 admin admin] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:39.976616 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ee07e0-6d04-42ce-9afc-179638af6425 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:39.976927 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ee07e0-6d04-42ce-9afc-179638af6425 admin admin] PATH_INFO: `/v3/users` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:39.977727 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ee07e0-6d04-42ce-9afc-179638af6425 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:14:39.979907 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ee07e0-6d04-42ce-9afc-179638af6425 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:14:39.985506 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1092/2200] 10.222.0.36 () {60 vars in 1152 bytes} [Tue May 3 14:14:39 2022] POST /identity/v3/projects => generated 379 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 14:14:39.985506 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84a0f6a-dd24-4735-ab66-1b1f8fff3b51 admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:14:40.013858 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1109/2201] 10.222.0.36 () {60 vars in 1143 bytes} [Tue May 3 14:14:39 2022] POST /identity/v3/users => generated 287 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 14:14:40.017130 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ee07e0-6d04-42ce-9afc-179638af6425 admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:14:40.029481 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ee07e0-6d04-42ce-9afc-179638af6425 admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:14:40.074728 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84a0f6a-dd24-4735-ab66-1b1f8fff3b51 admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:14:40.083041 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed2bc3c-5f2c-448b-96da-ab998a0d3b42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:14:40.084883 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed2bc3c-5f2c-448b-96da-ab998a0d3b42 admin admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:40.085425 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed2bc3c-5f2c-448b-96da-ab998a0d3b42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:40.086207 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed2bc3c-5f2c-448b-96da-ab998a0d3b42 admin admin] PATH_INFO: `/v3/roles` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:40.087149 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed2bc3c-5f2c-448b-96da-ab998a0d3b42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:14:40.089324 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed2bc3c-5f2c-448b-96da-ab998a0d3b42 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:14:40.102379 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1093/2202] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 3 14:14:39 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 14:14:40.103684 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed2bc3c-5f2c-448b-96da-ab998a0d3b42 admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:14:40.117198 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed2bc3c-5f2c-448b-96da-ab998a0d3b42 admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:14:40.122200 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e1599b-3d12-47b2-93ca-a5ea131be8b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:14:40.122814 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21982c4-aa55-4912-ba44-704a30fefe79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:14:40.123161 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e1599b-3d12-47b2-93ca-a5ea131be8b9 admin admin] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:40.123511 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e1599b-3d12-47b2-93ca-a5ea131be8b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:40.123653 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21982c4-aa55-4912-ba44-704a30fefe79 admin admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:40.123808 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e1599b-3d12-47b2-93ca-a5ea131be8b9 admin admin] PATH_INFO: `/v3/users` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:40.123961 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21982c4-aa55-4912-ba44-704a30fefe79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:40.124267 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21982c4-aa55-4912-ba44-704a30fefe79 admin admin] PATH_INFO: `/v3/roles` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:40.128694 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21982c4-aa55-4912-ba44-704a30fefe79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:14:40.128929 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e1599b-3d12-47b2-93ca-a5ea131be8b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:14:40.129012 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21982c4-aa55-4912-ba44-704a30fefe79 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:14:40.129085 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e1599b-3d12-47b2-93ca-a5ea131be8b9 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:14:40.144722 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1094/2203] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 3 14:14:40 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 14:14:40.146222 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21982c4-aa55-4912-ba44-704a30fefe79 admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:14:40.174627 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1110/2204] 10.222.0.36 () {60 vars in 1143 bytes} [Tue May 3 14:14:40 2022] POST /identity/v3/users => generated 296 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 14:14:40.175938 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e1599b-3d12-47b2-93ca-a5ea131be8b9 admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:14:40.188775 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21982c4-aa55-4912-ba44-704a30fefe79 admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:14:40.190686 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e1599b-3d12-47b2-93ca-a5ea131be8b9 admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:14:40.198821 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b6a62d-6aa4-4b01-814b-6406fc4c3f08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:14:40.199387 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b6a62d-6aa4-4b01-814b-6406fc4c3f08 admin admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:40.199674 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b6a62d-6aa4-4b01-814b-6406fc4c3f08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:40.199966 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b6a62d-6aa4-4b01-814b-6406fc4c3f08 admin admin] PATH_INFO: `/v3/roles` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:40.200297 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35e01c1-3903-422b-98ba-c3d510df81a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:14:40.200703 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b6a62d-6aa4-4b01-814b-6406fc4c3f08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:14:40.201223 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35e01c1-3903-422b-98ba-c3d510df81a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:40.201498 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35e01c1-3903-422b-98ba-c3d510df81a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:40.201774 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35e01c1-3903-422b-98ba-c3d510df81a7 admin admin] PATH_INFO: `/v3/projects/e78794eca21f426a9d844fe232498bd2/users/5f9c180eeef2480b959ed42e8bd36c1e/roles/441fdc11e95b47f4813f72610e39018b` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:40.202462 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b6a62d-6aa4-4b01-814b-6406fc4c3f08 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:14:40.231349 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1111/2205] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 3 14:14:40 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 14:14:40.232343 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b6a62d-6aa4-4b01-814b-6406fc4c3f08 admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:14:40.251529 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b6a62d-6aa4-4b01-814b-6406fc4c3f08 admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:14:40.257253 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b924bce-8cbc-4d8a-a0d5-381863008832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:14:40.257974 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b924bce-8cbc-4d8a-a0d5-381863008832 admin admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:40.258257 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b924bce-8cbc-4d8a-a0d5-381863008832 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:40.258539 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b924bce-8cbc-4d8a-a0d5-381863008832 admin admin] PATH_INFO: `/v3/roles` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:40.259386 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b924bce-8cbc-4d8a-a0d5-381863008832 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:14:40.260920 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35e01c1-3903-422b-98ba-c3d510df81a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e78794eca21f426a9d844fe232498bd2, user_id=5f9c180eeef2480b959ed42e8bd36c1e, role_id=441fdc11e95b47f4813f72610e39018b)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:14:40.261049 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b924bce-8cbc-4d8a-a0d5-381863008832 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:14:40.266321 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35e01c1-3903-422b-98ba-c3d510df81a7 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:14:40.301154 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1112/2206] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 3 14:14:40 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 14:14:40.302535 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b924bce-8cbc-4d8a-a0d5-381863008832 admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:14:40.314891 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b924bce-8cbc-4d8a-a0d5-381863008832 admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:14:40.326063 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1095/2207] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 3 14:14:40 2022] PUT /identity/v3/projects/e78794eca21f426a9d844fe232498bd2/users/5f9c180eeef2480b959ed42e8bd36c1e/roles/441fdc11e95b47f4813f72610e39018b => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:14:40.326063 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35e01c1-3903-422b-98ba-c3d510df81a7 admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:14:40.464579 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35e01c1-3903-422b-98ba-c3d510df81a7 admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:14:40.481217 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40b34a1-536e-4711-8ff5-dd7ab75460e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:14:40.482196 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40b34a1-536e-4711-8ff5-dd7ab75460e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:40.482471 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40b34a1-536e-4711-8ff5-dd7ab75460e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:40.483148 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40b34a1-536e-4711-8ff5-dd7ab75460e7 admin admin] PATH_INFO: `/v3/projects/d0b764ea593b465881fef7937cf6ac86/users/2c31897e0bc3457f8ef1586524540e30/roles/36abe9b50fd8479c86c4f8f70fd85aa3` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:40.515811 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40b34a1-536e-4711-8ff5-dd7ab75460e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0b764ea593b465881fef7937cf6ac86, user_id=2c31897e0bc3457f8ef1586524540e30, role_id=36abe9b50fd8479c86c4f8f70fd85aa3)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:14:40.521108 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40b34a1-536e-4711-8ff5-dd7ab75460e7 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:14:40.536442 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e2c481-2590-41d7-91a7-13b9a854b2ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:14:40.537730 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e2c481-2590-41d7-91a7-13b9a854b2ca admin admin] REQUEST_METHOD: `PUT` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:40.538007 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e2c481-2590-41d7-91a7-13b9a854b2ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:40.538289 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e2c481-2590-41d7-91a7-13b9a854b2ca admin admin] PATH_INFO: `/v3/projects/fe12e93e2173443ebbc6badc62f75f20/users/96b3f31586984846b2ac5d33701242b9/roles/441fdc11e95b47f4813f72610e39018b` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:40.560445 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1096/2208] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 3 14:14:40 2022] PUT /identity/v3/projects/d0b764ea593b465881fef7937cf6ac86/users/2c31897e0bc3457f8ef1586524540e30/roles/36abe9b50fd8479c86c4f8f70fd85aa3 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:14:40.562678 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2347bd27-0ea1-4dee-887a-5d54def92292 None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:40.563121 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2347bd27-0ea1-4dee-887a-5d54def92292 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:40.565178 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2347bd27-0ea1-4dee-887a-5d54def92292 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:40.574025 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e2c481-2590-41d7-91a7-13b9a854b2ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe12e93e2173443ebbc6badc62f75f20, user_id=96b3f31586984846b2ac5d33701242b9, role_id=441fdc11e95b47f4813f72610e39018b)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:14:40.579107 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e2c481-2590-41d7-91a7-13b9a854b2ca admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:14:40.608849 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1113/2209] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 3 14:14:40 2022] PUT /identity/v3/projects/fe12e93e2173443ebbc6badc62f75f20/users/96b3f31586984846b2ac5d33701242b9/roles/441fdc11e95b47f4813f72610e39018b => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:14:40.613172 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e2c481-2590-41d7-91a7-13b9a854b2ca admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:14:40.615081 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-e8e2c481-2590-41d7-91a7-13b9a854b2ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:14:40.624950 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-2347bd27-0ea1-4dee-887a-5d54def92292 None None] MFA Rules not processed for user `5f9c180eeef2480b959ed42e8bd36c1e`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:14:40.626689 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-2347bd27-0ea1-4dee-887a-5d54def92292 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:14:40.746976 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1097/2210] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:14:40 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:14:40.748438 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2347bd27-0ea1-4dee-887a-5d54def92292 None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:14:40.780391 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e2c481-2590-41d7-91a7-13b9a854b2ca admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:14:40.790041 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9082c60e-cbb9-4adb-b33e-b5aab84179dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:14:40.792083 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9082c60e-cbb9-4adb-b33e-b5aab84179dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:40.792478 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9082c60e-cbb9-4adb-b33e-b5aab84179dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:40.792866 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9082c60e-cbb9-4adb-b33e-b5aab84179dc admin admin] PATH_INFO: `/v3/users/f19a5630cfc645559e6c87f4bc9ac91d` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:40.794460 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9082c60e-cbb9-4adb-b33e-b5aab84179dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=f19a5630cfc645559e6c87f4bc9ac91d)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:14:40.796780 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9082c60e-cbb9-4adb-b33e-b5aab84179dc admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:14:40.859350 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2347bd27-0ea1-4dee-887a-5d54def92292 None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:14:40.865965 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fc0924-ebcc-4429-b086-0437ece72382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:14:40.867057 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fc0924-ebcc-4429-b086-0437ece72382 admin admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:40.867524 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fc0924-ebcc-4429-b086-0437ece72382 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:40.867959 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fc0924-ebcc-4429-b086-0437ece72382 admin admin] PATH_INFO: `/v3/roles` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:40.868854 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fc0924-ebcc-4429-b086-0437ece72382 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:14:40.870821 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fc0924-ebcc-4429-b086-0437ece72382 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:14:40.884434 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1098/2211] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 3 14:14:40 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 14:14:40.886104 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41530145-e9fa-428d-af1a-1da8deec5c77 None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:40.886565 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41530145-e9fa-428d-af1a-1da8deec5c77 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:40.886997 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41530145-e9fa-428d-af1a-1da8deec5c77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:40.891008 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-9082c60e-cbb9-4adb-b33e-b5aab84179dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f19a5630cfc645559e6c87f4bc9ac91d'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:14:40.908221 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-41530145-e9fa-428d-af1a-1da8deec5c77 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:14:40.911922 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-41530145-e9fa-428d-af1a-1da8deec5c77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:14:40.912420 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-9082c60e-cbb9-4adb-b33e-b5aab84179dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f19a5630cfc645559e6c87f4bc9ac91d'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:14:40.913784 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-9082c60e-cbb9-4adb-b33e-b5aab84179dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f19a5630cfc645559e6c87f4bc9ac91d'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:14:40.920498 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1099/2212] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:14:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:14:40.921481 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41530145-e9fa-428d-af1a-1da8deec5c77 None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:14:40.924971 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-41530145-e9fa-428d-af1a-1da8deec5c77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:14:40.946504 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-9082c60e-cbb9-4adb-b33e-b5aab84179dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f19a5630cfc645559e6c87f4bc9ac91d'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:14:40.947346 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-9082c60e-cbb9-4adb-b33e-b5aab84179dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f19a5630cfc645559e6c87f4bc9ac91d'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:14:40.975088 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1114/2213] 10.222.0.36 () {58 vars in 1223 bytes} [Tue May 3 14:14:40 2022] DELETE /identity/v3/users/f19a5630cfc645559e6c87f4bc9ac91d => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:14:40.975729 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9082c60e-cbb9-4adb-b33e-b5aab84179dc admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:14:40.977167 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-9082c60e-cbb9-4adb-b33e-b5aab84179dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:14:41.069247 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9082c60e-cbb9-4adb-b33e-b5aab84179dc admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:14:41.076790 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f543c9-b702-4aa7-ade7-18ce525da681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:14:41.078450 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f543c9-b702-4aa7-ade7-18ce525da681 admin admin] REQUEST_METHOD: `PUT` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:41.078450 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f543c9-b702-4aa7-ade7-18ce525da681 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:41.078450 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f543c9-b702-4aa7-ade7-18ce525da681 admin admin] PATH_INFO: `/v3/projects/d0b764ea593b465881fef7937cf6ac86/users/2c31897e0bc3457f8ef1586524540e30/roles/36abe9b50fd8479c86c4f8f70fd85aa3` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:41.080516 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f543c9-b702-4aa7-ade7-18ce525da681 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0b764ea593b465881fef7937cf6ac86, user_id=2c31897e0bc3457f8ef1586524540e30, role_id=36abe9b50fd8479c86c4f8f70fd85aa3)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:14:41.084237 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f543c9-b702-4aa7-ade7-18ce525da681 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:14:41.096668 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1115/2214] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 3 14:14:40 2022] PUT /identity/v3/projects/d0b764ea593b465881fef7937cf6ac86/users/2c31897e0bc3457f8ef1586524540e30/roles/36abe9b50fd8479c86c4f8f70fd85aa3 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:14:41.097949 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f543c9-b702-4aa7-ade7-18ce525da681 admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:14:41.100317 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-76f543c9-b702-4aa7-ade7-18ce525da681 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:14:41.113178 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41530145-e9fa-428d-af1a-1da8deec5c77 None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:14:41.205269 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f543c9-b702-4aa7-ade7-18ce525da681 admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:14:41.219336 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a27f69-889e-4a21-8edf-678c358cbb75 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '937bea4f355144b4a7ee11baabc3a4cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:14:41.221009 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a27f69-889e-4a21-8edf-678c358cbb75 service neutron] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:41.221411 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a27f69-889e-4a21-8edf-678c358cbb75 service neutron] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:41.222043 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a27f69-889e-4a21-8edf-678c358cbb75 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:41.228064 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4138cd39-ea8b-4451-afdc-3b7692af6b4a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '616de5e7daed46849efc75ad77ea054e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:14:41.229175 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4138cd39-ea8b-4451-afdc-3b7692af6b4a service glance] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:41.229633 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4138cd39-ea8b-4451-afdc-3b7692af6b4a service glance] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:41.230056 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4138cd39-ea8b-4451-afdc-3b7692af6b4a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:41.237096 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-4138cd39-ea8b-4451-afdc-3b7692af6b4a service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:14:41.348797 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a27f69-889e-4a21-8edf-678c358cbb75 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:14:41.351405 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a27f69-889e-4a21-8edf-678c358cbb75 service neutron] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:14:41.371737 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4138cd39-ea8b-4451-afdc-3b7692af6b4a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:14:41.373441 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4138cd39-ea8b-4451-afdc-3b7692af6b4a service glance] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:14:41.376720 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1116/2215] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:14:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 14:14:41.380292 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1c2911-d329-4766-891e-f420cdd391b6 None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:41.380852 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1c2911-d329-4766-891e-f420cdd391b6 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:41.381223 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1c2911-d329-4766-891e-f420cdd391b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:41.395199 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1100/2216] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:14:40 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 474 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 14:14:41.405069 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-fa1c2911-d329-4766-891e-f420cdd391b6 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:14:41.409035 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-fa1c2911-d329-4766-891e-f420cdd391b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:14:41.431308 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1117/2217] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:14:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:14:41.447088 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4138cd39-ea8b-4451-afdc-3b7692af6b4a service glance] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:14:41.468643 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4138cd39-ea8b-4451-afdc-3b7692af6b4a service glance] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:14:41.491424 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396c1c63-3839-4798-877f-9130ddb51a65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '937bea4f355144b4a7ee11baabc3a4cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:14:41.492097 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396c1c63-3839-4798-877f-9130ddb51a65 service neutron] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:41.492410 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396c1c63-3839-4798-877f-9130ddb51a65 service neutron] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:41.492691 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396c1c63-3839-4798-877f-9130ddb51a65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:41.544642 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396c1c63-3839-4798-877f-9130ddb51a65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:14:41.546159 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396c1c63-3839-4798-877f-9130ddb51a65 service neutron] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:14:41.583575 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1101/2218] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:14:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 14:14:43.242467 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1c2911-d329-4766-891e-f420cdd391b6 None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:14:43.246038 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-fa1c2911-d329-4766-891e-f420cdd391b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:14:43.266564 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1c2911-d329-4766-891e-f420cdd391b6 None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:14:43.272678 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af09f65f-b9ae-4de4-aca9-1cd8b4fa2b50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:14:43.273858 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af09f65f-b9ae-4de4-aca9-1cd8b4fa2b50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:43.274318 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af09f65f-b9ae-4de4-aca9-1cd8b4fa2b50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:43.274789 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af09f65f-b9ae-4de4-aca9-1cd8b4fa2b50 admin admin] PATH_INFO: `/v3/projects/e666804deea54d8ea4f3b2b7bcf263cd` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:43.277688 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af09f65f-b9ae-4de4-aca9-1cd8b4fa2b50 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e666804deea54d8ea4f3b2b7bcf263cd)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:14:43.280497 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af09f65f-b9ae-4de4-aca9-1cd8b4fa2b50 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:14:43.381866 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-af09f65f-b9ae-4de4-aca9-1cd8b4fa2b50 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e666804deea54d8ea4f3b2b7bcf263cd', 'request_id': 'req-af09f65f-b9ae-4de4-aca9-1cd8b4fa2b50'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:14:43.394203 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-af09f65f-b9ae-4de4-aca9-1cd8b4fa2b50 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e666804deea54d8ea4f3b2b7bcf263cd', 'request_id': 'req-af09f65f-b9ae-4de4-aca9-1cd8b4fa2b50'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:14:43.436187 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-af09f65f-b9ae-4de4-aca9-1cd8b4fa2b50 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e666804deea54d8ea4f3b2b7bcf263cd', 'request_id': 'req-af09f65f-b9ae-4de4-aca9-1cd8b4fa2b50'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:14:43.475737 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-af09f65f-b9ae-4de4-aca9-1cd8b4fa2b50 admin admin] The token cache is being invalidate because project e666804deea54d8ea4f3b2b7bcf263cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80013) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 14:14:43.477453 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-af09f65f-b9ae-4de4-aca9-1cd8b4fa2b50 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:14:43.480903 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-af09f65f-b9ae-4de4-aca9-1cd8b4fa2b50 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:14:43.493225 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a11e380-ec4d-45a5-a7ab-9c5b10a92520 None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:43.493914 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a11e380-ec4d-45a5-a7ab-9c5b10a92520 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:43.493914 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a11e380-ec4d-45a5-a7ab-9c5b10a92520 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:43.505515 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1118/2219] 10.222.0.36 () {58 vars in 1232 bytes} [Tue May 3 14:14:43 2022] DELETE /identity/v3/projects/e666804deea54d8ea4f3b2b7bcf263cd => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:14:43.520790 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-3a11e380-ec4d-45a5-a7ab-9c5b10a92520 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:14:43.523805 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-3a11e380-ec4d-45a5-a7ab-9c5b10a92520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:14:43.615439 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1102/2220] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:14:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:14:43.625192 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fed67b0-e2cc-4ed5-bc41-3d30220e1280 None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:43.625853 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fed67b0-e2cc-4ed5-bc41-3d30220e1280 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:43.626851 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fed67b0-e2cc-4ed5-bc41-3d30220e1280 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:43.653337 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-0fed67b0-e2cc-4ed5-bc41-3d30220e1280 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:14:43.655471 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-0fed67b0-e2cc-4ed5-bc41-3d30220e1280 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:14:43.700947 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a11e380-ec4d-45a5-a7ab-9c5b10a92520 None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:14:43.703235 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1119/2221] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:14:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:14:43.715805 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a11e380-ec4d-45a5-a7ab-9c5b10a92520 None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:14:43.727808 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3abc594-561f-4019-a014-93840f58a867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:14:43.729111 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3abc594-561f-4019-a014-93840f58a867 admin admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:43.735391 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3abc594-561f-4019-a014-93840f58a867 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:43.735956 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3abc594-561f-4019-a014-93840f58a867 admin admin] PATH_INFO: `/v3/domains` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:43.736937 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3abc594-561f-4019-a014-93840f58a867 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80012) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:14:43.737793 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3abc594-561f-4019-a014-93840f58a867 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:14:43.741512 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3abc594-561f-4019-a014-93840f58a867 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:14:43.771800 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1103/2222] 10.222.0.36 () {58 vars in 1152 bytes} [Tue May 3 14:14:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 14:14:43.776374 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fed67b0-e2cc-4ed5-bc41-3d30220e1280 None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:14:43.792744 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fed67b0-e2cc-4ed5-bc41-3d30220e1280 None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:14:43.802728 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ea02a1-e1d5-4b73-961c-c89fdc240dab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:14:43.803968 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ea02a1-e1d5-4b73-961c-c89fdc240dab admin admin] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:43.804487 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ea02a1-e1d5-4b73-961c-c89fdc240dab admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:43.804991 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ea02a1-e1d5-4b73-961c-c89fdc240dab admin admin] PATH_INFO: `/v3/projects` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:43.806079 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ea02a1-e1d5-4b73-961c-c89fdc240dab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:14:43.808337 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ea02a1-e1d5-4b73-961c-c89fdc240dab admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:14:43.822616 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aff7c0-32d5-433f-a2cf-4f3ceff82f9b None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:43.823247 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aff7c0-32d5-433f-a2cf-4f3ceff82f9b None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:43.823736 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aff7c0-32d5-433f-a2cf-4f3ceff82f9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:43.874304 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1120/2223] 10.222.0.36 () {60 vars in 1152 bytes} [Tue May 3 14:14:43 2022] POST /identity/v3/projects => generated 373 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 14:14:43.878461 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ea02a1-e1d5-4b73-961c-c89fdc240dab admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:14:43.885580 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-c7aff7c0-32d5-433f-a2cf-4f3ceff82f9b None None] MFA Rules not processed for user `96b3f31586984846b2ac5d33701242b9`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:14:43.888560 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-c7aff7c0-32d5-433f-a2cf-4f3ceff82f9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:14:44.157088 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1104/2224] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:14:43 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 335 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 14:14:44.169565 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7aff7c0-32d5-433f-a2cf-4f3ceff82f9b None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:14:44.171246 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-c7aff7c0-32d5-433f-a2cf-4f3ceff82f9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:14:44.271848 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ea02a1-e1d5-4b73-961c-c89fdc240dab admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:14:44.296884 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a445df68-a897-4cf6-98c9-0d8a851d2846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:14:44.297764 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a445df68-a897-4cf6-98c9-0d8a851d2846 admin admin] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:44.298320 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a445df68-a897-4cf6-98c9-0d8a851d2846 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:44.299482 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a445df68-a897-4cf6-98c9-0d8a851d2846 admin admin] PATH_INFO: `/v3/users` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:44.301481 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a445df68-a897-4cf6-98c9-0d8a851d2846 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:14:44.323018 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a445df68-a897-4cf6-98c9-0d8a851d2846 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:14:44.373359 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7aff7c0-32d5-433f-a2cf-4f3ceff82f9b None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:14:44.384856 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d745ddf-977f-45db-9b80-3c14fa2e53f4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b014f4c7ba1414cb8a597f5bc4033f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:14:44.385620 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d745ddf-977f-45db-9b80-3c14fa2e53f4 service cinder] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:44.385932 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d745ddf-977f-45db-9b80-3c14fa2e53f4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:44.386249 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d745ddf-977f-45db-9b80-3c14fa2e53f4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:44.391193 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1121/2225] 10.222.0.36 () {60 vars in 1143 bytes} [Tue May 3 14:14:43 2022] POST /identity/v3/users => generated 287 bytes in 513 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 14:14:44.398390 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a445df68-a897-4cf6-98c9-0d8a851d2846 admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:14:44.413902 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d745ddf-977f-45db-9b80-3c14fa2e53f4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:14:44.415469 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d745ddf-977f-45db-9b80-3c14fa2e53f4 service cinder] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:14:44.427696 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a445df68-a897-4cf6-98c9-0d8a851d2846 admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:14:44.438215 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1105/2226] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:14:44 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 03 14:14:44.440739 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9185de91-08ea-4fa6-be19-b0700039c773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:14:44.442051 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9185de91-08ea-4fa6-be19-b0700039c773 admin admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:44.442521 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9185de91-08ea-4fa6-be19-b0700039c773 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:44.442947 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9185de91-08ea-4fa6-be19-b0700039c773 admin admin] PATH_INFO: `/v3/roles` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:44.444337 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9185de91-08ea-4fa6-be19-b0700039c773 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:14:44.455962 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9185de91-08ea-4fa6-be19-b0700039c773 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:14:44.472649 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1122/2227] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 3 14:14:44 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 14:14:44.477080 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d745ddf-977f-45db-9b80-3c14fa2e53f4 service cinder] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:14:44.505762 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d745ddf-977f-45db-9b80-3c14fa2e53f4 service cinder] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:14:44.517647 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51163f5-824f-42e4-af7a-87b92a13ce8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:14:44.519060 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51163f5-824f-42e4-af7a-87b92a13ce8a admin admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:44.519569 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51163f5-824f-42e4-af7a-87b92a13ce8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:44.520301 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51163f5-824f-42e4-af7a-87b92a13ce8a admin admin] PATH_INFO: `/v3/roles` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:44.521333 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51163f5-824f-42e4-af7a-87b92a13ce8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:14:44.524017 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51163f5-824f-42e4-af7a-87b92a13ce8a admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:14:44.539464 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1106/2228] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 3 14:14:44 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 14:14:44.545215 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9185de91-08ea-4fa6-be19-b0700039c773 admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:14:44.592058 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9185de91-08ea-4fa6-be19-b0700039c773 admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:14:44.609142 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d239157-5ab9-4069-ae26-2e51eaef62c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:14:44.612105 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d239157-5ab9-4069-ae26-2e51eaef62c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:44.612849 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d239157-5ab9-4069-ae26-2e51eaef62c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:44.612849 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d239157-5ab9-4069-ae26-2e51eaef62c7 admin admin] PATH_INFO: `/v3/projects/54dd6bd702df48ccad568ae297ced6a1/users/37408d2936664b53828a657628fe9277/roles/441fdc11e95b47f4813f72610e39018b` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:44.638317 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d239157-5ab9-4069-ae26-2e51eaef62c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54dd6bd702df48ccad568ae297ced6a1, user_id=37408d2936664b53828a657628fe9277, role_id=441fdc11e95b47f4813f72610e39018b)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:14:44.642989 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d239157-5ab9-4069-ae26-2e51eaef62c7 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:14:44.677511 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1123/2229] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 3 14:14:44 2022] PUT /identity/v3/projects/54dd6bd702df48ccad568ae297ced6a1/users/37408d2936664b53828a657628fe9277/roles/441fdc11e95b47f4813f72610e39018b => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:14:44.686973 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835afa57-3657-4ff0-ad8f-7e0443b9dcda None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:44.687134 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835afa57-3657-4ff0-ad8f-7e0443b9dcda None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:44.687445 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835afa57-3657-4ff0-ad8f-7e0443b9dcda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:44.748060 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-835afa57-3657-4ff0-ad8f-7e0443b9dcda None None] MFA Rules not processed for user `37408d2936664b53828a657628fe9277`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:14:44.750810 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-835afa57-3657-4ff0-ad8f-7e0443b9dcda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:14:44.957179 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1107/2230] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:14:44 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:14:44.972722 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d239157-5ab9-4069-ae26-2e51eaef62c7 admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:14:44.975623 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-5d239157-5ab9-4069-ae26-2e51eaef62c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:14:45.223933 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d239157-5ab9-4069-ae26-2e51eaef62c7 admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:14:45.236853 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe097af-c65f-4ea0-8a2e-27fb4f1a2ec0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63489e658c094a2598a2ac62159d2fda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:14:45.237629 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe097af-c65f-4ea0-8a2e-27fb4f1a2ec0 service nova] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:45.238055 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe097af-c65f-4ea0-8a2e-27fb4f1a2ec0 service nova] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:45.238367 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe097af-c65f-4ea0-8a2e-27fb4f1a2ec0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:45.306625 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe097af-c65f-4ea0-8a2e-27fb4f1a2ec0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:14:45.314170 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe097af-c65f-4ea0-8a2e-27fb4f1a2ec0 service nova] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:14:45.350687 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1124/2231] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:14:44 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 14:14:46.116821 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11a95f3-926c-423c-b4ed-92ce758b2605 None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:46.117391 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11a95f3-926c-423c-b4ed-92ce758b2605 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:46.117509 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11a95f3-926c-423c-b4ed-92ce758b2605 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:46.148641 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-d11a95f3-926c-423c-b4ed-92ce758b2605 None None] MFA Rules not processed for user `96b3f31586984846b2ac5d33701242b9`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:14:46.150314 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-d11a95f3-926c-423c-b4ed-92ce758b2605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:14:46.229800 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1108/2232] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:14:46 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:14:48.931647 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe097af-c65f-4ea0-8a2e-27fb4f1a2ec0 service nova] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:14:49.263696 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe097af-c65f-4ea0-8a2e-27fb4f1a2ec0 service nova] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:14:49.285463 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c24385-d7d7-4443-a726-6574d6ad806b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:14:49.299634 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c24385-d7d7-4443-a726-6574d6ad806b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:49.300026 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c24385-d7d7-4443-a726-6574d6ad806b admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:49.300423 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c24385-d7d7-4443-a726-6574d6ad806b admin admin] PATH_INFO: `/v3/users/37408d2936664b53828a657628fe9277` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:49.306832 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c24385-d7d7-4443-a726-6574d6ad806b admin admin] RBAC: Authorizing `identity:delete_user(user_id=37408d2936664b53828a657628fe9277)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:14:49.310758 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c24385-d7d7-4443-a726-6574d6ad806b admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:14:49.432750 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-70c24385-d7d7-4443-a726-6574d6ad806b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37408d2936664b53828a657628fe9277'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:14:49.485665 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-70c24385-d7d7-4443-a726-6574d6ad806b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37408d2936664b53828a657628fe9277'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:14:49.489241 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-70c24385-d7d7-4443-a726-6574d6ad806b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37408d2936664b53828a657628fe9277'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:14:49.518669 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-70c24385-d7d7-4443-a726-6574d6ad806b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37408d2936664b53828a657628fe9277'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:14:49.519368 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-70c24385-d7d7-4443-a726-6574d6ad806b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37408d2936664b53828a657628fe9277'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:14:49.573108 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1125/2233] 10.222.0.36 () {58 vars in 1223 bytes} [Tue May 3 14:14:48 2022] DELETE /identity/v3/users/37408d2936664b53828a657628fe9277 => generated 0 bytes in 642 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:14:49.577763 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b51c06e-f90c-40a0-83f8-a5bfaa0e2db0 None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:49.578735 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b51c06e-f90c-40a0-83f8-a5bfaa0e2db0 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:49.579272 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b51c06e-f90c-40a0-83f8-a5bfaa0e2db0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:49.617728 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-8b51c06e-f90c-40a0-83f8-a5bfaa0e2db0 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:14:49.619436 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-8b51c06e-f90c-40a0-83f8-a5bfaa0e2db0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:14:49.783729 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1109/2234] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:14:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:14:49.794733 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c24385-d7d7-4443-a726-6574d6ad806b admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:14:49.797924 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-70c24385-d7d7-4443-a726-6574d6ad806b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:14:49.910540 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c24385-d7d7-4443-a726-6574d6ad806b admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:14:49.916254 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f572040-0a96-4202-912c-bc29ef6a3640 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '937bea4f355144b4a7ee11baabc3a4cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:14:49.917454 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f572040-0a96-4202-912c-bc29ef6a3640 service neutron] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:49.917923 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f572040-0a96-4202-912c-bc29ef6a3640 service neutron] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:49.918392 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f572040-0a96-4202-912c-bc29ef6a3640 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:49.934676 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f572040-0a96-4202-912c-bc29ef6a3640 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:14:49.937039 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f572040-0a96-4202-912c-bc29ef6a3640 service neutron] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:14:49.950647 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1126/2235] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:14:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 14:14:50.074266 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1615fb7-b3db-4322-90f2-ef8c088d0bc5 None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:50.074654 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1615fb7-b3db-4322-90f2-ef8c088d0bc5 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:50.074997 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1615fb7-b3db-4322-90f2-ef8c088d0bc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:50.142640 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-b1615fb7-b3db-4322-90f2-ef8c088d0bc5 None None] MFA Rules not processed for user `2c31897e0bc3457f8ef1586524540e30`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:14:50.144030 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-b1615fb7-b3db-4322-90f2-ef8c088d0bc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:14:50.376618 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1110/2236] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:14:50 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:14:50.387466 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f572040-0a96-4202-912c-bc29ef6a3640 service neutron] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:14:50.388903 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-5f572040-0a96-4202-912c-bc29ef6a3640 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:14:50.607064 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f572040-0a96-4202-912c-bc29ef6a3640 service neutron] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:14:50.628228 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1ab62e-1da1-441c-a8b0-8394981e79ba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63489e658c094a2598a2ac62159d2fda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:14:50.630337 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1ab62e-1da1-441c-a8b0-8394981e79ba service nova] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:50.630627 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1ab62e-1da1-441c-a8b0-8394981e79ba service nova] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:50.630903 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1ab62e-1da1-441c-a8b0-8394981e79ba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:50.650333 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-2c1ab62e-1da1-441c-a8b0-8394981e79ba service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:14:50.756860 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1615fb7-b3db-4322-90f2-ef8c088d0bc5 None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:14:50.759676 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-b1615fb7-b3db-4322-90f2-ef8c088d0bc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:14:50.798840 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1ab62e-1da1-441c-a8b0-8394981e79ba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:14:50.800508 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1ab62e-1da1-441c-a8b0-8394981e79ba service nova] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:14:50.802184 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1615fb7-b3db-4322-90f2-ef8c088d0bc5 None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:14:50.815446 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1127/2237] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:14:50 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 14:14:50.821266 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ad6e57-7f0b-4a26-8690-5f9e8924e169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:14:50.822873 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ad6e57-7f0b-4a26-8690-5f9e8924e169 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:50.825486 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ad6e57-7f0b-4a26-8690-5f9e8924e169 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:50.825862 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ad6e57-7f0b-4a26-8690-5f9e8924e169 admin admin] PATH_INFO: `/v3/projects/54dd6bd702df48ccad568ae297ced6a1` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:50.827500 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ad6e57-7f0b-4a26-8690-5f9e8924e169 admin admin] RBAC: Authorizing `identity:delete_project(project_id=54dd6bd702df48ccad568ae297ced6a1)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:14:50.833109 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ad6e57-7f0b-4a26-8690-5f9e8924e169 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:14:50.936709 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-89ad6e57-7f0b-4a26-8690-5f9e8924e169 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54dd6bd702df48ccad568ae297ced6a1', 'request_id': 'req-89ad6e57-7f0b-4a26-8690-5f9e8924e169'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:14:50.957609 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-89ad6e57-7f0b-4a26-8690-5f9e8924e169 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54dd6bd702df48ccad568ae297ced6a1', 'request_id': 'req-89ad6e57-7f0b-4a26-8690-5f9e8924e169'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:14:50.966612 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-89ad6e57-7f0b-4a26-8690-5f9e8924e169 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54dd6bd702df48ccad568ae297ced6a1', 'request_id': 'req-89ad6e57-7f0b-4a26-8690-5f9e8924e169'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:14:50.993041 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-89ad6e57-7f0b-4a26-8690-5f9e8924e169 admin admin] The token cache is being invalidate because project 54dd6bd702df48ccad568ae297ced6a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80012) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 14:14:50.993973 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-89ad6e57-7f0b-4a26-8690-5f9e8924e169 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:14:50.995377 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-89ad6e57-7f0b-4a26-8690-5f9e8924e169 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:14:51.000687 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1111/2238] 10.222.0.36 () {58 vars in 1232 bytes} [Tue May 3 14:14:50 2022] DELETE /identity/v3/projects/54dd6bd702df48ccad568ae297ced6a1 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:14:51.012145 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57b3066-57da-4cf8-8b20-2675b11d9be2 None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:51.012678 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57b3066-57da-4cf8-8b20-2675b11d9be2 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:51.012678 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57b3066-57da-4cf8-8b20-2675b11d9be2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:51.071616 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-c57b3066-57da-4cf8-8b20-2675b11d9be2 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:14:51.076546 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-c57b3066-57da-4cf8-8b20-2675b11d9be2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:14:51.285650 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1128/2239] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:14:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:14:51.288670 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c6468e-71eb-4bc7-b014-2e34c3b496d5 None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:51.288959 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c6468e-71eb-4bc7-b014-2e34c3b496d5 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:51.289312 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c6468e-71eb-4bc7-b014-2e34c3b496d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:51.328640 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-c4c6468e-71eb-4bc7-b014-2e34c3b496d5 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:14:51.329987 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-c4c6468e-71eb-4bc7-b014-2e34c3b496d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:14:51.398217 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1112/2240] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:14:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:14:51.401535 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57b3066-57da-4cf8-8b20-2675b11d9be2 None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:14:51.417801 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57b3066-57da-4cf8-8b20-2675b11d9be2 None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:14:51.430022 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ee66d1-c362-4a58-b524-05ba21e5c983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:14:51.430765 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ee66d1-c362-4a58-b524-05ba21e5c983 admin admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:51.431733 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ee66d1-c362-4a58-b524-05ba21e5c983 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:51.432024 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ee66d1-c362-4a58-b524-05ba21e5c983 admin admin] PATH_INFO: `/v3/domains` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:51.432772 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ee66d1-c362-4a58-b524-05ba21e5c983 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:14:51.433074 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ee66d1-c362-4a58-b524-05ba21e5c983 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:14:51.434804 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ee66d1-c362-4a58-b524-05ba21e5c983 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:14:51.466797 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c6468e-71eb-4bc7-b014-2e34c3b496d5 None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:14:51.467103 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1129/2241] 10.222.0.36 () {58 vars in 1152 bytes} [Tue May 3 14:14:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:14:51.482256 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c6468e-71eb-4bc7-b014-2e34c3b496d5 None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:14:51.487268 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6726c5f4-d71d-476b-9712-71e83502f64b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:14:51.487937 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6726c5f4-d71d-476b-9712-71e83502f64b admin admin] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:51.488211 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6726c5f4-d71d-476b-9712-71e83502f64b admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:51.488480 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6726c5f4-d71d-476b-9712-71e83502f64b admin admin] PATH_INFO: `/v3/projects` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:51.489186 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6726c5f4-d71d-476b-9712-71e83502f64b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:14:51.491277 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6726c5f4-d71d-476b-9712-71e83502f64b admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:14:51.525339 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1113/2242] 10.222.0.36 () {60 vars in 1152 bytes} [Tue May 3 14:14:51 2022] POST /identity/v3/projects => generated 385 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 14:14:51.529398 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ee66d1-c362-4a58-b524-05ba21e5c983 admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:14:51.546905 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ee66d1-c362-4a58-b524-05ba21e5c983 admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:14:51.744228 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08eaccc-2bf9-4053-8aed-1fdf942fd205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:14:51.745309 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08eaccc-2bf9-4053-8aed-1fdf942fd205 admin admin] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:51.746740 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08eaccc-2bf9-4053-8aed-1fdf942fd205 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:51.747176 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08eaccc-2bf9-4053-8aed-1fdf942fd205 admin admin] PATH_INFO: `/v3/users` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:51.753072 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08eaccc-2bf9-4053-8aed-1fdf942fd205 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:14:51.757875 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08eaccc-2bf9-4053-8aed-1fdf942fd205 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:14:51.801030 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6726c5f4-d71d-476b-9712-71e83502f64b admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:14:51.801640 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1130/2243] 10.222.0.36 () {60 vars in 1143 bytes} [Tue May 3 14:14:51 2022] POST /identity/v3/users => generated 293 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 14:14:51.837638 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6726c5f4-d71d-476b-9712-71e83502f64b admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:14:51.845174 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5985cc-f484-40ce-9129-a5c853278b08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:14:51.846080 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5985cc-f484-40ce-9129-a5c853278b08 admin admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:51.846604 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5985cc-f484-40ce-9129-a5c853278b08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:51.847129 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5985cc-f484-40ce-9129-a5c853278b08 admin admin] PATH_INFO: `/v3/roles` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:51.848242 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5985cc-f484-40ce-9129-a5c853278b08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:14:51.849995 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5985cc-f484-40ce-9129-a5c853278b08 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:14:51.864997 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1114/2244] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 3 14:14:51 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 14:14:51.869967 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08eaccc-2bf9-4053-8aed-1fdf942fd205 admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:14:51.896122 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08eaccc-2bf9-4053-8aed-1fdf942fd205 admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:14:51.904517 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd5f4a2-0067-4e80-9c56-5d9dd43b6593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:14:51.906058 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd5f4a2-0067-4e80-9c56-5d9dd43b6593 admin admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:51.906465 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd5f4a2-0067-4e80-9c56-5d9dd43b6593 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:51.906830 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd5f4a2-0067-4e80-9c56-5d9dd43b6593 admin admin] PATH_INFO: `/v3/roles` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:51.907943 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd5f4a2-0067-4e80-9c56-5d9dd43b6593 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:14:51.909848 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd5f4a2-0067-4e80-9c56-5d9dd43b6593 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:14:51.934696 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1131/2245] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 3 14:14:51 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 14:14:51.936009 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5985cc-f484-40ce-9129-a5c853278b08 admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:14:51.949787 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5985cc-f484-40ce-9129-a5c853278b08 admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:14:51.955949 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fc8d46-64c5-4aa6-911c-cb6dbc3b2908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:14:51.956944 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fc8d46-64c5-4aa6-911c-cb6dbc3b2908 admin admin] REQUEST_METHOD: `PUT` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:51.957398 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fc8d46-64c5-4aa6-911c-cb6dbc3b2908 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:51.957866 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fc8d46-64c5-4aa6-911c-cb6dbc3b2908 admin admin] PATH_INFO: `/v3/projects/2c544a972d7d43db98594a0093d85f95/users/c1a6578921f34df3b4059f7fca3d4a88/roles/441fdc11e95b47f4813f72610e39018b` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:51.980743 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fc8d46-64c5-4aa6-911c-cb6dbc3b2908 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c544a972d7d43db98594a0093d85f95, user_id=c1a6578921f34df3b4059f7fca3d4a88, role_id=441fdc11e95b47f4813f72610e39018b)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:14:51.984719 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fc8d46-64c5-4aa6-911c-cb6dbc3b2908 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:14:52.006483 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1115/2246] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 3 14:14:51 2022] PUT /identity/v3/projects/2c544a972d7d43db98594a0093d85f95/users/c1a6578921f34df3b4059f7fca3d4a88/roles/441fdc11e95b47f4813f72610e39018b => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:14:52.063018 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a9f921-730e-4688-9597-882c2fd89f5d None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:52.063907 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a9f921-730e-4688-9597-882c2fd89f5d None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:52.064339 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a9f921-730e-4688-9597-882c2fd89f5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:52.099060 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-e8a9f921-730e-4688-9597-882c2fd89f5d None None] MFA Rules not processed for user `c1a6578921f34df3b4059f7fca3d4a88`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:14:52.100607 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-e8a9f921-730e-4688-9597-882c2fd89f5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:14:52.185176 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1132/2247] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:14:52 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:14:52.188197 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fc8d46-64c5-4aa6-911c-cb6dbc3b2908 admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:14:52.299413 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fc8d46-64c5-4aa6-911c-cb6dbc3b2908 admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:14:52.306864 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b703d3b-8bfe-4077-8ed2-a71ea7e62106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:14:52.307863 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b703d3b-8bfe-4077-8ed2-a71ea7e62106 admin admin] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:52.309218 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b703d3b-8bfe-4077-8ed2-a71ea7e62106 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:52.309758 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b703d3b-8bfe-4077-8ed2-a71ea7e62106 admin admin] PATH_INFO: `/v3/projects` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:52.311484 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b703d3b-8bfe-4077-8ed2-a71ea7e62106 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:14:52.314356 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b703d3b-8bfe-4077-8ed2-a71ea7e62106 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:14:52.363003 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1116/2248] 10.222.0.36 () {60 vars in 1152 bytes} [Tue May 3 14:14:52 2022] POST /identity/v3/projects => generated 387 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 14:14:52.366745 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a9f921-730e-4688-9597-882c2fd89f5d None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:14:52.383776 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a9f921-730e-4688-9597-882c2fd89f5d None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:14:52.467922 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723247b2-73a2-40a6-a2e7-ab320baf61fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:14:52.468815 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723247b2-73a2-40a6-a2e7-ab320baf61fc admin admin] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:52.469096 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723247b2-73a2-40a6-a2e7-ab320baf61fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:52.469485 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723247b2-73a2-40a6-a2e7-ab320baf61fc admin admin] PATH_INFO: `/v3/users` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:52.470288 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723247b2-73a2-40a6-a2e7-ab320baf61fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:14:52.475691 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723247b2-73a2-40a6-a2e7-ab320baf61fc admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:14:52.511866 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1133/2249] 10.222.0.36 () {60 vars in 1143 bytes} [Tue May 3 14:14:52 2022] POST /identity/v3/users => generated 294 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 14:14:52.515872 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b703d3b-8bfe-4077-8ed2-a71ea7e62106 admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:14:52.532704 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b703d3b-8bfe-4077-8ed2-a71ea7e62106 admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:14:52.543755 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b6d96f-15a1-4ebc-95d9-29acdd7a32ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:14:52.544687 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b6d96f-15a1-4ebc-95d9-29acdd7a32ae admin admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:52.544687 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b6d96f-15a1-4ebc-95d9-29acdd7a32ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:52.544984 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b6d96f-15a1-4ebc-95d9-29acdd7a32ae admin admin] PATH_INFO: `/v3/roles` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:52.545845 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b6d96f-15a1-4ebc-95d9-29acdd7a32ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:14:52.550061 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b6d96f-15a1-4ebc-95d9-29acdd7a32ae admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:14:52.575970 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723247b2-73a2-40a6-a2e7-ab320baf61fc admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:14:52.576242 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1117/2250] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 3 14:14:52 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 14:14:52.607052 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723247b2-73a2-40a6-a2e7-ab320baf61fc admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:14:52.614773 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48fef19-962d-4430-be20-1a4d508b05d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:14:52.616209 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48fef19-962d-4430-be20-1a4d508b05d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:52.617104 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48fef19-962d-4430-be20-1a4d508b05d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:52.617744 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48fef19-962d-4430-be20-1a4d508b05d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:52.619531 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48fef19-962d-4430-be20-1a4d508b05d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:14:52.630388 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48fef19-962d-4430-be20-1a4d508b05d8 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:14:52.666391 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1134/2251] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 3 14:14:52 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 14:14:52.670920 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b6d96f-15a1-4ebc-95d9-29acdd7a32ae admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:14:52.687209 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b6d96f-15a1-4ebc-95d9-29acdd7a32ae admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:14:52.699059 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55f45b2-2b32-4789-b2be-07a0a073e31d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:14:52.700095 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55f45b2-2b32-4789-b2be-07a0a073e31d admin admin] REQUEST_METHOD: `PUT` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:52.700645 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55f45b2-2b32-4789-b2be-07a0a073e31d admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:52.701087 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55f45b2-2b32-4789-b2be-07a0a073e31d admin admin] PATH_INFO: `/v3/projects/22907aae7bb44db1a2dae7e4d64977ee/users/5d5d27de9b2245e99f7aacc3d13f54db/roles/441fdc11e95b47f4813f72610e39018b` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:52.776065 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55f45b2-2b32-4789-b2be-07a0a073e31d admin admin] RBAC: Authorizing `identity:create_grant(project_id=22907aae7bb44db1a2dae7e4d64977ee, user_id=5d5d27de9b2245e99f7aacc3d13f54db, role_id=441fdc11e95b47f4813f72610e39018b)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:14:52.779133 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55f45b2-2b32-4789-b2be-07a0a073e31d admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:14:52.803647 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1118/2252] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 3 14:14:52 2022] PUT /identity/v3/projects/22907aae7bb44db1a2dae7e4d64977ee/users/5d5d27de9b2245e99f7aacc3d13f54db/roles/441fdc11e95b47f4813f72610e39018b => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:14:52.814369 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31195c3-4fb7-4394-9e76-c6b350f6ce0a None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:52.814591 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31195c3-4fb7-4394-9e76-c6b350f6ce0a None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:52.814904 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31195c3-4fb7-4394-9e76-c6b350f6ce0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:52.914396 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-e31195c3-4fb7-4394-9e76-c6b350f6ce0a None None] MFA Rules not processed for user `5d5d27de9b2245e99f7aacc3d13f54db`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:14:52.916617 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-e31195c3-4fb7-4394-9e76-c6b350f6ce0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:14:53.056671 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1135/2253] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:14:52 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 14:14:53.062230 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55f45b2-2b32-4789-b2be-07a0a073e31d admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:14:53.182094 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55f45b2-2b32-4789-b2be-07a0a073e31d admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:14:53.197105 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2b7c7c-dd8e-4510-804d-ed65a528853a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:14:53.198635 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2b7c7c-dd8e-4510-804d-ed65a528853a admin admin] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:53.199705 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2b7c7c-dd8e-4510-804d-ed65a528853a admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:53.200154 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2b7c7c-dd8e-4510-804d-ed65a528853a admin admin] PATH_INFO: `/v3/projects` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:53.201025 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2b7c7c-dd8e-4510-804d-ed65a528853a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:14:53.213053 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2b7c7c-dd8e-4510-804d-ed65a528853a admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:14:53.271071 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1119/2254] 10.222.0.36 () {60 vars in 1152 bytes} [Tue May 3 14:14:53 2022] POST /identity/v3/projects => generated 385 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 14:14:53.276684 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31195c3-4fb7-4394-9e76-c6b350f6ce0a None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:14:53.336870 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31195c3-4fb7-4394-9e76-c6b350f6ce0a None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:14:53.544487 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aeb588c-3057-47ac-809e-72ddc35032d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:14:53.546642 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeb588c-3057-47ac-809e-72ddc35032d5 admin admin] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:53.547245 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeb588c-3057-47ac-809e-72ddc35032d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:53.547824 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeb588c-3057-47ac-809e-72ddc35032d5 admin admin] PATH_INFO: `/v3/users` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:53.549161 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aeb588c-3057-47ac-809e-72ddc35032d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:14:53.553065 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aeb588c-3057-47ac-809e-72ddc35032d5 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:14:53.570943 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19753249-9dd4-43dd-a698-91740c1651fd None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:53.571968 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19753249-9dd4-43dd-a698-91740c1651fd None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:53.573215 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19753249-9dd4-43dd-a698-91740c1651fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:53.593749 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1136/2255] 10.222.0.36 () {60 vars in 1143 bytes} [Tue May 3 14:14:53 2022] POST /identity/v3/users => generated 299 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 14:14:53.594860 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aeb588c-3057-47ac-809e-72ddc35032d5 admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:14:53.597825 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-19753249-9dd4-43dd-a698-91740c1651fd None None] MFA Rules not processed for user `39f0797cbeb448769677f54f936b915d`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:14:53.599845 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-19753249-9dd4-43dd-a698-91740c1651fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:14:53.611145 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aeb588c-3057-47ac-809e-72ddc35032d5 admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:14:53.620513 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176a8f6c-5b93-4ed7-a1eb-7ed2918f951c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:14:53.621200 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176a8f6c-5b93-4ed7-a1eb-7ed2918f951c admin admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:53.621504 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176a8f6c-5b93-4ed7-a1eb-7ed2918f951c admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:53.621778 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176a8f6c-5b93-4ed7-a1eb-7ed2918f951c admin admin] PATH_INFO: `/v3/roles` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:53.622519 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176a8f6c-5b93-4ed7-a1eb-7ed2918f951c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:14:53.630814 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176a8f6c-5b93-4ed7-a1eb-7ed2918f951c admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:14:53.654858 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1137/2256] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 3 14:14:53 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 14:14:53.660261 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176a8f6c-5b93-4ed7-a1eb-7ed2918f951c admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:14:53.678157 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176a8f6c-5b93-4ed7-a1eb-7ed2918f951c admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:14:53.694931 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1120/2257] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:14:53 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:14:53.700932 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb7d1a1-ad27-4f3d-bc5b-ac5fd0dc185c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:14:53.702102 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb7d1a1-ad27-4f3d-bc5b-ac5fd0dc185c admin admin] REQUEST_METHOD: `PUT` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:53.702412 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb7d1a1-ad27-4f3d-bc5b-ac5fd0dc185c admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:53.702689 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb7d1a1-ad27-4f3d-bc5b-ac5fd0dc185c admin admin] PATH_INFO: `/v3/projects/02878168c50843c988fc1f2ae0820de3/users/6f2db2d332ef46d284dc1c117d2235bc/roles/36abe9b50fd8479c86c4f8f70fd85aa3` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:53.728109 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb7d1a1-ad27-4f3d-bc5b-ac5fd0dc185c admin admin] RBAC: Authorizing `identity:create_grant(project_id=02878168c50843c988fc1f2ae0820de3, user_id=6f2db2d332ef46d284dc1c117d2235bc, role_id=36abe9b50fd8479c86c4f8f70fd85aa3)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:14:53.731325 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb7d1a1-ad27-4f3d-bc5b-ac5fd0dc185c admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:14:53.766528 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1138/2258] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 3 14:14:53 2022] PUT /identity/v3/projects/02878168c50843c988fc1f2ae0820de3/users/6f2db2d332ef46d284dc1c117d2235bc/roles/36abe9b50fd8479c86c4f8f70fd85aa3 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:14:53.768513 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19753249-9dd4-43dd-a698-91740c1651fd None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:14:53.786822 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19753249-9dd4-43dd-a698-91740c1651fd None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:14:53.926485 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b54a4e9-0a4b-42b2-ba04-8a58804bf725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:14:53.927188 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b54a4e9-0a4b-42b2-ba04-8a58804bf725 admin admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:53.927438 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b54a4e9-0a4b-42b2-ba04-8a58804bf725 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:53.927715 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b54a4e9-0a4b-42b2-ba04-8a58804bf725 admin admin] PATH_INFO: `/v3/roles` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:53.928499 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b54a4e9-0a4b-42b2-ba04-8a58804bf725 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:14:53.933448 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b54a4e9-0a4b-42b2-ba04-8a58804bf725 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:14:53.958033 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1121/2259] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 3 14:14:53 2022] GET /identity/v3/roles => generated 1420 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 14:14:53.962941 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb7d1a1-ad27-4f3d-bc5b-ac5fd0dc185c admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:14:53.983113 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb7d1a1-ad27-4f3d-bc5b-ac5fd0dc185c admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:14:53.992530 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f029e7d-3aaf-4b57-b7e9-cefad98b1f13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:14:53.993482 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f029e7d-3aaf-4b57-b7e9-cefad98b1f13 admin admin] REQUEST_METHOD: `PUT` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:53.993788 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f029e7d-3aaf-4b57-b7e9-cefad98b1f13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:53.994048 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f029e7d-3aaf-4b57-b7e9-cefad98b1f13 admin admin] PATH_INFO: `/v3/projects/02878168c50843c988fc1f2ae0820de3/users/6f2db2d332ef46d284dc1c117d2235bc/roles/36abe9b50fd8479c86c4f8f70fd85aa3` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:54.002704 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f029e7d-3aaf-4b57-b7e9-cefad98b1f13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=02878168c50843c988fc1f2ae0820de3, user_id=6f2db2d332ef46d284dc1c117d2235bc, role_id=36abe9b50fd8479c86c4f8f70fd85aa3)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:14:54.010095 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f029e7d-3aaf-4b57-b7e9-cefad98b1f13 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:14:54.036728 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1139/2260] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 3 14:14:53 2022] PUT /identity/v3/projects/02878168c50843c988fc1f2ae0820de3/users/6f2db2d332ef46d284dc1c117d2235bc/roles/36abe9b50fd8479c86c4f8f70fd85aa3 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:14:54.049582 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be196c2-3697-43e9-a812-52985bccbbcd None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:54.049872 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be196c2-3697-43e9-a812-52985bccbbcd None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:54.050150 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be196c2-3697-43e9-a812-52985bccbbcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:54.108846 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-5be196c2-3697-43e9-a812-52985bccbbcd None None] MFA Rules not processed for user `6f2db2d332ef46d284dc1c117d2235bc`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:14:54.110644 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-5be196c2-3697-43e9-a812-52985bccbbcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:14:54.237104 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1122/2261] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:14:54 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:14:54.247451 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f029e7d-3aaf-4b57-b7e9-cefad98b1f13 admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:14:54.251726 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-3f029e7d-3aaf-4b57-b7e9-cefad98b1f13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:14:54.383267 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f029e7d-3aaf-4b57-b7e9-cefad98b1f13 admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:14:54.389561 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052dc8cc-8555-403d-9414-cd3ad0026b7b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b014f4c7ba1414cb8a597f5bc4033f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:14:54.390893 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052dc8cc-8555-403d-9414-cd3ad0026b7b service cinder] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:54.391455 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052dc8cc-8555-403d-9414-cd3ad0026b7b service cinder] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:54.391937 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052dc8cc-8555-403d-9414-cd3ad0026b7b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:54.403283 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052dc8cc-8555-403d-9414-cd3ad0026b7b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:14:54.411485 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052dc8cc-8555-403d-9414-cd3ad0026b7b service cinder] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:14:54.435749 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1140/2262] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:14:54 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 14:14:55.488547 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be196c2-3697-43e9-a812-52985bccbbcd None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:14:55.532040 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be196c2-3697-43e9-a812-52985bccbbcd None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:14:55.549728 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56eee995-f0e3-494c-b445-cf9a7e07b1c0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b014f4c7ba1414cb8a597f5bc4033f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:14:55.550476 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eee995-f0e3-494c-b445-cf9a7e07b1c0 service cinder] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:55.550887 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eee995-f0e3-494c-b445-cf9a7e07b1c0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:55.551269 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eee995-f0e3-494c-b445-cf9a7e07b1c0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:55.684704 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56eee995-f0e3-494c-b445-cf9a7e07b1c0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:14:55.691146 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56eee995-f0e3-494c-b445-cf9a7e07b1c0 service cinder] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:14:55.703247 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1123/2263] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:14:55 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 14:14:57.776891 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a882c49a-dc70-4196-989b-50714ca240a1 None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:57.777582 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a882c49a-dc70-4196-989b-50714ca240a1 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:57.777582 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a882c49a-dc70-4196-989b-50714ca240a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:57.802614 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-a882c49a-dc70-4196-989b-50714ca240a1 None None] MFA Rules not processed for user `dec39ff0b6544a738e5aae06e9a8cb38`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:14:57.803926 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-a882c49a-dc70-4196-989b-50714ca240a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:14:57.865945 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1141/2264] 10.222.0.36 () {58 vars in 1009 bytes} [Tue May 3 14:14:57 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 14:14:57.885057 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56eee995-f0e3-494c-b445-cf9a7e07b1c0 service cinder] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:14:57.886715 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-56eee995-f0e3-494c-b445-cf9a7e07b1c0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:14:57.968053 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56eee995-f0e3-494c-b445-cf9a7e07b1c0 service cinder] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:14:57.973586 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06c1265-88da-4eeb-b4fb-bed421489e42 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1180e29180d44418390cf22d3e0bd6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:14:57.974486 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06c1265-88da-4eeb-b4fb-bed421489e42 service swift] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:14:57.974768 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06c1265-88da-4eeb-b4fb-bed421489e42 service swift] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:14:57.975042 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06c1265-88da-4eeb-b4fb-bed421489e42 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:14:57.987049 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06c1265-88da-4eeb-b4fb-bed421489e42 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:14:57.988934 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06c1265-88da-4eeb-b4fb-bed421489e42 service swift] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:14:57.999589 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1124/2265] 10.222.0.36 () {60 vars in 1384 bytes} [Tue May 3 14:14:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 03 14:15:00.148992 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a882c49a-dc70-4196-989b-50714ca240a1 None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:15:00.159636 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a882c49a-dc70-4196-989b-50714ca240a1 None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:15:00.163422 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f900393a-068f-4052-a040-0a1cd14a1ef6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b014f4c7ba1414cb8a597f5bc4033f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:15:00.164150 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f900393a-068f-4052-a040-0a1cd14a1ef6 service cinder] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:15:00.164497 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f900393a-068f-4052-a040-0a1cd14a1ef6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:15:00.164837 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f900393a-068f-4052-a040-0a1cd14a1ef6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:15:00.225393 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f900393a-068f-4052-a040-0a1cd14a1ef6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:15:00.227089 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f900393a-068f-4052-a040-0a1cd14a1ef6 service cinder] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:15:00.239679 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1142/2266] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:15:00 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 14:15:05.260526 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06c1265-88da-4eeb-b4fb-bed421489e42 service swift] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:15:05.378973 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06c1265-88da-4eeb-b4fb-bed421489e42 service swift] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:15:05.392471 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49149bb0-d766-4d39-b15b-ef2cf9942723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:15:05.393634 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49149bb0-d766-4d39-b15b-ef2cf9942723 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:15:05.393922 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49149bb0-d766-4d39-b15b-ef2cf9942723 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:15:05.394198 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49149bb0-d766-4d39-b15b-ef2cf9942723 admin admin] PATH_INFO: `/v3/users/c1a6578921f34df3b4059f7fca3d4a88` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:15:05.398513 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49149bb0-d766-4d39-b15b-ef2cf9942723 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1a6578921f34df3b4059f7fca3d4a88)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:15:05.400599 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49149bb0-d766-4d39-b15b-ef2cf9942723 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:15:05.491774 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-49149bb0-d766-4d39-b15b-ef2cf9942723 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1a6578921f34df3b4059f7fca3d4a88'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:15:05.502185 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-49149bb0-d766-4d39-b15b-ef2cf9942723 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1a6578921f34df3b4059f7fca3d4a88'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:15:05.503502 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-49149bb0-d766-4d39-b15b-ef2cf9942723 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1a6578921f34df3b4059f7fca3d4a88'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:15:05.520293 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-49149bb0-d766-4d39-b15b-ef2cf9942723 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1a6578921f34df3b4059f7fca3d4a88'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:15:05.521447 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-49149bb0-d766-4d39-b15b-ef2cf9942723 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1a6578921f34df3b4059f7fca3d4a88'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:15:05.586587 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1125/2267] 10.222.0.36 () {58 vars in 1223 bytes} [Tue May 3 14:15:05 2022] DELETE /identity/v3/users/c1a6578921f34df3b4059f7fca3d4a88 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:15:05.593037 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eaaa67-86a3-49f7-bcae-499a80e1398d None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:15:05.594645 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eaaa67-86a3-49f7-bcae-499a80e1398d None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:15:05.595454 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eaaa67-86a3-49f7-bcae-499a80e1398d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:15:05.648673 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-87eaaa67-86a3-49f7-bcae-499a80e1398d None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:15:05.651005 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-87eaaa67-86a3-49f7-bcae-499a80e1398d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:15:05.803230 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1143/2268] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:15:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:15:05.812934 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49149bb0-d766-4d39-b15b-ef2cf9942723 admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:15:05.814664 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-49149bb0-d766-4d39-b15b-ef2cf9942723 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:15:05.939102 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49149bb0-d766-4d39-b15b-ef2cf9942723 admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:15:05.943663 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfca385-b5e3-4511-9383-16c75f283f7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '937bea4f355144b4a7ee11baabc3a4cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:15:05.944651 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfca385-b5e3-4511-9383-16c75f283f7d service neutron] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:15:05.944933 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfca385-b5e3-4511-9383-16c75f283f7d service neutron] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:15:05.945209 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfca385-b5e3-4511-9383-16c75f283f7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:15:05.959855 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfca385-b5e3-4511-9383-16c75f283f7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:15:05.961656 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfca385-b5e3-4511-9383-16c75f283f7d service neutron] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:15:05.971639 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1126/2269] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:15:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 14:15:06.427335 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87eaaa67-86a3-49f7-bcae-499a80e1398d None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:15:06.428960 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-87eaaa67-86a3-49f7-bcae-499a80e1398d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:15:06.461041 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87eaaa67-86a3-49f7-bcae-499a80e1398d None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:15:06.505157 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c05ab20-327c-404e-ab8d-81bcc5f27d62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:15:06.507165 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c05ab20-327c-404e-ab8d-81bcc5f27d62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:15:06.507656 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c05ab20-327c-404e-ab8d-81bcc5f27d62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:15:06.508152 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c05ab20-327c-404e-ab8d-81bcc5f27d62 admin admin] PATH_INFO: `/v3/projects/2c544a972d7d43db98594a0093d85f95` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:15:06.509641 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c05ab20-327c-404e-ab8d-81bcc5f27d62 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c544a972d7d43db98594a0093d85f95)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:15:06.512390 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c05ab20-327c-404e-ab8d-81bcc5f27d62 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:15:06.607084 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-3c05ab20-327c-404e-ab8d-81bcc5f27d62 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c544a972d7d43db98594a0093d85f95', 'request_id': 'req-3c05ab20-327c-404e-ab8d-81bcc5f27d62'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:15:06.614806 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-3c05ab20-327c-404e-ab8d-81bcc5f27d62 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c544a972d7d43db98594a0093d85f95', 'request_id': 'req-3c05ab20-327c-404e-ab8d-81bcc5f27d62'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:15:06.622969 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-3c05ab20-327c-404e-ab8d-81bcc5f27d62 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c544a972d7d43db98594a0093d85f95', 'request_id': 'req-3c05ab20-327c-404e-ab8d-81bcc5f27d62'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:15:06.651600 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-3c05ab20-327c-404e-ab8d-81bcc5f27d62 admin admin] The token cache is being invalidate because project 2c544a972d7d43db98594a0093d85f95 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80013) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 14:15:06.651966 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-3c05ab20-327c-404e-ab8d-81bcc5f27d62 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:15:06.652749 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-3c05ab20-327c-404e-ab8d-81bcc5f27d62 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:15:06.655358 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1144/2270] 10.222.0.36 () {58 vars in 1232 bytes} [Tue May 3 14:15:06 2022] DELETE /identity/v3/projects/2c544a972d7d43db98594a0093d85f95 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:15:06.659270 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfca385-b5e3-4511-9383-16c75f283f7d service neutron] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:15:06.669177 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfca385-b5e3-4511-9383-16c75f283f7d service neutron] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:15:06.752428 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b56d84f-809b-41f7-992a-3c0030375927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:15:06.753367 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b56d84f-809b-41f7-992a-3c0030375927 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:15:06.753648 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b56d84f-809b-41f7-992a-3c0030375927 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:15:06.754125 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b56d84f-809b-41f7-992a-3c0030375927 admin admin] PATH_INFO: `/v3/users/5d5d27de9b2245e99f7aacc3d13f54db` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:15:06.755666 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b56d84f-809b-41f7-992a-3c0030375927 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d5d27de9b2245e99f7aacc3d13f54db)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:15:06.758272 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b56d84f-809b-41f7-992a-3c0030375927 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:15:06.820568 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-3b56d84f-809b-41f7-992a-3c0030375927 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d5d27de9b2245e99f7aacc3d13f54db'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:15:06.828335 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-3b56d84f-809b-41f7-992a-3c0030375927 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d5d27de9b2245e99f7aacc3d13f54db'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:15:06.829828 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-3b56d84f-809b-41f7-992a-3c0030375927 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d5d27de9b2245e99f7aacc3d13f54db'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:15:06.859260 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-3b56d84f-809b-41f7-992a-3c0030375927 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d5d27de9b2245e99f7aacc3d13f54db'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:15:06.860354 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-3b56d84f-809b-41f7-992a-3c0030375927 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d5d27de9b2245e99f7aacc3d13f54db'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:15:06.886399 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1127/2271] 10.222.0.36 () {58 vars in 1223 bytes} [Tue May 3 14:15:06 2022] DELETE /identity/v3/users/5d5d27de9b2245e99f7aacc3d13f54db => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:15:07.295420 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c05ab20-327c-404e-ab8d-81bcc5f27d62 admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:15:07.297072 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-3c05ab20-327c-404e-ab8d-81bcc5f27d62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:15:07.312398 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c05ab20-327c-404e-ab8d-81bcc5f27d62 admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:15:07.395721 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea37891-1eac-4955-ad06-fcbaf891202b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:15:07.396615 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea37891-1eac-4955-ad06-fcbaf891202b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:15:07.396894 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea37891-1eac-4955-ad06-fcbaf891202b admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:15:07.397173 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea37891-1eac-4955-ad06-fcbaf891202b admin admin] PATH_INFO: `/v3/projects/22907aae7bb44db1a2dae7e4d64977ee` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:15:07.398444 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea37891-1eac-4955-ad06-fcbaf891202b admin admin] RBAC: Authorizing `identity:delete_project(project_id=22907aae7bb44db1a2dae7e4d64977ee)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:15:07.400534 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea37891-1eac-4955-ad06-fcbaf891202b admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:15:07.466652 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-eea37891-1eac-4955-ad06-fcbaf891202b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22907aae7bb44db1a2dae7e4d64977ee', 'request_id': 'req-eea37891-1eac-4955-ad06-fcbaf891202b'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:15:07.477918 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-eea37891-1eac-4955-ad06-fcbaf891202b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22907aae7bb44db1a2dae7e4d64977ee', 'request_id': 'req-eea37891-1eac-4955-ad06-fcbaf891202b'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:15:07.489781 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-eea37891-1eac-4955-ad06-fcbaf891202b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22907aae7bb44db1a2dae7e4d64977ee', 'request_id': 'req-eea37891-1eac-4955-ad06-fcbaf891202b'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:15:07.503097 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-eea37891-1eac-4955-ad06-fcbaf891202b admin admin] The token cache is being invalidate because project 22907aae7bb44db1a2dae7e4d64977ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80013) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 14:15:07.503380 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-eea37891-1eac-4955-ad06-fcbaf891202b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:15:07.504177 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-eea37891-1eac-4955-ad06-fcbaf891202b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:15:07.505771 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1145/2272] 10.222.0.36 () {58 vars in 1232 bytes} [Tue May 3 14:15:07 2022] DELETE /identity/v3/projects/22907aae7bb44db1a2dae7e4d64977ee => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:15:07.509702 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b56d84f-809b-41f7-992a-3c0030375927 admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:15:07.511261 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-3b56d84f-809b-41f7-992a-3c0030375927 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:15:07.526283 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b56d84f-809b-41f7-992a-3c0030375927 admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:15:07.615578 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d093f6a8-3113-4871-b47e-f3e2e3a7e6c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:15:07.616608 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d093f6a8-3113-4871-b47e-f3e2e3a7e6c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:15:07.617236 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d093f6a8-3113-4871-b47e-f3e2e3a7e6c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:15:07.617859 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d093f6a8-3113-4871-b47e-f3e2e3a7e6c2 admin admin] PATH_INFO: `/v3/users/6f2db2d332ef46d284dc1c117d2235bc` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:15:07.619437 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d093f6a8-3113-4871-b47e-f3e2e3a7e6c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f2db2d332ef46d284dc1c117d2235bc)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:15:07.621512 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d093f6a8-3113-4871-b47e-f3e2e3a7e6c2 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:15:07.684323 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-d093f6a8-3113-4871-b47e-f3e2e3a7e6c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f2db2d332ef46d284dc1c117d2235bc'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:15:07.691132 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-d093f6a8-3113-4871-b47e-f3e2e3a7e6c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f2db2d332ef46d284dc1c117d2235bc'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:15:07.691800 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-d093f6a8-3113-4871-b47e-f3e2e3a7e6c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f2db2d332ef46d284dc1c117d2235bc'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:15:07.715354 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-d093f6a8-3113-4871-b47e-f3e2e3a7e6c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f2db2d332ef46d284dc1c117d2235bc'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:15:07.716375 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-d093f6a8-3113-4871-b47e-f3e2e3a7e6c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f2db2d332ef46d284dc1c117d2235bc'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:15:07.734485 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1128/2273] 10.222.0.36 () {58 vars in 1223 bytes} [Tue May 3 14:15:07 2022] DELETE /identity/v3/users/6f2db2d332ef46d284dc1c117d2235bc => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 14:15:08.060652 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea37891-1eac-4955-ad06-fcbaf891202b admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:15:08.062937 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-eea37891-1eac-4955-ad06-fcbaf891202b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:15:08.076618 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea37891-1eac-4955-ad06-fcbaf891202b admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:15:08.141388 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a901f2cf-c9f8-497c-a579-aa797f37463d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:15:08.142184 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a901f2cf-c9f8-497c-a579-aa797f37463d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:15:08.142462 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a901f2cf-c9f8-497c-a579-aa797f37463d admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:15:08.143224 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a901f2cf-c9f8-497c-a579-aa797f37463d admin admin] PATH_INFO: `/v3/projects/02878168c50843c988fc1f2ae0820de3` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:15:08.143978 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a901f2cf-c9f8-497c-a579-aa797f37463d admin admin] RBAC: Authorizing `identity:delete_project(project_id=02878168c50843c988fc1f2ae0820de3)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:15:08.145946 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a901f2cf-c9f8-497c-a579-aa797f37463d admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:15:08.192119 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-a901f2cf-c9f8-497c-a579-aa797f37463d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02878168c50843c988fc1f2ae0820de3', 'request_id': 'req-a901f2cf-c9f8-497c-a579-aa797f37463d'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:15:08.198552 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-a901f2cf-c9f8-497c-a579-aa797f37463d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02878168c50843c988fc1f2ae0820de3', 'request_id': 'req-a901f2cf-c9f8-497c-a579-aa797f37463d'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:15:08.207992 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-a901f2cf-c9f8-497c-a579-aa797f37463d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02878168c50843c988fc1f2ae0820de3', 'request_id': 'req-a901f2cf-c9f8-497c-a579-aa797f37463d'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:15:08.219883 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-a901f2cf-c9f8-497c-a579-aa797f37463d admin admin] The token cache is being invalidate because project 02878168c50843c988fc1f2ae0820de3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80013) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 14:15:08.220192 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-a901f2cf-c9f8-497c-a579-aa797f37463d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:15:08.220861 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-a901f2cf-c9f8-497c-a579-aa797f37463d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:15:08.223042 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1146/2274] 10.222.0.36 () {58 vars in 1232 bytes} [Tue May 3 14:15:08 2022] DELETE /identity/v3/projects/02878168c50843c988fc1f2ae0820de3 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:15:08.229001 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e7fd79-7fb2-465c-9c71-f6158a838fde None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:15:08.229314 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e7fd79-7fb2-465c-9c71-f6158a838fde None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:15:08.229606 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e7fd79-7fb2-465c-9c71-f6158a838fde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:15:08.249481 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-78e7fd79-7fb2-465c-9c71-f6158a838fde None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:15:08.250713 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-78e7fd79-7fb2-465c-9c71-f6158a838fde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:15:08.312953 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1129/2275] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:15:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:15:08.320520 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c68c1e-e49d-4457-82f8-4d6ba966c7f4 None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:15:08.320810 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c68c1e-e49d-4457-82f8-4d6ba966c7f4 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:15:08.324348 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c68c1e-e49d-4457-82f8-4d6ba966c7f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:15:08.347164 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-d8c68c1e-e49d-4457-82f8-4d6ba966c7f4 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:15:08.348371 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-d8c68c1e-e49d-4457-82f8-4d6ba966c7f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:15:08.359290 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1147/2276] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:15:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:15:08.366574 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e7fd79-7fb2-465c-9c71-f6158a838fde None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:15:08.377343 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e7fd79-7fb2-465c-9c71-f6158a838fde None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:15:08.391648 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1e7513-0530-4513-baaf-2b31eefe2d91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:15:08.392336 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1e7513-0530-4513-baaf-2b31eefe2d91 admin admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:15:08.392711 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1e7513-0530-4513-baaf-2b31eefe2d91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:15:08.393048 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1e7513-0530-4513-baaf-2b31eefe2d91 admin admin] PATH_INFO: `/v3/domains` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:15:08.393900 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1e7513-0530-4513-baaf-2b31eefe2d91 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80012) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:15:08.394304 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1e7513-0530-4513-baaf-2b31eefe2d91 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:15:08.396286 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1e7513-0530-4513-baaf-2b31eefe2d91 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:15:08.416144 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1130/2277] 10.222.0.36 () {58 vars in 1152 bytes} [Tue May 3 14:15:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:15:08.417413 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c68c1e-e49d-4457-82f8-4d6ba966c7f4 None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:15:08.427268 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c68c1e-e49d-4457-82f8-4d6ba966c7f4 None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:15:08.432315 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84a5116-899f-4eec-88e3-b89518375613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:15:08.433207 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84a5116-899f-4eec-88e3-b89518375613 admin admin] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:15:08.433368 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84a5116-899f-4eec-88e3-b89518375613 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:15:08.433664 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84a5116-899f-4eec-88e3-b89518375613 admin admin] PATH_INFO: `/v3/projects` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:15:08.434357 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84a5116-899f-4eec-88e3-b89518375613 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:15:08.436401 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84a5116-899f-4eec-88e3-b89518375613 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:15:08.477098 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1148/2278] 10.222.0.36 () {60 vars in 1152 bytes} [Tue May 3 14:15:08 2022] POST /identity/v3/projects => generated 377 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 14:15:08.478720 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1e7513-0530-4513-baaf-2b31eefe2d91 admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:15:08.489686 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1e7513-0530-4513-baaf-2b31eefe2d91 admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:15:08.550569 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4900c4-c3c7-42fe-b642-ad917e647e1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:15:08.551256 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4900c4-c3c7-42fe-b642-ad917e647e1f admin admin] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:15:08.551579 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4900c4-c3c7-42fe-b642-ad917e647e1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:15:08.551855 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4900c4-c3c7-42fe-b642-ad917e647e1f admin admin] PATH_INFO: `/v3/users` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:15:08.552549 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4900c4-c3c7-42fe-b642-ad917e647e1f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:15:08.554558 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4900c4-c3c7-42fe-b642-ad917e647e1f admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:15:08.578782 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1131/2279] 10.222.0.36 () {60 vars in 1143 bytes} [Tue May 3 14:15:08 2022] POST /identity/v3/users => generated 289 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 14:15:08.582714 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84a5116-899f-4eec-88e3-b89518375613 admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:15:08.595307 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84a5116-899f-4eec-88e3-b89518375613 admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:15:08.599916 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08185677-2713-4b78-8b47-b2b85490dc58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:15:08.600605 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08185677-2713-4b78-8b47-b2b85490dc58 admin admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:15:08.600869 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08185677-2713-4b78-8b47-b2b85490dc58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:15:08.601143 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08185677-2713-4b78-8b47-b2b85490dc58 admin admin] PATH_INFO: `/v3/roles` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:15:08.601904 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08185677-2713-4b78-8b47-b2b85490dc58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:15:08.603508 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08185677-2713-4b78-8b47-b2b85490dc58 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:15:08.614227 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1149/2280] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 3 14:15:08 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 14:15:08.618382 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4900c4-c3c7-42fe-b642-ad917e647e1f admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:15:08.628314 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4900c4-c3c7-42fe-b642-ad917e647e1f admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:15:08.633333 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535d17ec-6688-4fd4-9c17-50876f98d0d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:15:08.634005 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535d17ec-6688-4fd4-9c17-50876f98d0d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:15:08.634290 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535d17ec-6688-4fd4-9c17-50876f98d0d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:15:08.634562 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535d17ec-6688-4fd4-9c17-50876f98d0d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:15:08.635568 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535d17ec-6688-4fd4-9c17-50876f98d0d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:15:08.637173 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535d17ec-6688-4fd4-9c17-50876f98d0d9 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:15:08.648258 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1132/2281] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 3 14:15:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 14:15:08.651893 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08185677-2713-4b78-8b47-b2b85490dc58 admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:15:08.664832 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08185677-2713-4b78-8b47-b2b85490dc58 admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:15:08.670072 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae76918e-001f-4dce-81ae-d30534b613bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:15:08.670983 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae76918e-001f-4dce-81ae-d30534b613bd admin admin] REQUEST_METHOD: `PUT` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:15:08.671265 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae76918e-001f-4dce-81ae-d30534b613bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:15:08.671539 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae76918e-001f-4dce-81ae-d30534b613bd admin admin] PATH_INFO: `/v3/projects/dbb46988adce4e7fb0334b5f1f4cd242/users/3e5398bdaa694410869022a7b3ae9d8f/roles/441fdc11e95b47f4813f72610e39018b` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:15:08.687180 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae76918e-001f-4dce-81ae-d30534b613bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=dbb46988adce4e7fb0334b5f1f4cd242, user_id=3e5398bdaa694410869022a7b3ae9d8f, role_id=441fdc11e95b47f4813f72610e39018b)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:15:08.690416 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae76918e-001f-4dce-81ae-d30534b613bd admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:15:08.704614 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1150/2282] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 3 14:15:08 2022] PUT /identity/v3/projects/dbb46988adce4e7fb0334b5f1f4cd242/users/3e5398bdaa694410869022a7b3ae9d8f/roles/441fdc11e95b47f4813f72610e39018b => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:15:08.718268 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afd15a3-81d4-43c4-94d1-ef700fd5e731 None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:15:08.719258 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afd15a3-81d4-43c4-94d1-ef700fd5e731 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:15:08.721723 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afd15a3-81d4-43c4-94d1-ef700fd5e731 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:15:08.749436 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-6afd15a3-81d4-43c4-94d1-ef700fd5e731 None None] MFA Rules not processed for user `3e5398bdaa694410869022a7b3ae9d8f`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:15:08.751010 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-6afd15a3-81d4-43c4-94d1-ef700fd5e731 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:15:08.821572 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1133/2283] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:15:08 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 14:15:08.826841 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae76918e-001f-4dce-81ae-d30534b613bd admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:15:08.909518 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae76918e-001f-4dce-81ae-d30534b613bd admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:15:08.915233 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306e1817-c51e-4d4d-b098-ecad64984799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:15:08.916382 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306e1817-c51e-4d4d-b098-ecad64984799 admin admin] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:15:08.916664 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306e1817-c51e-4d4d-b098-ecad64984799 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:15:08.916957 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306e1817-c51e-4d4d-b098-ecad64984799 admin admin] PATH_INFO: `/v3/projects` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:15:08.917945 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306e1817-c51e-4d4d-b098-ecad64984799 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:15:08.920374 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306e1817-c51e-4d4d-b098-ecad64984799 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:15:08.959797 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1151/2284] 10.222.0.36 () {60 vars in 1152 bytes} [Tue May 3 14:15:08 2022] POST /identity/v3/projects => generated 379 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 14:15:08.963688 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afd15a3-81d4-43c4-94d1-ef700fd5e731 None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:15:08.976571 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afd15a3-81d4-43c4-94d1-ef700fd5e731 None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:15:09.059752 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e843b33-e065-47b3-8de4-cfebc8f6a2a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:15:09.060710 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e843b33-e065-47b3-8de4-cfebc8f6a2a7 admin admin] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:15:09.061874 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e843b33-e065-47b3-8de4-cfebc8f6a2a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:15:09.062325 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e843b33-e065-47b3-8de4-cfebc8f6a2a7 admin admin] PATH_INFO: `/v3/users` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:15:09.063368 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e843b33-e065-47b3-8de4-cfebc8f6a2a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:15:09.065807 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e843b33-e065-47b3-8de4-cfebc8f6a2a7 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:15:09.093128 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1134/2285] 10.222.0.36 () {60 vars in 1143 bytes} [Tue May 3 14:15:08 2022] POST /identity/v3/users => generated 290 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 14:15:09.097120 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306e1817-c51e-4d4d-b098-ecad64984799 admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:15:09.113362 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306e1817-c51e-4d4d-b098-ecad64984799 admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:15:09.119182 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97369a51-f162-466e-adc0-774adee0492d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:15:09.119694 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97369a51-f162-466e-adc0-774adee0492d admin admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:15:09.120044 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97369a51-f162-466e-adc0-774adee0492d admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:15:09.120745 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97369a51-f162-466e-adc0-774adee0492d admin admin] PATH_INFO: `/v3/roles` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:15:09.121059 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97369a51-f162-466e-adc0-774adee0492d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:15:09.123387 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97369a51-f162-466e-adc0-774adee0492d admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:15:09.137881 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1152/2286] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 3 14:15:09 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 14:15:09.139058 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e843b33-e065-47b3-8de4-cfebc8f6a2a7 admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:15:09.150036 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e843b33-e065-47b3-8de4-cfebc8f6a2a7 admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:15:09.156309 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac28afa-4307-4971-b0b1-d868e145558e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:15:09.157057 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac28afa-4307-4971-b0b1-d868e145558e admin admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:15:09.157466 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac28afa-4307-4971-b0b1-d868e145558e admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:15:09.157775 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac28afa-4307-4971-b0b1-d868e145558e admin admin] PATH_INFO: `/v3/roles` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:15:09.158537 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac28afa-4307-4971-b0b1-d868e145558e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:15:09.160208 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac28afa-4307-4971-b0b1-d868e145558e admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:15:09.171569 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1135/2287] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 3 14:15:09 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 14:15:09.175810 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97369a51-f162-466e-adc0-774adee0492d admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:15:09.189192 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97369a51-f162-466e-adc0-774adee0492d admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:15:09.195034 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da247337-b475-43e1-87f8-20ed5ae391ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:15:09.196365 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da247337-b475-43e1-87f8-20ed5ae391ef admin admin] REQUEST_METHOD: `PUT` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:15:09.196840 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da247337-b475-43e1-87f8-20ed5ae391ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:15:09.197405 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da247337-b475-43e1-87f8-20ed5ae391ef admin admin] PATH_INFO: `/v3/projects/34fe7c220b8140008534545cad9a094f/users/95bff084f76f4f55b876cfcd49065348/roles/441fdc11e95b47f4813f72610e39018b` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:15:09.229401 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da247337-b475-43e1-87f8-20ed5ae391ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=34fe7c220b8140008534545cad9a094f, user_id=95bff084f76f4f55b876cfcd49065348, role_id=441fdc11e95b47f4813f72610e39018b)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:15:09.233875 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da247337-b475-43e1-87f8-20ed5ae391ef admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:15:09.269523 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1153/2288] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 3 14:15:09 2022] PUT /identity/v3/projects/34fe7c220b8140008534545cad9a094f/users/95bff084f76f4f55b876cfcd49065348/roles/441fdc11e95b47f4813f72610e39018b => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:15:09.273608 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d754b5-c75d-4c0b-ab8d-b69bfc022b25 None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:15:09.274071 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d754b5-c75d-4c0b-ab8d-b69bfc022b25 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:15:09.274628 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d754b5-c75d-4c0b-ab8d-b69bfc022b25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:15:09.338410 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-80d754b5-c75d-4c0b-ab8d-b69bfc022b25 None None] MFA Rules not processed for user `95bff084f76f4f55b876cfcd49065348`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:15:09.339629 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-80d754b5-c75d-4c0b-ab8d-b69bfc022b25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:15:09.450151 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1136/2289] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:15:09 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 14:15:09.454886 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da247337-b475-43e1-87f8-20ed5ae391ef admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:15:09.530995 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da247337-b475-43e1-87f8-20ed5ae391ef admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:15:09.535730 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e00dd8-2aa7-451e-ae0f-1ef1f1a15f0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:15:09.536396 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e00dd8-2aa7-451e-ae0f-1ef1f1a15f0e admin admin] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:15:09.536676 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e00dd8-2aa7-451e-ae0f-1ef1f1a15f0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:15:09.536948 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e00dd8-2aa7-451e-ae0f-1ef1f1a15f0e admin admin] PATH_INFO: `/v3/projects` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:15:09.537702 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e00dd8-2aa7-451e-ae0f-1ef1f1a15f0e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:15:09.539847 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e00dd8-2aa7-451e-ae0f-1ef1f1a15f0e admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:15:09.569851 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1154/2290] 10.222.0.36 () {60 vars in 1152 bytes} [Tue May 3 14:15:09 2022] POST /identity/v3/projects => generated 379 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 14:15:09.571170 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d754b5-c75d-4c0b-ab8d-b69bfc022b25 None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:15:09.583235 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d754b5-c75d-4c0b-ab8d-b69bfc022b25 None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:15:09.655475 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5366127a-e3d5-4472-bed6-51b6fc42e0a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:15:09.656334 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5366127a-e3d5-4472-bed6-51b6fc42e0a2 admin admin] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:15:09.656716 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5366127a-e3d5-4472-bed6-51b6fc42e0a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:15:09.657201 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5366127a-e3d5-4472-bed6-51b6fc42e0a2 admin admin] PATH_INFO: `/v3/users` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:15:09.658029 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5366127a-e3d5-4472-bed6-51b6fc42e0a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:15:09.659992 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5366127a-e3d5-4472-bed6-51b6fc42e0a2 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:15:09.680158 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1137/2291] 10.222.0.36 () {60 vars in 1143 bytes} [Tue May 3 14:15:09 2022] POST /identity/v3/users => generated 296 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 14:15:09.683889 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e00dd8-2aa7-451e-ae0f-1ef1f1a15f0e admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:15:09.694868 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e00dd8-2aa7-451e-ae0f-1ef1f1a15f0e admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:15:09.700307 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f68821b-98cf-42bf-b8da-3e844569c57e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:15:09.701149 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f68821b-98cf-42bf-b8da-3e844569c57e admin admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:15:09.701529 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f68821b-98cf-42bf-b8da-3e844569c57e admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:15:09.701966 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f68821b-98cf-42bf-b8da-3e844569c57e admin admin] PATH_INFO: `/v3/roles` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:15:09.702775 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f68821b-98cf-42bf-b8da-3e844569c57e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:15:09.704413 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f68821b-98cf-42bf-b8da-3e844569c57e admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:15:09.715691 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1155/2292] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 3 14:15:09 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 14:15:09.720393 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5366127a-e3d5-4472-bed6-51b6fc42e0a2 admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:15:09.730690 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5366127a-e3d5-4472-bed6-51b6fc42e0a2 admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:15:09.736003 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82770e9b-8fc0-4618-aec7-1b8e5f143d5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:15:09.736972 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82770e9b-8fc0-4618-aec7-1b8e5f143d5b admin admin] REQUEST_METHOD: `PUT` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:15:09.737254 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82770e9b-8fc0-4618-aec7-1b8e5f143d5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:15:09.737557 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82770e9b-8fc0-4618-aec7-1b8e5f143d5b admin admin] PATH_INFO: `/v3/projects/8c7a8cb24388416194f8d3fdc75a323a/users/f3408badb084412ca8bf90f410dcfc52/roles/36abe9b50fd8479c86c4f8f70fd85aa3` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:15:09.752948 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82770e9b-8fc0-4618-aec7-1b8e5f143d5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c7a8cb24388416194f8d3fdc75a323a, user_id=f3408badb084412ca8bf90f410dcfc52, role_id=36abe9b50fd8479c86c4f8f70fd85aa3)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:15:09.755914 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82770e9b-8fc0-4618-aec7-1b8e5f143d5b admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:15:09.769618 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1138/2293] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 3 14:15:09 2022] PUT /identity/v3/projects/8c7a8cb24388416194f8d3fdc75a323a/users/f3408badb084412ca8bf90f410dcfc52/roles/36abe9b50fd8479c86c4f8f70fd85aa3 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:15:09.773549 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f68821b-98cf-42bf-b8da-3e844569c57e admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:15:09.784690 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f68821b-98cf-42bf-b8da-3e844569c57e admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:15:09.847121 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e9dfa1-ee5a-4ee5-b487-d36940640dba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:15:09.848119 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e9dfa1-ee5a-4ee5-b487-d36940640dba admin admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:15:09.848403 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e9dfa1-ee5a-4ee5-b487-d36940640dba admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:15:09.848676 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e9dfa1-ee5a-4ee5-b487-d36940640dba admin admin] PATH_INFO: `/v3/roles` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:15:09.849457 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e9dfa1-ee5a-4ee5-b487-d36940640dba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:15:09.851245 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e9dfa1-ee5a-4ee5-b487-d36940640dba admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:15:09.862223 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1156/2294] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 3 14:15:09 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 14:15:09.867203 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82770e9b-8fc0-4618-aec7-1b8e5f143d5b admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:15:09.880146 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82770e9b-8fc0-4618-aec7-1b8e5f143d5b admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:15:09.907052 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f2515a-6adc-47bc-a9c7-7a7e58302ccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:15:09.907966 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f2515a-6adc-47bc-a9c7-7a7e58302ccc admin admin] REQUEST_METHOD: `PUT` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:15:09.908244 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f2515a-6adc-47bc-a9c7-7a7e58302ccc admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:15:09.908666 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f2515a-6adc-47bc-a9c7-7a7e58302ccc admin admin] PATH_INFO: `/v3/projects/8c7a8cb24388416194f8d3fdc75a323a/users/f3408badb084412ca8bf90f410dcfc52/roles/36abe9b50fd8479c86c4f8f70fd85aa3` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:15:09.912341 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f2515a-6adc-47bc-a9c7-7a7e58302ccc admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c7a8cb24388416194f8d3fdc75a323a, user_id=f3408badb084412ca8bf90f410dcfc52, role_id=36abe9b50fd8479c86c4f8f70fd85aa3)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:15:09.916312 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f2515a-6adc-47bc-a9c7-7a7e58302ccc admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:15:09.932627 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1139/2295] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 3 14:15:09 2022] PUT /identity/v3/projects/8c7a8cb24388416194f8d3fdc75a323a/users/f3408badb084412ca8bf90f410dcfc52/roles/36abe9b50fd8479c86c4f8f70fd85aa3 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:15:09.943272 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb79f4a-5d46-47f3-aef9-84cca0ea6f72 None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:15:09.943540 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb79f4a-5d46-47f3-aef9-84cca0ea6f72 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:15:09.943809 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb79f4a-5d46-47f3-aef9-84cca0ea6f72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:15:09.973258 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-fbb79f4a-5d46-47f3-aef9-84cca0ea6f72 None None] MFA Rules not processed for user `f3408badb084412ca8bf90f410dcfc52`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:15:09.975276 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-fbb79f4a-5d46-47f3-aef9-84cca0ea6f72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:15:10.064438 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1157/2296] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:15:09 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:15:10.078146 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f2515a-6adc-47bc-a9c7-7a7e58302ccc admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:15:10.079876 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-49f2515a-6adc-47bc-a9c7-7a7e58302ccc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:15:10.141995 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f2515a-6adc-47bc-a9c7-7a7e58302ccc admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:15:10.145628 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25164728-5d98-47c6-9f4d-7d6740ba4217 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b014f4c7ba1414cb8a597f5bc4033f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:15:10.146274 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25164728-5d98-47c6-9f4d-7d6740ba4217 service cinder] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:15:10.146548 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25164728-5d98-47c6-9f4d-7d6740ba4217 service cinder] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:15:10.146817 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25164728-5d98-47c6-9f4d-7d6740ba4217 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:15:10.155751 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25164728-5d98-47c6-9f4d-7d6740ba4217 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:15:10.157163 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25164728-5d98-47c6-9f4d-7d6740ba4217 service cinder] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:15:10.167401 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1140/2297] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:15:10 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 03 14:15:10.214949 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb79f4a-5d46-47f3-aef9-84cca0ea6f72 None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:15:10.216372 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-fbb79f4a-5d46-47f3-aef9-84cca0ea6f72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:15:10.228473 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb79f4a-5d46-47f3-aef9-84cca0ea6f72 None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:15:10.232368 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badac31d-1677-41fa-9084-e02d42b97ba0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b014f4c7ba1414cb8a597f5bc4033f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:15:10.233186 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badac31d-1677-41fa-9084-e02d42b97ba0 service cinder] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:15:10.233506 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badac31d-1677-41fa-9084-e02d42b97ba0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:15:10.233775 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badac31d-1677-41fa-9084-e02d42b97ba0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:15:10.290802 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badac31d-1677-41fa-9084-e02d42b97ba0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:15:10.292232 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badac31d-1677-41fa-9084-e02d42b97ba0 service cinder] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:15:10.301603 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1158/2298] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:15:10 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 14:15:14.269172 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25164728-5d98-47c6-9f4d-7d6740ba4217 service cinder] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:15:14.374499 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25164728-5d98-47c6-9f4d-7d6740ba4217 service cinder] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:15:14.380695 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10a9fe4-c511-4ab7-b365-bbc92add291f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:15:14.381719 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10a9fe4-c511-4ab7-b365-bbc92add291f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:15:14.382149 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10a9fe4-c511-4ab7-b365-bbc92add291f admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:15:14.382432 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10a9fe4-c511-4ab7-b365-bbc92add291f admin admin] PATH_INFO: `/v3/users/3e5398bdaa694410869022a7b3ae9d8f` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:15:14.383903 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10a9fe4-c511-4ab7-b365-bbc92add291f admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e5398bdaa694410869022a7b3ae9d8f)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:15:14.386852 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10a9fe4-c511-4ab7-b365-bbc92add291f admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:15:14.440665 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-e10a9fe4-c511-4ab7-b365-bbc92add291f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e5398bdaa694410869022a7b3ae9d8f'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:15:14.447413 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-e10a9fe4-c511-4ab7-b365-bbc92add291f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e5398bdaa694410869022a7b3ae9d8f'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:15:14.448198 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-e10a9fe4-c511-4ab7-b365-bbc92add291f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e5398bdaa694410869022a7b3ae9d8f'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:15:14.461067 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-e10a9fe4-c511-4ab7-b365-bbc92add291f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e5398bdaa694410869022a7b3ae9d8f'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:15:14.461812 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-e10a9fe4-c511-4ab7-b365-bbc92add291f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e5398bdaa694410869022a7b3ae9d8f'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:15:14.480752 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1141/2299] 10.222.0.36 () {58 vars in 1223 bytes} [Tue May 3 14:15:14 2022] DELETE /identity/v3/users/3e5398bdaa694410869022a7b3ae9d8f => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:15:14.487985 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adb2653-a0fe-4966-bc81-4a3123d83cfd None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:15:14.488532 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adb2653-a0fe-4966-bc81-4a3123d83cfd None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:15:14.488532 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adb2653-a0fe-4966-bc81-4a3123d83cfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:15:14.544599 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-1adb2653-a0fe-4966-bc81-4a3123d83cfd None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:15:14.546181 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-1adb2653-a0fe-4966-bc81-4a3123d83cfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:15:14.610111 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1159/2300] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:15:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:15:14.620317 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10a9fe4-c511-4ab7-b365-bbc92add291f admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:15:14.621743 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-e10a9fe4-c511-4ab7-b365-bbc92add291f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:15:14.726399 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10a9fe4-c511-4ab7-b365-bbc92add291f admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:15:14.730872 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2535c3-11ea-452f-ab9a-7ef8c19d611b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '937bea4f355144b4a7ee11baabc3a4cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:15:14.731544 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2535c3-11ea-452f-ab9a-7ef8c19d611b service neutron] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:15:14.731806 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2535c3-11ea-452f-ab9a-7ef8c19d611b service neutron] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:15:14.732085 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2535c3-11ea-452f-ab9a-7ef8c19d611b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:15:14.742018 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2535c3-11ea-452f-ab9a-7ef8c19d611b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:15:14.743448 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2535c3-11ea-452f-ab9a-7ef8c19d611b service neutron] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:15:14.753907 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1142/2301] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:15:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 14:15:15.353866 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adb2653-a0fe-4966-bc81-4a3123d83cfd None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:15:15.355286 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-1adb2653-a0fe-4966-bc81-4a3123d83cfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:15:15.387912 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adb2653-a0fe-4966-bc81-4a3123d83cfd None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:15:15.404040 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7baadb04-1e70-4f13-a0e0-419289163f65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:15:15.405014 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baadb04-1e70-4f13-a0e0-419289163f65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:15:15.405335 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baadb04-1e70-4f13-a0e0-419289163f65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:15:15.405596 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baadb04-1e70-4f13-a0e0-419289163f65 admin admin] PATH_INFO: `/v3/projects/dbb46988adce4e7fb0334b5f1f4cd242` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:15:15.414757 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7baadb04-1e70-4f13-a0e0-419289163f65 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dbb46988adce4e7fb0334b5f1f4cd242)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:15:15.416816 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7baadb04-1e70-4f13-a0e0-419289163f65 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:15:15.480462 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-7baadb04-1e70-4f13-a0e0-419289163f65 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dbb46988adce4e7fb0334b5f1f4cd242', 'request_id': 'req-7baadb04-1e70-4f13-a0e0-419289163f65'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:15:15.486591 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-7baadb04-1e70-4f13-a0e0-419289163f65 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dbb46988adce4e7fb0334b5f1f4cd242', 'request_id': 'req-7baadb04-1e70-4f13-a0e0-419289163f65'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:15:15.495436 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-7baadb04-1e70-4f13-a0e0-419289163f65 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dbb46988adce4e7fb0334b5f1f4cd242', 'request_id': 'req-7baadb04-1e70-4f13-a0e0-419289163f65'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:15:15.512066 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-7baadb04-1e70-4f13-a0e0-419289163f65 admin admin] The token cache is being invalidate because project dbb46988adce4e7fb0334b5f1f4cd242 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80013) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 14:15:15.512442 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-7baadb04-1e70-4f13-a0e0-419289163f65 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:15:15.513174 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-7baadb04-1e70-4f13-a0e0-419289163f65 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:15:15.517890 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1160/2302] 10.222.0.36 () {58 vars in 1232 bytes} [Tue May 3 14:15:15 2022] DELETE /identity/v3/projects/dbb46988adce4e7fb0334b5f1f4cd242 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:15:15.519188 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2535c3-11ea-452f-ab9a-7ef8c19d611b service neutron] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:15:15.530379 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2535c3-11ea-452f-ab9a-7ef8c19d611b service neutron] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:15:15.603264 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8f5516-b440-48f8-87a8-05635398c2bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:15:15.604291 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8f5516-b440-48f8-87a8-05635398c2bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:15:15.604494 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8f5516-b440-48f8-87a8-05635398c2bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:15:15.604721 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8f5516-b440-48f8-87a8-05635398c2bf admin admin] PATH_INFO: `/v3/users/95bff084f76f4f55b876cfcd49065348` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:15:15.605999 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8f5516-b440-48f8-87a8-05635398c2bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=95bff084f76f4f55b876cfcd49065348)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:15:15.614033 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8f5516-b440-48f8-87a8-05635398c2bf admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:15:15.683740 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-0c8f5516-b440-48f8-87a8-05635398c2bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95bff084f76f4f55b876cfcd49065348'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:15:15.692731 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-0c8f5516-b440-48f8-87a8-05635398c2bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95bff084f76f4f55b876cfcd49065348'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:15:15.693491 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-0c8f5516-b440-48f8-87a8-05635398c2bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95bff084f76f4f55b876cfcd49065348'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:15:15.707837 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-0c8f5516-b440-48f8-87a8-05635398c2bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95bff084f76f4f55b876cfcd49065348'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:15:15.708606 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-0c8f5516-b440-48f8-87a8-05635398c2bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95bff084f76f4f55b876cfcd49065348'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:15:15.730407 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1143/2303] 10.222.0.36 () {58 vars in 1223 bytes} [Tue May 3 14:15:15 2022] DELETE /identity/v3/users/95bff084f76f4f55b876cfcd49065348 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:15:16.109548 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7baadb04-1e70-4f13-a0e0-419289163f65 admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:15:16.111409 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-7baadb04-1e70-4f13-a0e0-419289163f65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:15:16.155829 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7baadb04-1e70-4f13-a0e0-419289163f65 admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:15:16.225563 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcc9729-eb11-4ff3-a0ec-1c0402a99c77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:15:16.226445 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcc9729-eb11-4ff3-a0ec-1c0402a99c77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:15:16.226722 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcc9729-eb11-4ff3-a0ec-1c0402a99c77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:15:16.226994 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcc9729-eb11-4ff3-a0ec-1c0402a99c77 admin admin] PATH_INFO: `/v3/projects/34fe7c220b8140008534545cad9a094f` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:15:16.228172 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcc9729-eb11-4ff3-a0ec-1c0402a99c77 admin admin] RBAC: Authorizing `identity:delete_project(project_id=34fe7c220b8140008534545cad9a094f)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:15:16.230164 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcc9729-eb11-4ff3-a0ec-1c0402a99c77 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:15:16.281833 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-bdcc9729-eb11-4ff3-a0ec-1c0402a99c77 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34fe7c220b8140008534545cad9a094f', 'request_id': 'req-bdcc9729-eb11-4ff3-a0ec-1c0402a99c77'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:15:16.287689 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-bdcc9729-eb11-4ff3-a0ec-1c0402a99c77 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34fe7c220b8140008534545cad9a094f', 'request_id': 'req-bdcc9729-eb11-4ff3-a0ec-1c0402a99c77'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:15:16.296363 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-bdcc9729-eb11-4ff3-a0ec-1c0402a99c77 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34fe7c220b8140008534545cad9a094f', 'request_id': 'req-bdcc9729-eb11-4ff3-a0ec-1c0402a99c77'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:15:16.307183 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-bdcc9729-eb11-4ff3-a0ec-1c0402a99c77 admin admin] The token cache is being invalidate because project 34fe7c220b8140008534545cad9a094f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80013) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 14:15:16.307460 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-bdcc9729-eb11-4ff3-a0ec-1c0402a99c77 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:15:16.308088 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-bdcc9729-eb11-4ff3-a0ec-1c0402a99c77 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:15:16.309701 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1161/2304] 10.222.0.36 () {58 vars in 1232 bytes} [Tue May 3 14:15:16 2022] DELETE /identity/v3/projects/34fe7c220b8140008534545cad9a094f => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:15:16.313971 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8f5516-b440-48f8-87a8-05635398c2bf admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:15:16.315437 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-0c8f5516-b440-48f8-87a8-05635398c2bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:15:16.329144 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8f5516-b440-48f8-87a8-05635398c2bf admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:15:16.389461 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6468d6c2-7682-43d7-a0eb-10c78dfed29d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:15:16.390576 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6468d6c2-7682-43d7-a0eb-10c78dfed29d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:15:16.390860 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6468d6c2-7682-43d7-a0eb-10c78dfed29d admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:15:16.391139 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6468d6c2-7682-43d7-a0eb-10c78dfed29d admin admin] PATH_INFO: `/v3/users/f3408badb084412ca8bf90f410dcfc52` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:15:16.392478 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6468d6c2-7682-43d7-a0eb-10c78dfed29d admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3408badb084412ca8bf90f410dcfc52)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:15:16.394537 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6468d6c2-7682-43d7-a0eb-10c78dfed29d admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:15:16.442934 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-6468d6c2-7682-43d7-a0eb-10c78dfed29d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3408badb084412ca8bf90f410dcfc52'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:15:16.449971 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-6468d6c2-7682-43d7-a0eb-10c78dfed29d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3408badb084412ca8bf90f410dcfc52'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:15:16.450820 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-6468d6c2-7682-43d7-a0eb-10c78dfed29d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3408badb084412ca8bf90f410dcfc52'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:15:16.465079 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-6468d6c2-7682-43d7-a0eb-10c78dfed29d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3408badb084412ca8bf90f410dcfc52'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:15:16.465079 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-6468d6c2-7682-43d7-a0eb-10c78dfed29d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3408badb084412ca8bf90f410dcfc52'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:15:16.483442 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1144/2305] 10.222.0.36 () {58 vars in 1223 bytes} [Tue May 3 14:15:16 2022] DELETE /identity/v3/users/f3408badb084412ca8bf90f410dcfc52 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:15:16.829936 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcc9729-eb11-4ff3-a0ec-1c0402a99c77 admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:15:16.831461 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-bdcc9729-eb11-4ff3-a0ec-1c0402a99c77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:15:16.846956 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcc9729-eb11-4ff3-a0ec-1c0402a99c77 admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:15:16.891648 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6468d6c2-7682-43d7-a0eb-10c78dfed29d admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:15:16.893680 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-6468d6c2-7682-43d7-a0eb-10c78dfed29d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:15:16.921560 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57f7194-dd31-4c8d-8e90-85a84acc9e72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:15:16.923072 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57f7194-dd31-4c8d-8e90-85a84acc9e72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:15:16.923760 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57f7194-dd31-4c8d-8e90-85a84acc9e72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:15:16.924700 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57f7194-dd31-4c8d-8e90-85a84acc9e72 admin admin] PATH_INFO: `/v3/users/5f9c180eeef2480b959ed42e8bd36c1e` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:15:16.926630 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57f7194-dd31-4c8d-8e90-85a84acc9e72 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f9c180eeef2480b959ed42e8bd36c1e)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:15:16.928893 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57f7194-dd31-4c8d-8e90-85a84acc9e72 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:15:16.981535 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6468d6c2-7682-43d7-a0eb-10c78dfed29d admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:15:16.986282 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12005b1-8891-41fa-98d5-156b558c07a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:15:16.986516 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-b57f7194-dd31-4c8d-8e90-85a84acc9e72 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f9c180eeef2480b959ed42e8bd36c1e'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:15:16.987164 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12005b1-8891-41fa-98d5-156b558c07a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:15:16.987445 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12005b1-8891-41fa-98d5-156b558c07a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:15:16.987721 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12005b1-8891-41fa-98d5-156b558c07a2 admin admin] PATH_INFO: `/v3/projects/8c7a8cb24388416194f8d3fdc75a323a` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:15:16.988894 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12005b1-8891-41fa-98d5-156b558c07a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c7a8cb24388416194f8d3fdc75a323a)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:15:16.990974 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12005b1-8891-41fa-98d5-156b558c07a2 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:15:16.994403 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-b57f7194-dd31-4c8d-8e90-85a84acc9e72 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f9c180eeef2480b959ed42e8bd36c1e'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:15:16.995101 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-b57f7194-dd31-4c8d-8e90-85a84acc9e72 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f9c180eeef2480b959ed42e8bd36c1e'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:15:17.003019 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-b57f7194-dd31-4c8d-8e90-85a84acc9e72 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f9c180eeef2480b959ed42e8bd36c1e'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:15:17.003703 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-b57f7194-dd31-4c8d-8e90-85a84acc9e72 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f9c180eeef2480b959ed42e8bd36c1e'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:15:17.023357 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1162/2306] 10.222.0.36 () {58 vars in 1223 bytes} [Tue May 3 14:15:16 2022] DELETE /identity/v3/users/5f9c180eeef2480b959ed42e8bd36c1e => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:15:17.038322 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b65e04c-1ab4-43bf-b55f-87c5f0db6545 None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:15:17.038904 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b65e04c-1ab4-43bf-b55f-87c5f0db6545 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:15:17.039336 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b65e04c-1ab4-43bf-b55f-87c5f0db6545 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:15:17.044229 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-a12005b1-8891-41fa-98d5-156b558c07a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c7a8cb24388416194f8d3fdc75a323a', 'request_id': 'req-a12005b1-8891-41fa-98d5-156b558c07a2'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:15:17.052796 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-a12005b1-8891-41fa-98d5-156b558c07a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c7a8cb24388416194f8d3fdc75a323a', 'request_id': 'req-a12005b1-8891-41fa-98d5-156b558c07a2'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:15:17.059822 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-1b65e04c-1ab4-43bf-b55f-87c5f0db6545 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:15:17.061039 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-a12005b1-8891-41fa-98d5-156b558c07a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c7a8cb24388416194f8d3fdc75a323a', 'request_id': 'req-a12005b1-8891-41fa-98d5-156b558c07a2'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:15:17.061178 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-1b65e04c-1ab4-43bf-b55f-87c5f0db6545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:15:17.076082 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-a12005b1-8891-41fa-98d5-156b558c07a2 admin admin] The token cache is being invalidate because project 8c7a8cb24388416194f8d3fdc75a323a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80012) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 14:15:17.076552 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-a12005b1-8891-41fa-98d5-156b558c07a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:15:17.077274 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-a12005b1-8891-41fa-98d5-156b558c07a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:15:17.079217 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1145/2307] 10.222.0.36 () {58 vars in 1232 bytes} [Tue May 3 14:15:16 2022] DELETE /identity/v3/projects/8c7a8cb24388416194f8d3fdc75a323a => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:15:17.084870 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc1893f-8151-4221-a44b-37707ac536e0 None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:15:17.085376 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc1893f-8151-4221-a44b-37707ac536e0 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:15:17.086115 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc1893f-8151-4221-a44b-37707ac536e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:15:17.120729 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1163/2308] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:15:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 14:15:17.123607 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-8fc1893f-8151-4221-a44b-37707ac536e0 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:15:17.124831 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-8fc1893f-8151-4221-a44b-37707ac536e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:15:17.131216 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b65e04c-1ab4-43bf-b55f-87c5f0db6545 None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:15:17.132585 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-1b65e04c-1ab4-43bf-b55f-87c5f0db6545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:15:17.133211 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1146/2309] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:15:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 14:15:17.144048 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b9fb29-084c-4ded-bcfe-234fd15c99a5 None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:15:17.144344 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b9fb29-084c-4ded-bcfe-234fd15c99a5 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:15:17.144611 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b9fb29-084c-4ded-bcfe-234fd15c99a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:15:17.162842 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-94b9fb29-084c-4ded-bcfe-234fd15c99a5 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:15:17.164023 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-94b9fb29-084c-4ded-bcfe-234fd15c99a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:15:17.172893 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1147/2310] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:15:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:15:17.177470 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b9fb29-084c-4ded-bcfe-234fd15c99a5 None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:15:17.186799 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b9fb29-084c-4ded-bcfe-234fd15c99a5 None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:15:17.192387 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ac4d85-6fa7-4ec5-9b48-98f9ed8b6d10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:15:17.193060 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ac4d85-6fa7-4ec5-9b48-98f9ed8b6d10 admin admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:15:17.193432 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ac4d85-6fa7-4ec5-9b48-98f9ed8b6d10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:15:17.193633 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ac4d85-6fa7-4ec5-9b48-98f9ed8b6d10 admin admin] PATH_INFO: `/v3/domains` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:15:17.194358 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ac4d85-6fa7-4ec5-9b48-98f9ed8b6d10 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80012) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:15:17.194718 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ac4d85-6fa7-4ec5-9b48-98f9ed8b6d10 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:15:17.196362 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ac4d85-6fa7-4ec5-9b48-98f9ed8b6d10 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:15:17.197238 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b65e04c-1ab4-43bf-b55f-87c5f0db6545 None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:15:17.201682 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1208d06-5e76-415a-ba78-98fb5c2ec383 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '937bea4f355144b4a7ee11baabc3a4cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:15:17.202430 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1208d06-5e76-415a-ba78-98fb5c2ec383 service neutron] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:15:17.202710 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1208d06-5e76-415a-ba78-98fb5c2ec383 service neutron] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:15:17.202980 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1208d06-5e76-415a-ba78-98fb5c2ec383 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:15:17.208736 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1148/2311] 10.222.0.36 () {58 vars in 1152 bytes} [Tue May 3 14:15:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:15:17.214498 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ac4d85-6fa7-4ec5-9b48-98f9ed8b6d10 admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:15:17.214962 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1208d06-5e76-415a-ba78-98fb5c2ec383 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:15:17.217225 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1208d06-5e76-415a-ba78-98fb5c2ec383 service neutron] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:15:17.227481 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ac4d85-6fa7-4ec5-9b48-98f9ed8b6d10 admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:15:17.228548 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1164/2312] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:15:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 03 14:15:17.232767 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd37b41e-9b00-45fe-8688-59303c6da074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:15:17.233320 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd37b41e-9b00-45fe-8688-59303c6da074 admin admin] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:15:17.233603 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd37b41e-9b00-45fe-8688-59303c6da074 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:15:17.233950 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd37b41e-9b00-45fe-8688-59303c6da074 admin admin] PATH_INFO: `/v3/projects` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:15:17.234680 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd37b41e-9b00-45fe-8688-59303c6da074 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:15:17.236577 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd37b41e-9b00-45fe-8688-59303c6da074 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:15:17.272837 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1208d06-5e76-415a-ba78-98fb5c2ec383 service neutron] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:15:17.273601 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1149/2313] 10.222.0.36 () {60 vars in 1152 bytes} [Tue May 3 14:15:17 2022] POST /identity/v3/projects => generated 383 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 14:15:17.283905 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1208d06-5e76-415a-ba78-98fb5c2ec383 service neutron] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:15:17.348535 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367c0fc5-fb5d-4f41-bed0-e21027001123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:15:17.349645 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367c0fc5-fb5d-4f41-bed0-e21027001123 admin admin] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:15:17.349876 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367c0fc5-fb5d-4f41-bed0-e21027001123 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:15:17.351041 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367c0fc5-fb5d-4f41-bed0-e21027001123 admin admin] PATH_INFO: `/v3/users` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:15:17.351454 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367c0fc5-fb5d-4f41-bed0-e21027001123 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:15:17.353422 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367c0fc5-fb5d-4f41-bed0-e21027001123 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:15:17.385137 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1165/2314] 10.222.0.36 () {60 vars in 1143 bytes} [Tue May 3 14:15:17 2022] POST /identity/v3/users => generated 292 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 14:15:17.386864 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd37b41e-9b00-45fe-8688-59303c6da074 admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:15:17.397571 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd37b41e-9b00-45fe-8688-59303c6da074 admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:15:17.402194 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380d8f8e-e9dd-4841-b3bb-0f0e9adb98a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:15:17.402860 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380d8f8e-e9dd-4841-b3bb-0f0e9adb98a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:15:17.403135 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380d8f8e-e9dd-4841-b3bb-0f0e9adb98a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:15:17.403406 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380d8f8e-e9dd-4841-b3bb-0f0e9adb98a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:15:17.404479 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380d8f8e-e9dd-4841-b3bb-0f0e9adb98a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:15:17.406119 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380d8f8e-e9dd-4841-b3bb-0f0e9adb98a9 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:15:17.421583 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1150/2315] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 3 14:15:17 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 14:15:17.427914 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367c0fc5-fb5d-4f41-bed0-e21027001123 admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:15:17.453841 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367c0fc5-fb5d-4f41-bed0-e21027001123 admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:15:17.460293 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed03cbed-e23f-4462-90a2-efbdd4e4a753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:15:17.461276 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed03cbed-e23f-4462-90a2-efbdd4e4a753 admin admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:15:17.461585 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed03cbed-e23f-4462-90a2-efbdd4e4a753 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:15:17.461856 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed03cbed-e23f-4462-90a2-efbdd4e4a753 admin admin] PATH_INFO: `/v3/roles` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:15:17.462585 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed03cbed-e23f-4462-90a2-efbdd4e4a753 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:15:17.464356 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed03cbed-e23f-4462-90a2-efbdd4e4a753 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:15:17.477787 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1166/2316] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 3 14:15:17 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 14:15:17.480329 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380d8f8e-e9dd-4841-b3bb-0f0e9adb98a9 admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:15:17.491061 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380d8f8e-e9dd-4841-b3bb-0f0e9adb98a9 admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:15:17.496396 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a94405f-1618-4bb2-82d6-ad9fa524c295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:15:17.497668 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a94405f-1618-4bb2-82d6-ad9fa524c295 admin admin] REQUEST_METHOD: `PUT` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:15:17.498181 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a94405f-1618-4bb2-82d6-ad9fa524c295 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:15:17.498500 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a94405f-1618-4bb2-82d6-ad9fa524c295 admin admin] PATH_INFO: `/v3/projects/264ac49293a74c70840117e3c078a851/users/dab970d0bec8420284172fc574f26eac/roles/441fdc11e95b47f4813f72610e39018b` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:15:17.516123 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a94405f-1618-4bb2-82d6-ad9fa524c295 admin admin] RBAC: Authorizing `identity:create_grant(project_id=264ac49293a74c70840117e3c078a851, user_id=dab970d0bec8420284172fc574f26eac, role_id=441fdc11e95b47f4813f72610e39018b)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:15:17.519004 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a94405f-1618-4bb2-82d6-ad9fa524c295 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:15:17.536081 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1151/2317] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 3 14:15:17 2022] PUT /identity/v3/projects/264ac49293a74c70840117e3c078a851/users/dab970d0bec8420284172fc574f26eac/roles/441fdc11e95b47f4813f72610e39018b => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 14:15:17.548152 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae62a8c-8485-4fea-8905-1bc2262b43e1 None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:15:17.548554 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae62a8c-8485-4fea-8905-1bc2262b43e1 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:15:17.548890 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae62a8c-8485-4fea-8905-1bc2262b43e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:15:17.568721 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a94405f-1618-4bb2-82d6-ad9fa524c295 admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:15:17.570453 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-0a94405f-1618-4bb2-82d6-ad9fa524c295 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:15:17.578729 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-6ae62a8c-8485-4fea-8905-1bc2262b43e1 None None] MFA Rules not processed for user `dab970d0bec8420284172fc574f26eac`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:15:17.579931 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-6ae62a8c-8485-4fea-8905-1bc2262b43e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:15:17.638653 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a94405f-1618-4bb2-82d6-ad9fa524c295 admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:15:17.643585 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbb2f3e-6dd4-4022-8963-1c44130f3696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:15:17.644440 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbb2f3e-6dd4-4022-8963-1c44130f3696 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:15:17.644716 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbb2f3e-6dd4-4022-8963-1c44130f3696 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:15:17.644993 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbb2f3e-6dd4-4022-8963-1c44130f3696 admin admin] PATH_INFO: `/v3/projects/e78794eca21f426a9d844fe232498bd2` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:15:17.646188 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbb2f3e-6dd4-4022-8963-1c44130f3696 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e78794eca21f426a9d844fe232498bd2)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:15:17.648001 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1167/2318] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:15:17 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:15:17.648114 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbb2f3e-6dd4-4022-8963-1c44130f3696 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:15:17.649101 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4befbcd-1832-4393-aaef-2e2c6f4e21d3 None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:15:17.649420 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4befbcd-1832-4393-aaef-2e2c6f4e21d3 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:15:17.649699 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4befbcd-1832-4393-aaef-2e2c6f4e21d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:15:17.671395 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-c4befbcd-1832-4393-aaef-2e2c6f4e21d3 None None] MFA Rules not processed for user `7b05c6d36153485c9859ce7b749ab40c`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:15:17.672600 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-c4befbcd-1832-4393-aaef-2e2c6f4e21d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:15:17.706737 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-acbb2f3e-6dd4-4022-8963-1c44130f3696 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e78794eca21f426a9d844fe232498bd2', 'request_id': 'req-acbb2f3e-6dd4-4022-8963-1c44130f3696'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:15:17.715240 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-acbb2f3e-6dd4-4022-8963-1c44130f3696 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e78794eca21f426a9d844fe232498bd2', 'request_id': 'req-acbb2f3e-6dd4-4022-8963-1c44130f3696'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:15:17.721897 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-acbb2f3e-6dd4-4022-8963-1c44130f3696 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e78794eca21f426a9d844fe232498bd2', 'request_id': 'req-acbb2f3e-6dd4-4022-8963-1c44130f3696'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:15:17.738316 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1168/2319] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:15:17 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:15:17.741563 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4befbcd-1832-4393-aaef-2e2c6f4e21d3 None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:15:17.749734 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4befbcd-1832-4393-aaef-2e2c6f4e21d3 None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:15:17.752299 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-acbb2f3e-6dd4-4022-8963-1c44130f3696 admin admin] The token cache is being invalidate because project e78794eca21f426a9d844fe232498bd2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80012) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 14:15:17.755713 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-acbb2f3e-6dd4-4022-8963-1c44130f3696 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:15:17.756547 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-acbb2f3e-6dd4-4022-8963-1c44130f3696 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:15:17.759175 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1152/2320] 10.222.0.36 () {58 vars in 1232 bytes} [Tue May 3 14:15:17 2022] DELETE /identity/v3/projects/e78794eca21f426a9d844fe232498bd2 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 14:15:17.818613 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23b6686-941e-481b-8a26-0d605334156e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:15:17.819553 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23b6686-941e-481b-8a26-0d605334156e admin admin] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:15:17.819868 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23b6686-941e-481b-8a26-0d605334156e admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:15:17.820178 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23b6686-941e-481b-8a26-0d605334156e admin admin] PATH_INFO: `/v3/projects` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:15:17.820896 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23b6686-941e-481b-8a26-0d605334156e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:15:17.823000 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23b6686-941e-481b-8a26-0d605334156e admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:15:17.854278 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1169/2321] 10.222.0.36 () {60 vars in 1152 bytes} [Tue May 3 14:15:17 2022] POST /identity/v3/projects => generated 385 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 14:15:17.858779 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbb2f3e-6dd4-4022-8963-1c44130f3696 admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:15:17.860354 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-acbb2f3e-6dd4-4022-8963-1c44130f3696 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:15:17.877860 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbb2f3e-6dd4-4022-8963-1c44130f3696 admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:15:17.991572 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974c6f34-2d3b-4882-a436-9f3080c69a00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:15:17.993177 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974c6f34-2d3b-4882-a436-9f3080c69a00 admin admin] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:15:17.993694 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974c6f34-2d3b-4882-a436-9f3080c69a00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:15:17.994174 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974c6f34-2d3b-4882-a436-9f3080c69a00 admin admin] PATH_INFO: `/v3/users` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:15:17.995278 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974c6f34-2d3b-4882-a436-9f3080c69a00 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:15:17.997815 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974c6f34-2d3b-4882-a436-9f3080c69a00 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:15:18.026088 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1153/2322] 10.222.0.36 () {60 vars in 1143 bytes} [Tue May 3 14:15:17 2022] POST /identity/v3/users => generated 293 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 14:15:18.032346 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23b6686-941e-481b-8a26-0d605334156e admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:15:18.055118 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23b6686-941e-481b-8a26-0d605334156e admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:15:18.078451 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc6e4c6-c850-4e81-bfaa-2711a59d5dc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:15:18.083610 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc6e4c6-c850-4e81-bfaa-2711a59d5dc7 admin admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:15:18.084226 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc6e4c6-c850-4e81-bfaa-2711a59d5dc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:15:18.084226 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc6e4c6-c850-4e81-bfaa-2711a59d5dc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:15:18.084910 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc6e4c6-c850-4e81-bfaa-2711a59d5dc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:15:18.086876 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc6e4c6-c850-4e81-bfaa-2711a59d5dc7 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:15:18.109863 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1170/2323] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 3 14:15:18 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 14:15:18.113616 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974c6f34-2d3b-4882-a436-9f3080c69a00 admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:15:18.128014 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974c6f34-2d3b-4882-a436-9f3080c69a00 admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:15:18.133607 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2676610-774c-4e6a-9ff7-9cdff85e46b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:15:18.134563 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2676610-774c-4e6a-9ff7-9cdff85e46b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:15:18.134854 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2676610-774c-4e6a-9ff7-9cdff85e46b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:15:18.135124 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2676610-774c-4e6a-9ff7-9cdff85e46b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:15:18.135863 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2676610-774c-4e6a-9ff7-9cdff85e46b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:15:18.137617 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2676610-774c-4e6a-9ff7-9cdff85e46b1 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:15:18.165349 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1154/2324] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 3 14:15:18 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 14:15:18.171978 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc6e4c6-c850-4e81-bfaa-2711a59d5dc7 admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:15:18.189593 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc6e4c6-c850-4e81-bfaa-2711a59d5dc7 admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:15:18.195777 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7960fdf3-86e7-411b-ac1d-cd9648e45524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:15:18.196909 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7960fdf3-86e7-411b-ac1d-cd9648e45524 admin admin] REQUEST_METHOD: `PUT` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:15:18.197258 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7960fdf3-86e7-411b-ac1d-cd9648e45524 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:15:18.197605 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7960fdf3-86e7-411b-ac1d-cd9648e45524 admin admin] PATH_INFO: `/v3/projects/5dfb907e265a473087977ccb7b98af77/users/ec59e70a39214055965244312497905a/roles/441fdc11e95b47f4813f72610e39018b` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:15:18.234950 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7960fdf3-86e7-411b-ac1d-cd9648e45524 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5dfb907e265a473087977ccb7b98af77, user_id=ec59e70a39214055965244312497905a, role_id=441fdc11e95b47f4813f72610e39018b)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:15:18.238060 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7960fdf3-86e7-411b-ac1d-cd9648e45524 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:15:18.264542 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1171/2325] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 3 14:15:18 2022] PUT /identity/v3/projects/5dfb907e265a473087977ccb7b98af77/users/ec59e70a39214055965244312497905a/roles/441fdc11e95b47f4813f72610e39018b => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:15:18.276053 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075d08ff-4980-4761-8d74-22111e86aacc None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:15:18.276451 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075d08ff-4980-4761-8d74-22111e86aacc None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:15:18.276607 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075d08ff-4980-4761-8d74-22111e86aacc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:15:18.341027 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-075d08ff-4980-4761-8d74-22111e86aacc None None] MFA Rules not processed for user `ec59e70a39214055965244312497905a`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:15:18.342625 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-075d08ff-4980-4761-8d74-22111e86aacc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:15:18.480944 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1155/2326] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:15:18 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:15:18.485646 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7960fdf3-86e7-411b-ac1d-cd9648e45524 admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:15:18.558122 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7960fdf3-86e7-411b-ac1d-cd9648e45524 admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:15:18.562913 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344bcf63-fcc0-4b56-9b5f-900a924ada2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:15:18.563575 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344bcf63-fcc0-4b56-9b5f-900a924ada2e admin admin] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:15:18.563846 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344bcf63-fcc0-4b56-9b5f-900a924ada2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:15:18.564113 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344bcf63-fcc0-4b56-9b5f-900a924ada2e admin admin] PATH_INFO: `/v3/projects` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:15:18.564795 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344bcf63-fcc0-4b56-9b5f-900a924ada2e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:15:18.566745 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344bcf63-fcc0-4b56-9b5f-900a924ada2e admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:15:18.594955 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1172/2327] 10.222.0.36 () {60 vars in 1152 bytes} [Tue May 3 14:15:18 2022] POST /identity/v3/projects => generated 381 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 14:15:18.599250 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075d08ff-4980-4761-8d74-22111e86aacc None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:15:18.612401 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075d08ff-4980-4761-8d74-22111e86aacc None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:15:18.693343 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86fa52f-808a-41ec-9932-6ba111727816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:15:18.694214 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86fa52f-808a-41ec-9932-6ba111727816 admin admin] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:15:18.694498 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86fa52f-808a-41ec-9932-6ba111727816 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:15:18.694784 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86fa52f-808a-41ec-9932-6ba111727816 admin admin] PATH_INFO: `/v3/users` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:15:18.695490 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86fa52f-808a-41ec-9932-6ba111727816 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:15:18.697485 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86fa52f-808a-41ec-9932-6ba111727816 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:15:18.719278 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1156/2328] 10.222.0.36 () {60 vars in 1143 bytes} [Tue May 3 14:15:18 2022] POST /identity/v3/users => generated 297 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 14:15:18.723296 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344bcf63-fcc0-4b56-9b5f-900a924ada2e admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:15:18.734345 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344bcf63-fcc0-4b56-9b5f-900a924ada2e admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:15:18.740448 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efe1fb0-2bd6-4681-a675-3d5b7acf44c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:15:18.741171 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efe1fb0-2bd6-4681-a675-3d5b7acf44c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:15:18.741489 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efe1fb0-2bd6-4681-a675-3d5b7acf44c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:15:18.741765 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efe1fb0-2bd6-4681-a675-3d5b7acf44c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:15:18.742555 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efe1fb0-2bd6-4681-a675-3d5b7acf44c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:15:18.744251 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efe1fb0-2bd6-4681-a675-3d5b7acf44c3 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:15:18.761188 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1173/2329] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 3 14:15:18 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 14:15:18.762668 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86fa52f-808a-41ec-9932-6ba111727816 admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:15:18.774547 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86fa52f-808a-41ec-9932-6ba111727816 admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:15:18.779836 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf74a7f9-9a76-45ce-836b-732228688254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:15:18.781012 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf74a7f9-9a76-45ce-836b-732228688254 admin admin] REQUEST_METHOD: `PUT` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:15:18.781144 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf74a7f9-9a76-45ce-836b-732228688254 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:15:18.781353 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf74a7f9-9a76-45ce-836b-732228688254 admin admin] PATH_INFO: `/v3/projects/5880172480174676a9e9541921f3b4d5/users/53d7f23fb9754d9198adc46babcd27f2/roles/36abe9b50fd8479c86c4f8f70fd85aa3` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:15:18.798000 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf74a7f9-9a76-45ce-836b-732228688254 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5880172480174676a9e9541921f3b4d5, user_id=53d7f23fb9754d9198adc46babcd27f2, role_id=36abe9b50fd8479c86c4f8f70fd85aa3)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:15:18.800803 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf74a7f9-9a76-45ce-836b-732228688254 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:15:18.829028 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1157/2330] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 3 14:15:18 2022] PUT /identity/v3/projects/5880172480174676a9e9541921f3b4d5/users/53d7f23fb9754d9198adc46babcd27f2/roles/36abe9b50fd8479c86c4f8f70fd85aa3 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 14:15:18.832607 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efe1fb0-2bd6-4681-a675-3d5b7acf44c3 admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:15:18.845704 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efe1fb0-2bd6-4681-a675-3d5b7acf44c3 admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:15:18.931257 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f764d5-f1a9-44ba-981f-2fd918603259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:15:18.931959 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f764d5-f1a9-44ba-981f-2fd918603259 admin admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:15:18.932240 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f764d5-f1a9-44ba-981f-2fd918603259 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:15:18.932511 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f764d5-f1a9-44ba-981f-2fd918603259 admin admin] PATH_INFO: `/v3/roles` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:15:18.933305 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f764d5-f1a9-44ba-981f-2fd918603259 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:15:18.936024 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f764d5-f1a9-44ba-981f-2fd918603259 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:15:18.951965 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf74a7f9-9a76-45ce-836b-732228688254 admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:15:18.952978 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1174/2331] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 3 14:15:18 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 14:15:18.963233 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf74a7f9-9a76-45ce-836b-732228688254 admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:15:18.970052 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f8e592-c78d-4a3e-9d6a-df05ef31f507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:15:18.971018 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f8e592-c78d-4a3e-9d6a-df05ef31f507 admin admin] REQUEST_METHOD: `PUT` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:15:18.971361 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f8e592-c78d-4a3e-9d6a-df05ef31f507 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:15:18.971656 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f8e592-c78d-4a3e-9d6a-df05ef31f507 admin admin] PATH_INFO: `/v3/projects/5880172480174676a9e9541921f3b4d5/users/53d7f23fb9754d9198adc46babcd27f2/roles/36abe9b50fd8479c86c4f8f70fd85aa3` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:15:18.975595 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f8e592-c78d-4a3e-9d6a-df05ef31f507 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5880172480174676a9e9541921f3b4d5, user_id=53d7f23fb9754d9198adc46babcd27f2, role_id=36abe9b50fd8479c86c4f8f70fd85aa3)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:15:18.979470 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f8e592-c78d-4a3e-9d6a-df05ef31f507 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:15:18.993901 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1158/2332] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 3 14:15:18 2022] PUT /identity/v3/projects/5880172480174676a9e9541921f3b4d5/users/53d7f23fb9754d9198adc46babcd27f2/roles/36abe9b50fd8479c86c4f8f70fd85aa3 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 14:15:19.003951 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917df02c-fdd1-430b-a695-9de12f7a589a None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:15:19.004083 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917df02c-fdd1-430b-a695-9de12f7a589a None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:15:19.005132 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917df02c-fdd1-430b-a695-9de12f7a589a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:15:19.041075 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-917df02c-fdd1-430b-a695-9de12f7a589a None None] MFA Rules not processed for user `53d7f23fb9754d9198adc46babcd27f2`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:15:19.042411 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-917df02c-fdd1-430b-a695-9de12f7a589a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:15:19.137250 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1175/2333] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:15:19 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:15:19.153033 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f8e592-c78d-4a3e-9d6a-df05ef31f507 admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:15:19.156235 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-b0f8e592-c78d-4a3e-9d6a-df05ef31f507 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:15:19.236062 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f8e592-c78d-4a3e-9d6a-df05ef31f507 admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:15:19.239679 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996c0b89-bcf9-4107-a81b-2b2b6af50f10 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b014f4c7ba1414cb8a597f5bc4033f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:15:19.240333 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996c0b89-bcf9-4107-a81b-2b2b6af50f10 service cinder] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:15:19.240613 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996c0b89-bcf9-4107-a81b-2b2b6af50f10 service cinder] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:15:19.240893 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996c0b89-bcf9-4107-a81b-2b2b6af50f10 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:15:19.242719 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-996c0b89-bcf9-4107-a81b-2b2b6af50f10 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:15:19.309340 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996c0b89-bcf9-4107-a81b-2b2b6af50f10 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:15:19.311401 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996c0b89-bcf9-4107-a81b-2b2b6af50f10 service cinder] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:15:19.321321 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1159/2334] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:15:19 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 14:15:20.931371 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917df02c-fdd1-430b-a695-9de12f7a589a None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:15:20.936449 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-917df02c-fdd1-430b-a695-9de12f7a589a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:15:20.961387 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917df02c-fdd1-430b-a695-9de12f7a589a None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:15:20.966197 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9536a0-fffd-43a7-b1fc-05423a71f4ef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b014f4c7ba1414cb8a597f5bc4033f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:15:20.967359 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9536a0-fffd-43a7-b1fc-05423a71f4ef service cinder] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:15:20.968127 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9536a0-fffd-43a7-b1fc-05423a71f4ef service cinder] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:15:20.968773 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9536a0-fffd-43a7-b1fc-05423a71f4ef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:15:21.049914 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9536a0-fffd-43a7-b1fc-05423a71f4ef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:15:21.051382 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9536a0-fffd-43a7-b1fc-05423a71f4ef service cinder] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:15:21.077501 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1176/2335] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:15:20 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 14:15:21.446162 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c7369c-373e-447d-aefe-4c2d9ea77ab3 None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:15:21.447363 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c7369c-373e-447d-aefe-4c2d9ea77ab3 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:15:21.447963 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c7369c-373e-447d-aefe-4c2d9ea77ab3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:15:21.471084 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-52c7369c-373e-447d-aefe-4c2d9ea77ab3 None None] MFA Rules not processed for user `38de7546d3524382b4589def32732e6e`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:15:21.475442 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-52c7369c-373e-447d-aefe-4c2d9ea77ab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:15:21.562972 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1160/2336] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:15:21 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:15:21.811932 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9536a0-fffd-43a7-b1fc-05423a71f4ef service cinder] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:15:21.821019 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9536a0-fffd-43a7-b1fc-05423a71f4ef service cinder] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:15:21.824749 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7f85b8-7776-40d3-80bf-b1b3adbf76d9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b014f4c7ba1414cb8a597f5bc4033f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:15:21.825684 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7f85b8-7776-40d3-80bf-b1b3adbf76d9 service cinder] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:15:21.826031 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7f85b8-7776-40d3-80bf-b1b3adbf76d9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:15:21.826434 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7f85b8-7776-40d3-80bf-b1b3adbf76d9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:15:21.836362 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7f85b8-7776-40d3-80bf-b1b3adbf76d9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:15:21.837841 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7f85b8-7776-40d3-80bf-b1b3adbf76d9 service cinder] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:15:21.848515 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1177/2337] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:15:21 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 14:15:25.867773 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c7369c-373e-447d-aefe-4c2d9ea77ab3 None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:15:25.950000 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c7369c-373e-447d-aefe-4c2d9ea77ab3 None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:15:25.954888 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8013025b-705a-4d97-a718-c9c511975dd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:15:25.955775 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8013025b-705a-4d97-a718-c9c511975dd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:15:25.956054 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8013025b-705a-4d97-a718-c9c511975dd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:15:25.956327 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8013025b-705a-4d97-a718-c9c511975dd5 admin admin] PATH_INFO: `/v3/users/dab970d0bec8420284172fc574f26eac` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:15:25.957544 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8013025b-705a-4d97-a718-c9c511975dd5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dab970d0bec8420284172fc574f26eac)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:15:25.959447 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8013025b-705a-4d97-a718-c9c511975dd5 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:15:26.024400 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-8013025b-705a-4d97-a718-c9c511975dd5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dab970d0bec8420284172fc574f26eac'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:15:26.034781 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-8013025b-705a-4d97-a718-c9c511975dd5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dab970d0bec8420284172fc574f26eac'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:15:26.035608 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-8013025b-705a-4d97-a718-c9c511975dd5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dab970d0bec8420284172fc574f26eac'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:15:26.053555 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-8013025b-705a-4d97-a718-c9c511975dd5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dab970d0bec8420284172fc574f26eac'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:15:26.054432 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-8013025b-705a-4d97-a718-c9c511975dd5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dab970d0bec8420284172fc574f26eac'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:15:26.087240 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1161/2338] 10.222.0.36 () {58 vars in 1223 bytes} [Tue May 3 14:15:25 2022] DELETE /identity/v3/users/dab970d0bec8420284172fc574f26eac => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:15:26.092222 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd08a125-759d-491b-99b5-433282839a91 None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:15:26.093073 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd08a125-759d-491b-99b5-433282839a91 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:15:26.093536 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd08a125-759d-491b-99b5-433282839a91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:15:26.119682 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-fd08a125-759d-491b-99b5-433282839a91 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:15:26.121682 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-fd08a125-759d-491b-99b5-433282839a91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:15:26.194613 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1178/2339] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:15:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:15:26.206777 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8013025b-705a-4d97-a718-c9c511975dd5 admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:15:26.208049 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-8013025b-705a-4d97-a718-c9c511975dd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:15:26.293049 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8013025b-705a-4d97-a718-c9c511975dd5 admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:15:26.297961 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b69ea2-7632-433e-adae-b9e01613aead service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '937bea4f355144b4a7ee11baabc3a4cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:15:26.298928 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b69ea2-7632-433e-adae-b9e01613aead service neutron] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:15:26.299982 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b69ea2-7632-433e-adae-b9e01613aead service neutron] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:15:26.299982 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b69ea2-7632-433e-adae-b9e01613aead service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:15:26.311020 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b69ea2-7632-433e-adae-b9e01613aead service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:15:26.312615 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b69ea2-7632-433e-adae-b9e01613aead service neutron] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:15:26.325078 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1162/2340] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:15:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 14:15:26.809953 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd08a125-759d-491b-99b5-433282839a91 None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:15:26.811403 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-fd08a125-759d-491b-99b5-433282839a91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:15:26.825969 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd08a125-759d-491b-99b5-433282839a91 None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:15:26.836096 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb2e96f-5693-420f-a1aa-34a63941445d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:15:26.837889 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb2e96f-5693-420f-a1aa-34a63941445d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:15:26.838677 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb2e96f-5693-420f-a1aa-34a63941445d admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:15:26.838952 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb2e96f-5693-420f-a1aa-34a63941445d admin admin] PATH_INFO: `/v3/projects/264ac49293a74c70840117e3c078a851` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:15:26.840549 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb2e96f-5693-420f-a1aa-34a63941445d admin admin] RBAC: Authorizing `identity:delete_project(project_id=264ac49293a74c70840117e3c078a851)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:15:26.842732 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb2e96f-5693-420f-a1aa-34a63941445d admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:15:26.903366 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-dbb2e96f-5693-420f-a1aa-34a63941445d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '264ac49293a74c70840117e3c078a851', 'request_id': 'req-dbb2e96f-5693-420f-a1aa-34a63941445d'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:15:26.910583 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-dbb2e96f-5693-420f-a1aa-34a63941445d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '264ac49293a74c70840117e3c078a851', 'request_id': 'req-dbb2e96f-5693-420f-a1aa-34a63941445d'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:15:26.924763 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-dbb2e96f-5693-420f-a1aa-34a63941445d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '264ac49293a74c70840117e3c078a851', 'request_id': 'req-dbb2e96f-5693-420f-a1aa-34a63941445d'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:15:26.942924 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-dbb2e96f-5693-420f-a1aa-34a63941445d admin admin] The token cache is being invalidate because project 264ac49293a74c70840117e3c078a851 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80013) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 14:15:26.943367 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-dbb2e96f-5693-420f-a1aa-34a63941445d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:15:26.944259 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-dbb2e96f-5693-420f-a1aa-34a63941445d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:15:26.946516 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1179/2341] 10.222.0.36 () {58 vars in 1232 bytes} [Tue May 3 14:15:26 2022] DELETE /identity/v3/projects/264ac49293a74c70840117e3c078a851 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:15:26.950203 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b69ea2-7632-433e-adae-b9e01613aead service neutron] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:15:26.960735 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b69ea2-7632-433e-adae-b9e01613aead service neutron] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:15:27.026306 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc70c86a-cda9-4847-a253-68483835ddc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:15:27.027194 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc70c86a-cda9-4847-a253-68483835ddc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:15:27.027475 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc70c86a-cda9-4847-a253-68483835ddc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:15:27.027753 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc70c86a-cda9-4847-a253-68483835ddc6 admin admin] PATH_INFO: `/v3/users/ec59e70a39214055965244312497905a` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:15:27.029030 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc70c86a-cda9-4847-a253-68483835ddc6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec59e70a39214055965244312497905a)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:15:27.031395 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc70c86a-cda9-4847-a253-68483835ddc6 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:15:27.093927 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-fc70c86a-cda9-4847-a253-68483835ddc6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec59e70a39214055965244312497905a'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:15:27.101009 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-fc70c86a-cda9-4847-a253-68483835ddc6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec59e70a39214055965244312497905a'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:15:27.101865 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-fc70c86a-cda9-4847-a253-68483835ddc6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec59e70a39214055965244312497905a'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:15:27.114959 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-fc70c86a-cda9-4847-a253-68483835ddc6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec59e70a39214055965244312497905a'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:15:27.115680 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-fc70c86a-cda9-4847-a253-68483835ddc6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec59e70a39214055965244312497905a'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:15:27.132796 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1163/2342] 10.222.0.36 () {58 vars in 1223 bytes} [Tue May 3 14:15:26 2022] DELETE /identity/v3/users/ec59e70a39214055965244312497905a => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 14:15:27.530600 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb2e96f-5693-420f-a1aa-34a63941445d admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:15:27.534246 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-dbb2e96f-5693-420f-a1aa-34a63941445d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:15:27.555226 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb2e96f-5693-420f-a1aa-34a63941445d admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:15:27.624894 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b2b80d-ffca-476f-9f05-8457a2136de4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:15:27.626128 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b2b80d-ffca-476f-9f05-8457a2136de4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:15:27.626513 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b2b80d-ffca-476f-9f05-8457a2136de4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:15:27.627022 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b2b80d-ffca-476f-9f05-8457a2136de4 admin admin] PATH_INFO: `/v3/projects/5dfb907e265a473087977ccb7b98af77` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:15:27.628573 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b2b80d-ffca-476f-9f05-8457a2136de4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5dfb907e265a473087977ccb7b98af77)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:15:27.633393 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b2b80d-ffca-476f-9f05-8457a2136de4 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:15:27.705639 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-59b2b80d-ffca-476f-9f05-8457a2136de4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5dfb907e265a473087977ccb7b98af77', 'request_id': 'req-59b2b80d-ffca-476f-9f05-8457a2136de4'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:15:27.711933 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-59b2b80d-ffca-476f-9f05-8457a2136de4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5dfb907e265a473087977ccb7b98af77', 'request_id': 'req-59b2b80d-ffca-476f-9f05-8457a2136de4'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:15:27.727328 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-59b2b80d-ffca-476f-9f05-8457a2136de4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5dfb907e265a473087977ccb7b98af77', 'request_id': 'req-59b2b80d-ffca-476f-9f05-8457a2136de4'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:15:27.742072 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-59b2b80d-ffca-476f-9f05-8457a2136de4 admin admin] The token cache is being invalidate because project 5dfb907e265a473087977ccb7b98af77 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80013) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 14:15:27.742359 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-59b2b80d-ffca-476f-9f05-8457a2136de4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:15:27.743209 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-59b2b80d-ffca-476f-9f05-8457a2136de4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:15:27.744867 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1180/2343] 10.222.0.36 () {58 vars in 1232 bytes} [Tue May 3 14:15:27 2022] DELETE /identity/v3/projects/5dfb907e265a473087977ccb7b98af77 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:15:27.749056 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc70c86a-cda9-4847-a253-68483835ddc6 admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:15:27.751065 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-fc70c86a-cda9-4847-a253-68483835ddc6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:15:27.765276 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc70c86a-cda9-4847-a253-68483835ddc6 admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:15:27.828346 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae37ef6-0205-4173-bb4e-1bdcc18a38c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:15:27.829656 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae37ef6-0205-4173-bb4e-1bdcc18a38c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:15:27.829935 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae37ef6-0205-4173-bb4e-1bdcc18a38c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:15:27.830530 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae37ef6-0205-4173-bb4e-1bdcc18a38c5 admin admin] PATH_INFO: `/v3/users/53d7f23fb9754d9198adc46babcd27f2` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:15:27.832074 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae37ef6-0205-4173-bb4e-1bdcc18a38c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=53d7f23fb9754d9198adc46babcd27f2)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:15:27.835053 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae37ef6-0205-4173-bb4e-1bdcc18a38c5 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:15:27.900563 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-dae37ef6-0205-4173-bb4e-1bdcc18a38c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53d7f23fb9754d9198adc46babcd27f2'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:15:27.908834 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-dae37ef6-0205-4173-bb4e-1bdcc18a38c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53d7f23fb9754d9198adc46babcd27f2'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:15:27.909725 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-dae37ef6-0205-4173-bb4e-1bdcc18a38c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53d7f23fb9754d9198adc46babcd27f2'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:15:27.924437 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-dae37ef6-0205-4173-bb4e-1bdcc18a38c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53d7f23fb9754d9198adc46babcd27f2'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:15:27.927640 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-dae37ef6-0205-4173-bb4e-1bdcc18a38c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53d7f23fb9754d9198adc46babcd27f2'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:15:27.942476 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1164/2344] 10.222.0.36 () {58 vars in 1223 bytes} [Tue May 3 14:15:27 2022] DELETE /identity/v3/users/53d7f23fb9754d9198adc46babcd27f2 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:15:28.327972 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b2b80d-ffca-476f-9f05-8457a2136de4 admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:15:28.330310 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-59b2b80d-ffca-476f-9f05-8457a2136de4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:15:28.358370 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b2b80d-ffca-476f-9f05-8457a2136de4 admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:15:28.384626 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae37ef6-0205-4173-bb4e-1bdcc18a38c5 admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:15:28.386838 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-dae37ef6-0205-4173-bb4e-1bdcc18a38c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:15:28.452287 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7238f78-3a57-445d-a8b1-77fff693c9af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:15:28.453152 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7238f78-3a57-445d-a8b1-77fff693c9af admin admin] REQUEST_METHOD: `DELETE` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:15:28.453459 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7238f78-3a57-445d-a8b1-77fff693c9af admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:15:28.453732 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7238f78-3a57-445d-a8b1-77fff693c9af admin admin] PATH_INFO: `/v3/projects/5880172480174676a9e9541921f3b4d5` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:15:28.454932 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7238f78-3a57-445d-a8b1-77fff693c9af admin admin] RBAC: Authorizing `identity:delete_project(project_id=5880172480174676a9e9541921f3b4d5)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:15:28.456878 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7238f78-3a57-445d-a8b1-77fff693c9af admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:15:28.461426 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae37ef6-0205-4173-bb4e-1bdcc18a38c5 admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:15:28.467494 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ccf69c-cf79-49f6-9468-35a7a3d5aff1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '937bea4f355144b4a7ee11baabc3a4cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:15:28.468342 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ccf69c-cf79-49f6-9468-35a7a3d5aff1 service neutron] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:15:28.468621 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ccf69c-cf79-49f6-9468-35a7a3d5aff1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:15:28.470202 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ccf69c-cf79-49f6-9468-35a7a3d5aff1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:15:28.473695 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-62ccf69c-cf79-49f6-9468-35a7a3d5aff1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:15:28.512244 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-e7238f78-3a57-445d-a8b1-77fff693c9af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5880172480174676a9e9541921f3b4d5', 'request_id': 'req-e7238f78-3a57-445d-a8b1-77fff693c9af'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:15:28.518560 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-e7238f78-3a57-445d-a8b1-77fff693c9af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5880172480174676a9e9541921f3b4d5', 'request_id': 'req-e7238f78-3a57-445d-a8b1-77fff693c9af'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:15:28.526697 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-e7238f78-3a57-445d-a8b1-77fff693c9af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5880172480174676a9e9541921f3b4d5', 'request_id': 'req-e7238f78-3a57-445d-a8b1-77fff693c9af'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:15:28.543115 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-e7238f78-3a57-445d-a8b1-77fff693c9af admin admin] The token cache is being invalidate because project 5880172480174676a9e9541921f3b4d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80013) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 14:15:28.543772 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-e7238f78-3a57-445d-a8b1-77fff693c9af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:15:28.544319 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-e7238f78-3a57-445d-a8b1-77fff693c9af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:15:28.545761 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ccf69c-cf79-49f6-9468-35a7a3d5aff1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:15:28.546848 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1181/2345] 10.222.0.36 () {58 vars in 1232 bytes} [Tue May 3 14:15:28 2022] DELETE /identity/v3/projects/5880172480174676a9e9541921f3b4d5 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:15:28.551728 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ccf69c-cf79-49f6-9468-35a7a3d5aff1 service neutron] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:15:28.553181 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59747de-2a76-44d2-b4ac-3331f3298f98 None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:15:28.554198 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59747de-2a76-44d2-b4ac-3331f3298f98 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:15:28.554198 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59747de-2a76-44d2-b4ac-3331f3298f98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:15:28.564033 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1165/2346] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:15:28 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 03 14:15:28.608314 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-b59747de-2a76-44d2-b4ac-3331f3298f98 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:15:28.609676 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-b59747de-2a76-44d2-b4ac-3331f3298f98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:15:28.687001 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1182/2347] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:15:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 14:15:28.699011 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de2d232-8a8c-461b-8cc9-235150f6780f None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:15:28.699280 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de2d232-8a8c-461b-8cc9-235150f6780f None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:15:28.699594 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de2d232-8a8c-461b-8cc9-235150f6780f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:15:28.718653 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-1de2d232-8a8c-461b-8cc9-235150f6780f None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:15:28.719850 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-1de2d232-8a8c-461b-8cc9-235150f6780f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:15:28.728080 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1166/2348] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:15:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:15:28.732218 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59747de-2a76-44d2-b4ac-3331f3298f98 None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:15:28.742527 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59747de-2a76-44d2-b4ac-3331f3298f98 None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:15:28.749192 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58100e5d-c57b-473d-ba7e-2db7569e5cc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:15:28.749901 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58100e5d-c57b-473d-ba7e-2db7569e5cc9 admin admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:15:28.750178 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58100e5d-c57b-473d-ba7e-2db7569e5cc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:15:28.750464 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58100e5d-c57b-473d-ba7e-2db7569e5cc9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:15:28.751280 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58100e5d-c57b-473d-ba7e-2db7569e5cc9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:15:28.751582 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58100e5d-c57b-473d-ba7e-2db7569e5cc9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:15:28.753233 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58100e5d-c57b-473d-ba7e-2db7569e5cc9 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:15:28.774255 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1183/2349] 10.222.0.36 () {58 vars in 1152 bytes} [Tue May 3 14:15:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 14:15:28.775558 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de2d232-8a8c-461b-8cc9-235150f6780f None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:15:28.787546 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de2d232-8a8c-461b-8cc9-235150f6780f None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:15:28.793540 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfdbe4d-ffc1-45e5-a9be-e9fd6b2673a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:15:28.794206 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfdbe4d-ffc1-45e5-a9be-e9fd6b2673a5 admin admin] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:15:28.794958 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfdbe4d-ffc1-45e5-a9be-e9fd6b2673a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:15:28.795476 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfdbe4d-ffc1-45e5-a9be-e9fd6b2673a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:15:28.796318 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfdbe4d-ffc1-45e5-a9be-e9fd6b2673a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:15:28.798509 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfdbe4d-ffc1-45e5-a9be-e9fd6b2673a5 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:15:28.836809 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1167/2350] 10.222.0.36 () {60 vars in 1152 bytes} [Tue May 3 14:15:28 2022] POST /identity/v3/projects => generated 385 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 14:15:28.841432 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58100e5d-c57b-473d-ba7e-2db7569e5cc9 admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:15:28.857113 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58100e5d-c57b-473d-ba7e-2db7569e5cc9 admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:15:28.923710 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d8af92-d123-4da7-95a0-ce7727496146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:15:28.924386 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d8af92-d123-4da7-95a0-ce7727496146 admin admin] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:15:28.924658 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d8af92-d123-4da7-95a0-ce7727496146 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:15:28.924927 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d8af92-d123-4da7-95a0-ce7727496146 admin admin] PATH_INFO: `/v3/users` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:15:28.925671 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d8af92-d123-4da7-95a0-ce7727496146 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:15:28.927579 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d8af92-d123-4da7-95a0-ce7727496146 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:15:28.955490 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1184/2351] 10.222.0.36 () {60 vars in 1143 bytes} [Tue May 3 14:15:28 2022] POST /identity/v3/users => generated 293 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 14:15:28.956730 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfdbe4d-ffc1-45e5-a9be-e9fd6b2673a5 admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:15:28.967069 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfdbe4d-ffc1-45e5-a9be-e9fd6b2673a5 admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:15:28.971705 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973b95e0-8ab4-411f-9184-2d5dc6e0ba63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:15:28.972362 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973b95e0-8ab4-411f-9184-2d5dc6e0ba63 admin admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:15:28.972637 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973b95e0-8ab4-411f-9184-2d5dc6e0ba63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:15:28.972910 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973b95e0-8ab4-411f-9184-2d5dc6e0ba63 admin admin] PATH_INFO: `/v3/roles` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:15:28.973744 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973b95e0-8ab4-411f-9184-2d5dc6e0ba63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:15:28.975542 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973b95e0-8ab4-411f-9184-2d5dc6e0ba63 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:15:28.986858 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1168/2352] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 3 14:15:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 14:15:28.993195 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d8af92-d123-4da7-95a0-ce7727496146 admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:15:29.006374 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d8af92-d123-4da7-95a0-ce7727496146 admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:15:29.026433 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7e90a9-3601-4fad-9f41-2530813f6e92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:15:29.027120 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7e90a9-3601-4fad-9f41-2530813f6e92 admin admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:15:29.027396 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7e90a9-3601-4fad-9f41-2530813f6e92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:15:29.027665 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7e90a9-3601-4fad-9f41-2530813f6e92 admin admin] PATH_INFO: `/v3/roles` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:15:29.029147 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7e90a9-3601-4fad-9f41-2530813f6e92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:15:29.030787 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7e90a9-3601-4fad-9f41-2530813f6e92 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:15:29.042841 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1185/2353] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 3 14:15:28 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 14:15:29.047416 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973b95e0-8ab4-411f-9184-2d5dc6e0ba63 admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:15:29.057349 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973b95e0-8ab4-411f-9184-2d5dc6e0ba63 admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:15:29.069903 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9fd37b-428a-44bf-a427-1941e861cec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:15:29.070963 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9fd37b-428a-44bf-a427-1941e861cec3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:15:29.071247 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9fd37b-428a-44bf-a427-1941e861cec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:15:29.071523 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9fd37b-428a-44bf-a427-1941e861cec3 admin admin] PATH_INFO: `/v3/projects/3b8ba9c5407543549139ccedc3068f38/users/821a5125ae1f4b27bce23fea21ae67b6/roles/441fdc11e95b47f4813f72610e39018b` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:15:29.099621 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9fd37b-428a-44bf-a427-1941e861cec3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b8ba9c5407543549139ccedc3068f38, user_id=821a5125ae1f4b27bce23fea21ae67b6, role_id=441fdc11e95b47f4813f72610e39018b)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:15:29.102672 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9fd37b-428a-44bf-a427-1941e861cec3 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:15:29.123720 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1169/2354] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 3 14:15:29 2022] PUT /identity/v3/projects/3b8ba9c5407543549139ccedc3068f38/users/821a5125ae1f4b27bce23fea21ae67b6/roles/441fdc11e95b47f4813f72610e39018b => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:15:29.135307 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2c6fbc-0e39-4f52-9d8f-bc3b0a8da15f None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:15:29.135595 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2c6fbc-0e39-4f52-9d8f-bc3b0a8da15f None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:15:29.136037 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2c6fbc-0e39-4f52-9d8f-bc3b0a8da15f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:15:29.169947 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-6b2c6fbc-0e39-4f52-9d8f-bc3b0a8da15f None None] MFA Rules not processed for user `821a5125ae1f4b27bce23fea21ae67b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:15:29.171327 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-6b2c6fbc-0e39-4f52-9d8f-bc3b0a8da15f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:15:29.261760 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1186/2355] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:15:29 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:15:29.276689 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9fd37b-428a-44bf-a427-1941e861cec3 admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:15:29.279842 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-7d9fd37b-428a-44bf-a427-1941e861cec3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:15:29.360166 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9fd37b-428a-44bf-a427-1941e861cec3 admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:15:29.363969 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ea61de-37be-4c69-bc34-187aaedaf3c9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b014f4c7ba1414cb8a597f5bc4033f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:15:29.364761 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ea61de-37be-4c69-bc34-187aaedaf3c9 service cinder] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:15:29.365141 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ea61de-37be-4c69-bc34-187aaedaf3c9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:15:29.365516 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ea61de-37be-4c69-bc34-187aaedaf3c9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:15:29.376005 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ea61de-37be-4c69-bc34-187aaedaf3c9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:15:29.377493 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ea61de-37be-4c69-bc34-187aaedaf3c9 service cinder] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:15:29.387061 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1170/2356] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:15:29 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 14:15:30.888321 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b81e8c-dffb-4ffd-b40c-6696a0a5a0f7 None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:15:30.888884 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b81e8c-dffb-4ffd-b40c-6696a0a5a0f7 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:15:30.888884 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b81e8c-dffb-4ffd-b40c-6696a0a5a0f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:15:30.915556 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-a8b81e8c-dffb-4ffd-b40c-6696a0a5a0f7 None None] MFA Rules not processed for user `96b3f31586984846b2ac5d33701242b9`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:15:30.916765 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-a8b81e8c-dffb-4ffd-b40c-6696a0a5a0f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:15:30.972383 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1187/2357] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:15:30 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:15:31.939858 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ea61de-37be-4c69-bc34-187aaedaf3c9 service cinder] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:15:32.070855 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ea61de-37be-4c69-bc34-187aaedaf3c9 service cinder] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:15:32.076339 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04fea2f-a136-4a79-b632-286cc7e001fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:15:32.077259 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04fea2f-a136-4a79-b632-286cc7e001fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:15:32.077578 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04fea2f-a136-4a79-b632-286cc7e001fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:15:32.077855 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04fea2f-a136-4a79-b632-286cc7e001fd admin admin] PATH_INFO: `/v3/users/821a5125ae1f4b27bce23fea21ae67b6` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:15:32.079131 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04fea2f-a136-4a79-b632-286cc7e001fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=821a5125ae1f4b27bce23fea21ae67b6)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:15:32.081097 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04fea2f-a136-4a79-b632-286cc7e001fd admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:15:32.170490 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-d04fea2f-a136-4a79-b632-286cc7e001fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '821a5125ae1f4b27bce23fea21ae67b6'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:15:32.189442 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-d04fea2f-a136-4a79-b632-286cc7e001fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '821a5125ae1f4b27bce23fea21ae67b6'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:15:32.190435 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-d04fea2f-a136-4a79-b632-286cc7e001fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '821a5125ae1f4b27bce23fea21ae67b6'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:15:32.214184 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-d04fea2f-a136-4a79-b632-286cc7e001fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '821a5125ae1f4b27bce23fea21ae67b6'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:15:32.215409 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-d04fea2f-a136-4a79-b632-286cc7e001fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '821a5125ae1f4b27bce23fea21ae67b6'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:15:32.238133 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1171/2358] 10.222.0.36 () {58 vars in 1223 bytes} [Tue May 3 14:15:31 2022] DELETE /identity/v3/users/821a5125ae1f4b27bce23fea21ae67b6 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:15:32.240383 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ca2471-d8bd-45f2-ab6e-4e7ddcf9de42 None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:15:32.240833 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ca2471-d8bd-45f2-ab6e-4e7ddcf9de42 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:15:32.241137 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ca2471-d8bd-45f2-ab6e-4e7ddcf9de42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:15:32.296267 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-12ca2471-d8bd-45f2-ab6e-4e7ddcf9de42 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:15:32.300606 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-12ca2471-d8bd-45f2-ab6e-4e7ddcf9de42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:15:32.398313 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1188/2359] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:15:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:15:32.408977 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04fea2f-a136-4a79-b632-286cc7e001fd admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:15:32.410344 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-d04fea2f-a136-4a79-b632-286cc7e001fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:15:32.482343 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04fea2f-a136-4a79-b632-286cc7e001fd admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:15:32.488665 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5c6000-2312-47a3-9a3c-5f6a2fb0869f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '937bea4f355144b4a7ee11baabc3a4cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:15:32.490301 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5c6000-2312-47a3-9a3c-5f6a2fb0869f service neutron] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:15:32.490641 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5c6000-2312-47a3-9a3c-5f6a2fb0869f service neutron] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:15:32.491255 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5c6000-2312-47a3-9a3c-5f6a2fb0869f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:15:32.503742 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5c6000-2312-47a3-9a3c-5f6a2fb0869f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:15:32.505521 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5c6000-2312-47a3-9a3c-5f6a2fb0869f service neutron] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:15:32.516905 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1172/2360] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:15:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 14:15:32.980016 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ca2471-d8bd-45f2-ab6e-4e7ddcf9de42 None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:15:32.983072 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-12ca2471-d8bd-45f2-ab6e-4e7ddcf9de42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:15:32.998386 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ca2471-d8bd-45f2-ab6e-4e7ddcf9de42 None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:15:33.005394 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bfabee-a891-4004-b367-266e7fd5b040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:15:33.006466 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bfabee-a891-4004-b367-266e7fd5b040 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:15:33.006742 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bfabee-a891-4004-b367-266e7fd5b040 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:15:33.007010 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bfabee-a891-4004-b367-266e7fd5b040 admin admin] PATH_INFO: `/v3/projects/3b8ba9c5407543549139ccedc3068f38` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:15:33.008621 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bfabee-a891-4004-b367-266e7fd5b040 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b8ba9c5407543549139ccedc3068f38)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:15:33.010527 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bfabee-a891-4004-b367-266e7fd5b040 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:15:33.070845 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-55bfabee-a891-4004-b367-266e7fd5b040 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b8ba9c5407543549139ccedc3068f38', 'request_id': 'req-55bfabee-a891-4004-b367-266e7fd5b040'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:15:33.076686 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-55bfabee-a891-4004-b367-266e7fd5b040 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b8ba9c5407543549139ccedc3068f38', 'request_id': 'req-55bfabee-a891-4004-b367-266e7fd5b040'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:15:33.086728 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-55bfabee-a891-4004-b367-266e7fd5b040 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b8ba9c5407543549139ccedc3068f38', 'request_id': 'req-55bfabee-a891-4004-b367-266e7fd5b040'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:15:33.101380 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-55bfabee-a891-4004-b367-266e7fd5b040 admin admin] The token cache is being invalidate because project 3b8ba9c5407543549139ccedc3068f38 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80013) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 14:15:33.101715 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-55bfabee-a891-4004-b367-266e7fd5b040 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:15:33.102717 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-55bfabee-a891-4004-b367-266e7fd5b040 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:15:33.106040 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1189/2361] 10.222.0.36 () {58 vars in 1232 bytes} [Tue May 3 14:15:32 2022] DELETE /identity/v3/projects/3b8ba9c5407543549139ccedc3068f38 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:15:33.111551 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1de6374-b1ba-4eb6-9b18-ae1ce3da5f40 None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:15:33.112097 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1de6374-b1ba-4eb6-9b18-ae1ce3da5f40 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:15:33.112194 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1de6374-b1ba-4eb6-9b18-ae1ce3da5f40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:15:33.132556 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-e1de6374-b1ba-4eb6-9b18-ae1ce3da5f40 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:15:33.133827 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-e1de6374-b1ba-4eb6-9b18-ae1ce3da5f40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:15:33.200400 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1173/2362] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:15:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:15:33.208181 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fd37c7-e8a7-4bb0-9a89-dc9fcde8410c None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:15:33.208465 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fd37c7-e8a7-4bb0-9a89-dc9fcde8410c None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:15:33.208741 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fd37c7-e8a7-4bb0-9a89-dc9fcde8410c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:15:33.227204 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-02fd37c7-e8a7-4bb0-9a89-dc9fcde8410c None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:15:33.228400 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-02fd37c7-e8a7-4bb0-9a89-dc9fcde8410c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:15:33.236276 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1190/2363] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:15:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:15:33.240609 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1de6374-b1ba-4eb6-9b18-ae1ce3da5f40 None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:15:33.250815 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1de6374-b1ba-4eb6-9b18-ae1ce3da5f40 None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:15:33.255496 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f3a626-15ed-4b0d-844c-6309df202de1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:15:33.256309 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f3a626-15ed-4b0d-844c-6309df202de1 admin admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:15:33.256580 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f3a626-15ed-4b0d-844c-6309df202de1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:15:33.256851 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f3a626-15ed-4b0d-844c-6309df202de1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:15:33.257598 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f3a626-15ed-4b0d-844c-6309df202de1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80012) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:15:33.257901 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f3a626-15ed-4b0d-844c-6309df202de1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:15:33.259520 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f3a626-15ed-4b0d-844c-6309df202de1 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:15:33.271323 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1174/2364] 10.222.0.36 () {58 vars in 1152 bytes} [Tue May 3 14:15:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:15:33.276428 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fd37c7-e8a7-4bb0-9a89-dc9fcde8410c None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:15:33.285966 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fd37c7-e8a7-4bb0-9a89-dc9fcde8410c None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:15:33.291093 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4212a04c-5e62-4ac0-85ca-80a04171b6a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:15:33.291742 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4212a04c-5e62-4ac0-85ca-80a04171b6a2 admin admin] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:15:33.292016 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4212a04c-5e62-4ac0-85ca-80a04171b6a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:15:33.292287 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4212a04c-5e62-4ac0-85ca-80a04171b6a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:15:33.292999 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4212a04c-5e62-4ac0-85ca-80a04171b6a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:15:33.294982 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4212a04c-5e62-4ac0-85ca-80a04171b6a2 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:15:33.321360 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1191/2365] 10.222.0.36 () {60 vars in 1152 bytes} [Tue May 3 14:15:33 2022] POST /identity/v3/projects => generated 375 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 14:15:33.325193 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f3a626-15ed-4b0d-844c-6309df202de1 admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:15:33.349016 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f3a626-15ed-4b0d-844c-6309df202de1 admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:15:33.408108 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1f11c8-e585-4490-869e-bb441e7b2d00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:15:33.408965 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1f11c8-e585-4490-869e-bb441e7b2d00 admin admin] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:15:33.409336 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1f11c8-e585-4490-869e-bb441e7b2d00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:15:33.409746 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1f11c8-e585-4490-869e-bb441e7b2d00 admin admin] PATH_INFO: `/v3/users` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:15:33.410415 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1f11c8-e585-4490-869e-bb441e7b2d00 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:15:33.412356 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1f11c8-e585-4490-869e-bb441e7b2d00 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:15:33.433050 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1175/2366] 10.222.0.36 () {60 vars in 1143 bytes} [Tue May 3 14:15:33 2022] POST /identity/v3/users => generated 288 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 14:15:33.437314 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4212a04c-5e62-4ac0-85ca-80a04171b6a2 admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:15:33.448679 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4212a04c-5e62-4ac0-85ca-80a04171b6a2 admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:15:33.454329 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36a8e3b-6f44-4dd6-b08a-799076819b40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:15:33.455005 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36a8e3b-6f44-4dd6-b08a-799076819b40 admin admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:15:33.455283 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36a8e3b-6f44-4dd6-b08a-799076819b40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:15:33.455557 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36a8e3b-6f44-4dd6-b08a-799076819b40 admin admin] PATH_INFO: `/v3/roles` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:15:33.456363 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36a8e3b-6f44-4dd6-b08a-799076819b40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:15:33.458350 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36a8e3b-6f44-4dd6-b08a-799076819b40 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:15:33.469269 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1192/2367] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 3 14:15:33 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 14:15:33.474509 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1f11c8-e585-4490-869e-bb441e7b2d00 admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:15:33.484808 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1f11c8-e585-4490-869e-bb441e7b2d00 admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:15:33.489576 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86156e3e-ebfb-452c-9b84-d36d9528a23a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:15:33.490165 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86156e3e-ebfb-452c-9b84-d36d9528a23a admin admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:15:33.490446 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86156e3e-ebfb-452c-9b84-d36d9528a23a admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:15:33.490734 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86156e3e-ebfb-452c-9b84-d36d9528a23a admin admin] PATH_INFO: `/v3/roles` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:15:33.491461 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86156e3e-ebfb-452c-9b84-d36d9528a23a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:15:33.493064 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86156e3e-ebfb-452c-9b84-d36d9528a23a admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:15:33.503909 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1176/2368] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 3 14:15:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 14:15:33.508766 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36a8e3b-6f44-4dd6-b08a-799076819b40 admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:15:33.527938 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36a8e3b-6f44-4dd6-b08a-799076819b40 admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:15:33.533252 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bb0bd9-694c-4fa5-9df0-7b945aa456fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:15:33.534592 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bb0bd9-694c-4fa5-9df0-7b945aa456fe admin admin] REQUEST_METHOD: `PUT` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:15:33.535211 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bb0bd9-694c-4fa5-9df0-7b945aa456fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:15:33.535632 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bb0bd9-694c-4fa5-9df0-7b945aa456fe admin admin] PATH_INFO: `/v3/projects/f943511aa73d4418851276f1e21c42a4/users/8e60b4fc5e7f4dffa838b363caf236ff/roles/441fdc11e95b47f4813f72610e39018b` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:15:33.554564 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bb0bd9-694c-4fa5-9df0-7b945aa456fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=f943511aa73d4418851276f1e21c42a4, user_id=8e60b4fc5e7f4dffa838b363caf236ff, role_id=441fdc11e95b47f4813f72610e39018b)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:15:33.557525 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bb0bd9-694c-4fa5-9df0-7b945aa456fe admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:15:33.573053 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1193/2369] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 3 14:15:33 2022] PUT /identity/v3/projects/f943511aa73d4418851276f1e21c42a4/users/8e60b4fc5e7f4dffa838b363caf236ff/roles/441fdc11e95b47f4813f72610e39018b => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 14:15:33.583722 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f378e37b-b10a-4b2e-b79f-768632dc4711 None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:15:33.584031 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f378e37b-b10a-4b2e-b79f-768632dc4711 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:15:33.584411 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f378e37b-b10a-4b2e-b79f-768632dc4711 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:15:33.615249 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-f378e37b-b10a-4b2e-b79f-768632dc4711 None None] MFA Rules not processed for user `8e60b4fc5e7f4dffa838b363caf236ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:15:33.616485 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-f378e37b-b10a-4b2e-b79f-768632dc4711 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:15:33.689041 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1177/2370] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:15:33 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:15:33.701242 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bb0bd9-694c-4fa5-9df0-7b945aa456fe admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:15:33.703156 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-76bb0bd9-694c-4fa5-9df0-7b945aa456fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:15:33.767336 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bb0bd9-694c-4fa5-9df0-7b945aa456fe admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:15:33.771170 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f93ce92-9b38-4ad1-a592-c75880e32e86 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b014f4c7ba1414cb8a597f5bc4033f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:15:33.771824 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f93ce92-9b38-4ad1-a592-c75880e32e86 service cinder] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:15:33.772252 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f93ce92-9b38-4ad1-a592-c75880e32e86 service cinder] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:15:33.772532 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f93ce92-9b38-4ad1-a592-c75880e32e86 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:15:33.785998 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f93ce92-9b38-4ad1-a592-c75880e32e86 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:15:33.787504 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f93ce92-9b38-4ad1-a592-c75880e32e86 service cinder] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:15:33.798050 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1194/2371] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:15:33 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 03 14:15:35.180398 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683b29dc-46f4-485d-b830-269ebdc294d9 None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:15:35.181581 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683b29dc-46f4-485d-b830-269ebdc294d9 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:15:35.181889 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683b29dc-46f4-485d-b830-269ebdc294d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:15:35.224878 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-683b29dc-46f4-485d-b830-269ebdc294d9 None None] MFA Rules not processed for user `dec39ff0b6544a738e5aae06e9a8cb38`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:15:35.228193 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-683b29dc-46f4-485d-b830-269ebdc294d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:15:35.315430 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1178/2372] 10.222.0.36 () {58 vars in 1009 bytes} [Tue May 3 14:15:35 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:15:35.353185 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f93ce92-9b38-4ad1-a592-c75880e32e86 service cinder] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:15:35.355262 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-4f93ce92-9b38-4ad1-a592-c75880e32e86 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:15:35.402596 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90749c0c-af34-46f6-b420-efae21b9a1d2 None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:15:35.404118 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90749c0c-af34-46f6-b420-efae21b9a1d2 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:15:35.404728 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90749c0c-af34-46f6-b420-efae21b9a1d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:15:35.447729 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-90749c0c-af34-46f6-b420-efae21b9a1d2 None None] MFA Rules not processed for user `8e60b4fc5e7f4dffa838b363caf236ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:15:35.451079 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-90749c0c-af34-46f6-b420-efae21b9a1d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:15:35.472077 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1179/2373] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:15:35 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:15:35.487161 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f93ce92-9b38-4ad1-a592-c75880e32e86 service cinder] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:15:35.495755 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb87ede-831c-40fd-9b81-bf4244c5744e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1180e29180d44418390cf22d3e0bd6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:15:35.496779 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb87ede-831c-40fd-9b81-bf4244c5744e service swift] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:15:35.497413 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb87ede-831c-40fd-9b81-bf4244c5744e service swift] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:15:35.497840 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb87ede-831c-40fd-9b81-bf4244c5744e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:15:35.507870 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb87ede-831c-40fd-9b81-bf4244c5744e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:15:35.510795 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb87ede-831c-40fd-9b81-bf4244c5744e service swift] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:15:35.532787 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1195/2374] 10.222.0.36 () {60 vars in 1384 bytes} [Tue May 3 14:15:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 03 14:15:44.278610 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90749c0c-af34-46f6-b420-efae21b9a1d2 None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:15:44.279975 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-90749c0c-af34-46f6-b420-efae21b9a1d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:15:44.396586 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90749c0c-af34-46f6-b420-efae21b9a1d2 None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:15:44.400299 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b4089f-4209-4306-add5-d73149deec7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '937bea4f355144b4a7ee11baabc3a4cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:15:44.400955 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b4089f-4209-4306-add5-d73149deec7f service neutron] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:15:44.401230 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b4089f-4209-4306-add5-d73149deec7f service neutron] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:15:44.401527 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b4089f-4209-4306-add5-d73149deec7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:15:44.403511 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-b4b4089f-4209-4306-add5-d73149deec7f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:15:44.511637 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b4089f-4209-4306-add5-d73149deec7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:15:44.513860 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b4089f-4209-4306-add5-d73149deec7f service neutron] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:15:44.527310 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1180/2375] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:15:44 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 14:15:47.188024 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf509bb-49f6-4b45-a327-0085bb5688cb None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:15:47.188942 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf509bb-49f6-4b45-a327-0085bb5688cb None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:15:47.189718 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf509bb-49f6-4b45-a327-0085bb5688cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:15:47.214966 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-4cf509bb-49f6-4b45-a327-0085bb5688cb None None] MFA Rules not processed for user `b67e152bc8e94244bce87e63c3b33747`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:15:47.216310 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-4cf509bb-49f6-4b45-a327-0085bb5688cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:15:47.304630 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1196/2376] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:15:47 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:15:54.814253 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdf2298-9fe5-45b7-965e-cb3e03414a0c None None] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:15:54.815404 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdf2298-9fe5-45b7-965e-cb3e03414a0c None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:15:54.815663 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdf2298-9fe5-45b7-965e-cb3e03414a0c None None] PATH_INFO: `/` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:15:54.817057 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1181/2377] 10.222.0.36 () {54 vars in 921 bytes} [Tue May 3 14:15:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 14:15:54.823567 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfcb34f-150d-4a03-a94a-1e1b2d1f4791 None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:15:54.824099 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfcb34f-150d-4a03-a94a-1e1b2d1f4791 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:15:54.824195 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfcb34f-150d-4a03-a94a-1e1b2d1f4791 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:15:54.875038 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-6dfcb34f-150d-4a03-a94a-1e1b2d1f4791 None None] MFA Rules not processed for user `63489e658c094a2598a2ac62159d2fda`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:15:54.876314 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-6dfcb34f-150d-4a03-a94a-1e1b2d1f4791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:15:54.960044 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1197/2378] 10.222.0.36 () {58 vars in 1018 bytes} [Tue May 3 14:15:54 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 14:15:54.972946 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdf2298-9fe5-45b7-965e-cb3e03414a0c None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:15:54.975005 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-4fdf2298-9fe5-45b7-965e-cb3e03414a0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:15:55.032089 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdf2298-9fe5-45b7-965e-cb3e03414a0c None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:15:55.035661 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b85169-4c31-44c5-a7fc-2a98be04b9c7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '616de5e7daed46849efc75ad77ea054e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:15:55.036383 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b85169-4c31-44c5-a7fc-2a98be04b9c7 service glance] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:15:55.036665 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b85169-4c31-44c5-a7fc-2a98be04b9c7 service glance] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:15:55.036915 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b85169-4c31-44c5-a7fc-2a98be04b9c7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:15:55.051730 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b85169-4c31-44c5-a7fc-2a98be04b9c7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:15:55.053177 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b85169-4c31-44c5-a7fc-2a98be04b9c7 service glance] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:15:55.066123 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1182/2379] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:15:54 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 14:15:55.138300 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16510ae1-4de0-4712-9fcc-2bc7a7b84e44 None None] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:15:55.138710 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16510ae1-4de0-4712-9fcc-2bc7a7b84e44 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:15:55.139080 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16510ae1-4de0-4712-9fcc-2bc7a7b84e44 None None] PATH_INFO: `/` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:15:55.140572 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1198/2380] 10.222.0.36 () {54 vars in 921 bytes} [Tue May 3 14:15:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 14:15:55.145797 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69000dc-f89b-40c1-b91c-864ee5fff3a9 None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:15:55.146116 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69000dc-f89b-40c1-b91c-864ee5fff3a9 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:15:55.146402 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69000dc-f89b-40c1-b91c-864ee5fff3a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:15:55.165865 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-b69000dc-f89b-40c1-b91c-864ee5fff3a9 None None] MFA Rules not processed for user `937bea4f355144b4a7ee11baabc3a4cb`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:15:55.167341 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-b69000dc-f89b-40c1-b91c-864ee5fff3a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:15:55.174269 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1183/2381] 10.222.0.36 () {58 vars in 1018 bytes} [Tue May 3 14:15:55 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:15:55.186133 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16510ae1-4de0-4712-9fcc-2bc7a7b84e44 None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:15:55.187949 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-16510ae1-4de0-4712-9fcc-2bc7a7b84e44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:15:55.201168 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16510ae1-4de0-4712-9fcc-2bc7a7b84e44 None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:15:55.204864 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997af528-4164-40d4-b38b-252d63e3973f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '937bea4f355144b4a7ee11baabc3a4cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:15:55.205541 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997af528-4164-40d4-b38b-252d63e3973f service neutron] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:15:55.205821 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997af528-4164-40d4-b38b-252d63e3973f service neutron] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:15:55.206091 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997af528-4164-40d4-b38b-252d63e3973f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:15:55.213963 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997af528-4164-40d4-b38b-252d63e3973f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:15:55.215836 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997af528-4164-40d4-b38b-252d63e3973f service neutron] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:15:55.224324 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1199/2382] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:15:55 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 14:15:55.319784 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eba0d4d-f630-4116-a491-c768c4c3f3f7 None None] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:15:55.320709 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eba0d4d-f630-4116-a491-c768c4c3f3f7 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:15:55.321320 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eba0d4d-f630-4116-a491-c768c4c3f3f7 None None] PATH_INFO: `/` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:15:55.323182 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1184/2383] 10.222.0.36 () {54 vars in 921 bytes} [Tue May 3 14:15:55 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 14:15:55.330232 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b74946-1658-4ab1-94c2-57bf4ae93e24 None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:15:55.330848 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b74946-1658-4ab1-94c2-57bf4ae93e24 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:15:55.331297 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b74946-1658-4ab1-94c2-57bf4ae93e24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:15:55.353845 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-51b74946-1658-4ab1-94c2-57bf4ae93e24 None None] MFA Rules not processed for user `63489e658c094a2598a2ac62159d2fda`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:15:55.358213 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-51b74946-1658-4ab1-94c2-57bf4ae93e24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:15:55.368507 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1200/2384] 10.222.0.36 () {58 vars in 1018 bytes} [Tue May 3 14:15:55 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:15:55.380826 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eba0d4d-f630-4116-a491-c768c4c3f3f7 None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:15:55.396788 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eba0d4d-f630-4116-a491-c768c4c3f3f7 None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:15:55.401523 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f51a873-0907-4e63-97ee-4fa76a6c7790 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '937bea4f355144b4a7ee11baabc3a4cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:15:55.402458 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f51a873-0907-4e63-97ee-4fa76a6c7790 service neutron] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:15:55.402914 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f51a873-0907-4e63-97ee-4fa76a6c7790 service neutron] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:15:55.403455 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f51a873-0907-4e63-97ee-4fa76a6c7790 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:15:55.415355 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f51a873-0907-4e63-97ee-4fa76a6c7790 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:15:55.416799 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f51a873-0907-4e63-97ee-4fa76a6c7790 service neutron] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:15:55.432205 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1185/2385] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:15:55 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 14:16:03.831853 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d0b09f-9abe-4976-8c9c-f8621a2d24ae None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:16:03.832317 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d0b09f-9abe-4976-8c9c-f8621a2d24ae None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:16:03.832561 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d0b09f-9abe-4976-8c9c-f8621a2d24ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:16:03.895390 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-09d0b09f-9abe-4976-8c9c-f8621a2d24ae None None] MFA Rules not processed for user `dec39ff0b6544a738e5aae06e9a8cb38`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:16:03.897074 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-09d0b09f-9abe-4976-8c9c-f8621a2d24ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:16:03.923982 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1201/2386] 10.222.0.36 () {58 vars in 1009 bytes} [Tue May 3 14:16:03 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:16:03.938859 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f51a873-0907-4e63-97ee-4fa76a6c7790 service neutron] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:16:03.972037 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f51a873-0907-4e63-97ee-4fa76a6c7790 service neutron] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:16:03.978831 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac1e282-6627-4c2a-9c50-bf5e15c3d54d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1180e29180d44418390cf22d3e0bd6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:16:03.979337 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac1e282-6627-4c2a-9c50-bf5e15c3d54d service swift] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:16:03.979626 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac1e282-6627-4c2a-9c50-bf5e15c3d54d service swift] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:16:03.979908 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac1e282-6627-4c2a-9c50-bf5e15c3d54d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:16:03.999820 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac1e282-6627-4c2a-9c50-bf5e15c3d54d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:16:04.001809 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac1e282-6627-4c2a-9c50-bf5e15c3d54d service swift] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:16:04.010838 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1186/2387] 10.222.0.36 () {60 vars in 1384 bytes} [Tue May 3 14:16:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 03 14:16:04.526567 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c61abc1-004f-4ea4-8157-334c9a30cc9f None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:16:04.526859 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c61abc1-004f-4ea4-8157-334c9a30cc9f None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:16:04.527139 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c61abc1-004f-4ea4-8157-334c9a30cc9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:16:04.545335 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-9c61abc1-004f-4ea4-8157-334c9a30cc9f None None] MFA Rules not processed for user `dec39ff0b6544a738e5aae06e9a8cb38`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:16:04.546911 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-9c61abc1-004f-4ea4-8157-334c9a30cc9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:16:04.564267 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1202/2388] 10.222.0.36 () {58 vars in 1009 bytes} [Tue May 3 14:16:04 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:16:04.580302 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac1e282-6627-4c2a-9c50-bf5e15c3d54d service swift] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:16:04.592479 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac1e282-6627-4c2a-9c50-bf5e15c3d54d service swift] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:16:04.599762 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f05332-6229-4844-9341-26f28e081c17 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1180e29180d44418390cf22d3e0bd6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:16:04.605164 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f05332-6229-4844-9341-26f28e081c17 service swift] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:16:04.605644 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f05332-6229-4844-9341-26f28e081c17 service swift] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:16:04.606077 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f05332-6229-4844-9341-26f28e081c17 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:16:04.615738 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f05332-6229-4844-9341-26f28e081c17 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:16:04.617673 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f05332-6229-4844-9341-26f28e081c17 service swift] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:16:04.627275 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1187/2389] 10.222.0.36 () {60 vars in 1384 bytes} [Tue May 3 14:16:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 03 14:16:05.182317 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0bc849-ed8b-4f67-b3a5-97a3427ace57 None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:16:05.182860 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0bc849-ed8b-4f67-b3a5-97a3427ace57 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:16:05.182860 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0bc849-ed8b-4f67-b3a5-97a3427ace57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:16:05.208971 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-7e0bc849-ed8b-4f67-b3a5-97a3427ace57 None None] MFA Rules not processed for user `dec39ff0b6544a738e5aae06e9a8cb38`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:16:05.214426 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-7e0bc849-ed8b-4f67-b3a5-97a3427ace57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:16:05.230825 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1203/2390] 10.222.0.36 () {58 vars in 967 bytes} [Tue May 3 14:16:05 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:16:05.250629 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f05332-6229-4844-9341-26f28e081c17 service swift] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:16:05.271836 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f05332-6229-4844-9341-26f28e081c17 service swift] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:16:05.277475 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01b4b41-0811-4fee-afcc-62800e13ff97 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1180e29180d44418390cf22d3e0bd6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:16:05.278179 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01b4b41-0811-4fee-afcc-62800e13ff97 service swift] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:16:05.278664 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01b4b41-0811-4fee-afcc-62800e13ff97 service swift] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:16:05.278937 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01b4b41-0811-4fee-afcc-62800e13ff97 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:16:05.288161 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01b4b41-0811-4fee-afcc-62800e13ff97 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:16:05.289799 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01b4b41-0811-4fee-afcc-62800e13ff97 service swift] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:16:05.300182 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1188/2391] 10.222.0.36 () {60 vars in 1384 bytes} [Tue May 3 14:16:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 03 14:16:05.563878 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd4edae-4834-4767-808e-cd196a555be0 None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:16:05.564184 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd4edae-4834-4767-808e-cd196a555be0 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:16:05.564666 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd4edae-4834-4767-808e-cd196a555be0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:16:05.586292 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-3bd4edae-4834-4767-808e-cd196a555be0 None None] MFA Rules not processed for user `dec39ff0b6544a738e5aae06e9a8cb38`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:16:05.587829 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-3bd4edae-4834-4767-808e-cd196a555be0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:16:05.595436 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1204/2392] 10.222.0.36 () {58 vars in 1009 bytes} [Tue May 3 14:16:05 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:16:05.608212 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01b4b41-0811-4fee-afcc-62800e13ff97 service swift] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:16:05.618937 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01b4b41-0811-4fee-afcc-62800e13ff97 service swift] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:16:05.624592 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103d6ffa-cc73-41e4-be71-bf7659978bff service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1180e29180d44418390cf22d3e0bd6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:16:05.625441 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103d6ffa-cc73-41e4-be71-bf7659978bff service swift] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:16:05.625752 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103d6ffa-cc73-41e4-be71-bf7659978bff service swift] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:16:05.626038 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103d6ffa-cc73-41e4-be71-bf7659978bff service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:16:05.635580 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103d6ffa-cc73-41e4-be71-bf7659978bff service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:16:05.637314 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103d6ffa-cc73-41e4-be71-bf7659978bff service swift] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:16:05.648126 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1189/2393] 10.222.0.36 () {60 vars in 1384 bytes} [Tue May 3 14:16:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 03 14:16:06.048471 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1b11fb-291e-4df2-8ebc-4ff40018c0a6 None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:16:06.048827 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1b11fb-291e-4df2-8ebc-4ff40018c0a6 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:16:06.049202 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1b11fb-291e-4df2-8ebc-4ff40018c0a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:16:06.074439 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-4a1b11fb-291e-4df2-8ebc-4ff40018c0a6 None None] MFA Rules not processed for user `dec39ff0b6544a738e5aae06e9a8cb38`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:16:06.075853 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-4a1b11fb-291e-4df2-8ebc-4ff40018c0a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:16:06.083166 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1205/2394] 10.222.0.36 () {58 vars in 967 bytes} [Tue May 3 14:16:06 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:16:06.096542 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103d6ffa-cc73-41e4-be71-bf7659978bff service swift] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:16:06.108732 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103d6ffa-cc73-41e4-be71-bf7659978bff service swift] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:16:06.115082 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d9e10d-add2-46be-a5c2-a4fd2120e518 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1180e29180d44418390cf22d3e0bd6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:16:06.115868 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d9e10d-add2-46be-a5c2-a4fd2120e518 service swift] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:16:06.116152 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d9e10d-add2-46be-a5c2-a4fd2120e518 service swift] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:16:06.116426 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d9e10d-add2-46be-a5c2-a4fd2120e518 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:16:06.127589 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d9e10d-add2-46be-a5c2-a4fd2120e518 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:16:06.129797 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d9e10d-add2-46be-a5c2-a4fd2120e518 service swift] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:16:06.140386 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1190/2395] 10.222.0.36 () {60 vars in 1384 bytes} [Tue May 3 14:16:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 03 14:16:08.324252 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1b11fb-291e-4df2-8ebc-4ff40018c0a6 None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:16:08.408271 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1b11fb-291e-4df2-8ebc-4ff40018c0a6 None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:16:08.414046 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdd4f95-8f9d-48de-94a7-fdaa5a06df7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:16:08.415089 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdd4f95-8f9d-48de-94a7-fdaa5a06df7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:16:08.416336 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdd4f95-8f9d-48de-94a7-fdaa5a06df7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:16:08.416958 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdd4f95-8f9d-48de-94a7-fdaa5a06df7e admin admin] PATH_INFO: `/v3/users/8e60b4fc5e7f4dffa838b363caf236ff` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:16:08.418582 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdd4f95-8f9d-48de-94a7-fdaa5a06df7e admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e60b4fc5e7f4dffa838b363caf236ff)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:16:08.423127 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdd4f95-8f9d-48de-94a7-fdaa5a06df7e admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:16:08.479187 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-3cdd4f95-8f9d-48de-94a7-fdaa5a06df7e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e60b4fc5e7f4dffa838b363caf236ff'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:16:08.486017 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-3cdd4f95-8f9d-48de-94a7-fdaa5a06df7e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e60b4fc5e7f4dffa838b363caf236ff'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:16:08.486682 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-3cdd4f95-8f9d-48de-94a7-fdaa5a06df7e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e60b4fc5e7f4dffa838b363caf236ff'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:16:08.497114 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-3cdd4f95-8f9d-48de-94a7-fdaa5a06df7e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e60b4fc5e7f4dffa838b363caf236ff'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:16:08.498103 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-3cdd4f95-8f9d-48de-94a7-fdaa5a06df7e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e60b4fc5e7f4dffa838b363caf236ff'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:16:08.527454 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1206/2396] 10.222.0.36 () {58 vars in 1223 bytes} [Tue May 3 14:16:08 2022] DELETE /identity/v3/users/8e60b4fc5e7f4dffa838b363caf236ff => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:16:08.532208 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432163c7-808f-4c3a-9ea7-d16b1914f982 None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:16:08.533073 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432163c7-808f-4c3a-9ea7-d16b1914f982 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:16:08.533385 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432163c7-808f-4c3a-9ea7-d16b1914f982 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:16:08.550836 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-432163c7-808f-4c3a-9ea7-d16b1914f982 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:16:08.552014 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-432163c7-808f-4c3a-9ea7-d16b1914f982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:16:08.611773 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1191/2397] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:16:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:16:08.621579 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdd4f95-8f9d-48de-94a7-fdaa5a06df7e admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:16:08.623121 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-3cdd4f95-8f9d-48de-94a7-fdaa5a06df7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:16:08.687197 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdd4f95-8f9d-48de-94a7-fdaa5a06df7e admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:16:08.697615 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988308b8-40d0-4022-9e5a-97f2953be495 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '937bea4f355144b4a7ee11baabc3a4cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:16:08.698290 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988308b8-40d0-4022-9e5a-97f2953be495 service neutron] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:16:08.698591 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988308b8-40d0-4022-9e5a-97f2953be495 service neutron] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:16:08.698936 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988308b8-40d0-4022-9e5a-97f2953be495 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:16:08.708862 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988308b8-40d0-4022-9e5a-97f2953be495 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:16:08.710760 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988308b8-40d0-4022-9e5a-97f2953be495 service neutron] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:16:08.722532 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1207/2398] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:16:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 14:16:08.766355 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f2a9e6-1e69-4b45-af3d-d0e21e38d529 None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:16:08.767327 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f2a9e6-1e69-4b45-af3d-d0e21e38d529 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:16:08.767823 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f2a9e6-1e69-4b45-af3d-d0e21e38d529 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:16:08.791734 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-54f2a9e6-1e69-4b45-af3d-d0e21e38d529 None None] MFA Rules not processed for user `dec39ff0b6544a738e5aae06e9a8cb38`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:16:08.793341 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-54f2a9e6-1e69-4b45-af3d-d0e21e38d529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:16:08.854221 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1192/2399] 10.222.0.36 () {58 vars in 1009 bytes} [Tue May 3 14:16:08 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:16:08.888268 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988308b8-40d0-4022-9e5a-97f2953be495 service neutron] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:16:08.890028 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-988308b8-40d0-4022-9e5a-97f2953be495 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:16:09.011730 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f2a9e6-1e69-4b45-af3d-d0e21e38d529 None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:16:09.014103 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-54f2a9e6-1e69-4b45-af3d-d0e21e38d529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:16:09.039805 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988308b8-40d0-4022-9e5a-97f2953be495 service neutron] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:16:09.050277 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b62375-cbd9-4fc5-a669-7279fa2517ae service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1180e29180d44418390cf22d3e0bd6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:16:09.051499 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b62375-cbd9-4fc5-a669-7279fa2517ae service swift] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:16:09.051785 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b62375-cbd9-4fc5-a669-7279fa2517ae service swift] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:16:09.052067 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b62375-cbd9-4fc5-a669-7279fa2517ae service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:16:09.055446 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f2a9e6-1e69-4b45-af3d-d0e21e38d529 None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:16:09.073126 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b62375-cbd9-4fc5-a669-7279fa2517ae service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:16:09.075552 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b62375-cbd9-4fc5-a669-7279fa2517ae service swift] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:16:09.078911 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc5ab58-0ecb-4372-a9bb-f34cff9cb8ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:16:09.080074 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc5ab58-0ecb-4372-a9bb-f34cff9cb8ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:16:09.080653 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc5ab58-0ecb-4372-a9bb-f34cff9cb8ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:16:09.081093 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc5ab58-0ecb-4372-a9bb-f34cff9cb8ce admin admin] PATH_INFO: `/v3/projects/f943511aa73d4418851276f1e21c42a4` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:16:09.082562 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc5ab58-0ecb-4372-a9bb-f34cff9cb8ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=f943511aa73d4418851276f1e21c42a4)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:16:09.085001 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc5ab58-0ecb-4372-a9bb-f34cff9cb8ce admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:16:09.099679 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1208/2400] 10.222.0.36 () {60 vars in 1384 bytes} [Tue May 3 14:16:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 03 14:16:09.149201 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-adc5ab58-0ecb-4372-a9bb-f34cff9cb8ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f943511aa73d4418851276f1e21c42a4', 'request_id': 'req-adc5ab58-0ecb-4372-a9bb-f34cff9cb8ce'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:16:09.156360 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-adc5ab58-0ecb-4372-a9bb-f34cff9cb8ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f943511aa73d4418851276f1e21c42a4', 'request_id': 'req-adc5ab58-0ecb-4372-a9bb-f34cff9cb8ce'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:16:09.168200 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-adc5ab58-0ecb-4372-a9bb-f34cff9cb8ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f943511aa73d4418851276f1e21c42a4', 'request_id': 'req-adc5ab58-0ecb-4372-a9bb-f34cff9cb8ce'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:16:09.194928 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-adc5ab58-0ecb-4372-a9bb-f34cff9cb8ce admin admin] The token cache is being invalidate because project f943511aa73d4418851276f1e21c42a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80012) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 14:16:09.195530 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-adc5ab58-0ecb-4372-a9bb-f34cff9cb8ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:16:09.196953 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-adc5ab58-0ecb-4372-a9bb-f34cff9cb8ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:16:09.199075 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1193/2401] 10.222.0.36 () {58 vars in 1232 bytes} [Tue May 3 14:16:09 2022] DELETE /identity/v3/projects/f943511aa73d4418851276f1e21c42a4 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:16:19.365088 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b62375-cbd9-4fc5-a669-7279fa2517ae service swift] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:16:19.367547 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-78b62375-cbd9-4fc5-a669-7279fa2517ae service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:16:19.584638 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b62375-cbd9-4fc5-a669-7279fa2517ae service swift] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:16:19.657737 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2039809a-d248-4091-99d2-0254d7c9a269 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '164c7f36acf644e9bf93f158e876e9e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:16:19.658764 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2039809a-d248-4091-99d2-0254d7c9a269 service placement] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:16:19.659251 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2039809a-d248-4091-99d2-0254d7c9a269 service placement] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:16:19.659733 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2039809a-d248-4091-99d2-0254d7c9a269 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:16:19.661812 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-2039809a-d248-4091-99d2-0254d7c9a269 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:16:19.674678 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2039809a-d248-4091-99d2-0254d7c9a269 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:16:19.676638 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2039809a-d248-4091-99d2-0254d7c9a269 service placement] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:16:19.687878 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1209/2402] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:16:19 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 14:16:26.077160 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d7cafc-4c58-4b9c-aa34-5a62db3bcbdf None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:16:26.077727 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d7cafc-4c58-4b9c-aa34-5a62db3bcbdf None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:16:26.077727 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d7cafc-4c58-4b9c-aa34-5a62db3bcbdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:16:26.097519 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-50d7cafc-4c58-4b9c-aa34-5a62db3bcbdf None None] MFA Rules not processed for user `dec39ff0b6544a738e5aae06e9a8cb38`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:16:26.098724 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-50d7cafc-4c58-4b9c-aa34-5a62db3bcbdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:16:26.155383 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1194/2403] 10.222.0.36 () {58 vars in 967 bytes} [Tue May 3 14:16:26 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:16:26.168399 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2039809a-d248-4091-99d2-0254d7c9a269 service placement] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:16:26.169793 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-2039809a-d248-4091-99d2-0254d7c9a269 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:16:26.237149 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2039809a-d248-4091-99d2-0254d7c9a269 service placement] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:16:26.242590 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a3685f-3f88-4b9a-8d06-23a55c382644 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1180e29180d44418390cf22d3e0bd6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:16:26.243267 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a3685f-3f88-4b9a-8d06-23a55c382644 service swift] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:16:26.243536 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a3685f-3f88-4b9a-8d06-23a55c382644 service swift] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:16:26.243802 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a3685f-3f88-4b9a-8d06-23a55c382644 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:16:26.252457 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a3685f-3f88-4b9a-8d06-23a55c382644 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:16:26.253996 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a3685f-3f88-4b9a-8d06-23a55c382644 service swift] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:16:26.261900 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1210/2404] 10.222.0.36 () {60 vars in 1384 bytes} [Tue May 3 14:16:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 03 14:16:28.266097 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d7cafc-4c58-4b9c-aa34-5a62db3bcbdf None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:16:28.267608 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-50d7cafc-4c58-4b9c-aa34-5a62db3bcbdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:16:28.338581 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d7cafc-4c58-4b9c-aa34-5a62db3bcbdf None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:16:28.344482 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bacf0e-89bd-443e-a083-432cf3d58869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:16:28.345345 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bacf0e-89bd-443e-a083-432cf3d58869 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:16:28.345629 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bacf0e-89bd-443e-a083-432cf3d58869 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:16:28.345905 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bacf0e-89bd-443e-a083-432cf3d58869 admin admin] PATH_INFO: `/v3/users/96b3f31586984846b2ac5d33701242b9` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:16:28.347110 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bacf0e-89bd-443e-a083-432cf3d58869 admin admin] RBAC: Authorizing `identity:delete_user(user_id=96b3f31586984846b2ac5d33701242b9)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:16:28.349061 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bacf0e-89bd-443e-a083-432cf3d58869 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:16:28.398268 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-03bacf0e-89bd-443e-a083-432cf3d58869 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '96b3f31586984846b2ac5d33701242b9'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:16:28.405917 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-03bacf0e-89bd-443e-a083-432cf3d58869 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '96b3f31586984846b2ac5d33701242b9'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:16:28.406661 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-03bacf0e-89bd-443e-a083-432cf3d58869 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '96b3f31586984846b2ac5d33701242b9'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:16:28.418614 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-03bacf0e-89bd-443e-a083-432cf3d58869 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '96b3f31586984846b2ac5d33701242b9'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:16:28.419317 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-03bacf0e-89bd-443e-a083-432cf3d58869 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '96b3f31586984846b2ac5d33701242b9'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:16:28.432874 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1195/2405] 10.222.0.36 () {58 vars in 1223 bytes} [Tue May 3 14:16:28 2022] DELETE /identity/v3/users/96b3f31586984846b2ac5d33701242b9 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:16:28.611899 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a3685f-3f88-4b9a-8d06-23a55c382644 service swift] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:16:28.622781 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a3685f-3f88-4b9a-8d06-23a55c382644 service swift] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:16:28.689332 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5632bb81-3a08-48b1-91ee-7ee82df8d3c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:16:28.690222 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5632bb81-3a08-48b1-91ee-7ee82df8d3c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:16:28.690542 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5632bb81-3a08-48b1-91ee-7ee82df8d3c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:16:28.690817 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5632bb81-3a08-48b1-91ee-7ee82df8d3c3 admin admin] PATH_INFO: `/v3/projects/fe12e93e2173443ebbc6badc62f75f20` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:16:28.692013 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5632bb81-3a08-48b1-91ee-7ee82df8d3c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe12e93e2173443ebbc6badc62f75f20)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:16:28.693995 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5632bb81-3a08-48b1-91ee-7ee82df8d3c3 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:16:28.743212 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-5632bb81-3a08-48b1-91ee-7ee82df8d3c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe12e93e2173443ebbc6badc62f75f20', 'request_id': 'req-5632bb81-3a08-48b1-91ee-7ee82df8d3c3'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:16:28.749144 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-5632bb81-3a08-48b1-91ee-7ee82df8d3c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe12e93e2173443ebbc6badc62f75f20', 'request_id': 'req-5632bb81-3a08-48b1-91ee-7ee82df8d3c3'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:16:28.759492 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-5632bb81-3a08-48b1-91ee-7ee82df8d3c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe12e93e2173443ebbc6badc62f75f20', 'request_id': 'req-5632bb81-3a08-48b1-91ee-7ee82df8d3c3'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:16:28.770906 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-5632bb81-3a08-48b1-91ee-7ee82df8d3c3 admin admin] The token cache is being invalidate because project fe12e93e2173443ebbc6badc62f75f20 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80013) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 14:16:28.771235 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-5632bb81-3a08-48b1-91ee-7ee82df8d3c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:16:28.771959 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-5632bb81-3a08-48b1-91ee-7ee82df8d3c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:16:28.773696 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1211/2406] 10.222.0.36 () {58 vars in 1232 bytes} [Tue May 3 14:16:28 2022] DELETE /identity/v3/projects/fe12e93e2173443ebbc6badc62f75f20 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 14:16:28.778946 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723ead62-52f5-4d4e-8cdd-5b96c7550550 None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:16:28.779232 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723ead62-52f5-4d4e-8cdd-5b96c7550550 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:16:28.779502 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723ead62-52f5-4d4e-8cdd-5b96c7550550 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:16:28.797209 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-723ead62-52f5-4d4e-8cdd-5b96c7550550 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:16:28.798504 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-723ead62-52f5-4d4e-8cdd-5b96c7550550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:16:28.863005 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1196/2407] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:16:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 14:16:28.927766 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3963a258-6217-4ba9-8e74-9ded8f177910 None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:16:28.928044 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3963a258-6217-4ba9-8e74-9ded8f177910 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:16:28.928321 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3963a258-6217-4ba9-8e74-9ded8f177910 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:16:28.958697 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-3963a258-6217-4ba9-8e74-9ded8f177910 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:16:28.960682 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-3963a258-6217-4ba9-8e74-9ded8f177910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:16:28.971774 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1212/2408] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:16:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:16:28.976319 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723ead62-52f5-4d4e-8cdd-5b96c7550550 None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:16:28.986236 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723ead62-52f5-4d4e-8cdd-5b96c7550550 None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:16:28.991269 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c9a0da-ce9a-42d1-a3f6-31f7986bb028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:16:28.991920 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c9a0da-ce9a-42d1-a3f6-31f7986bb028 admin admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:16:28.992169 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c9a0da-ce9a-42d1-a3f6-31f7986bb028 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:16:28.992470 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c9a0da-ce9a-42d1-a3f6-31f7986bb028 admin admin] PATH_INFO: `/v3/domains` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:16:28.993189 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c9a0da-ce9a-42d1-a3f6-31f7986bb028 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80012) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:16:28.993525 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c9a0da-ce9a-42d1-a3f6-31f7986bb028 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:16:28.995227 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c9a0da-ce9a-42d1-a3f6-31f7986bb028 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:16:29.007896 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1197/2409] 10.222.0.36 () {58 vars in 1152 bytes} [Tue May 3 14:16:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:16:29.012410 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3963a258-6217-4ba9-8e74-9ded8f177910 None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:16:29.021666 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3963a258-6217-4ba9-8e74-9ded8f177910 None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:16:29.026732 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bce72b-f3fb-444a-9d8d-c4b93914fa7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:16:29.027396 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bce72b-f3fb-444a-9d8d-c4b93914fa7e admin admin] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:16:29.027670 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bce72b-f3fb-444a-9d8d-c4b93914fa7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:16:29.027941 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bce72b-f3fb-444a-9d8d-c4b93914fa7e admin admin] PATH_INFO: `/v3/projects` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:16:29.028621 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bce72b-f3fb-444a-9d8d-c4b93914fa7e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:16:29.030560 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bce72b-f3fb-444a-9d8d-c4b93914fa7e admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:16:29.062718 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1213/2410] 10.222.0.36 () {60 vars in 1152 bytes} [Tue May 3 14:16:29 2022] POST /identity/v3/projects => generated 375 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 14:16:29.063847 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c9a0da-ce9a-42d1-a3f6-31f7986bb028 admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:16:29.074789 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c9a0da-ce9a-42d1-a3f6-31f7986bb028 admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:16:29.132451 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58887777-8d76-4152-916b-c7a49ea7cc90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:16:29.133035 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58887777-8d76-4152-916b-c7a49ea7cc90 admin admin] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:16:29.133344 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58887777-8d76-4152-916b-c7a49ea7cc90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:16:29.134099 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58887777-8d76-4152-916b-c7a49ea7cc90 admin admin] PATH_INFO: `/v3/users` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:16:29.134315 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58887777-8d76-4152-916b-c7a49ea7cc90 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:16:29.136247 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58887777-8d76-4152-916b-c7a49ea7cc90 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:16:29.157947 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1198/2411] 10.222.0.36 () {60 vars in 1143 bytes} [Tue May 3 14:16:29 2022] POST /identity/v3/users => generated 288 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 14:16:29.161747 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bce72b-f3fb-444a-9d8d-c4b93914fa7e admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:16:29.173057 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bce72b-f3fb-444a-9d8d-c4b93914fa7e admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:16:29.177877 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c5a9b9-c734-4519-911d-a8002c5a49e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:16:29.178546 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c5a9b9-c734-4519-911d-a8002c5a49e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:16:29.178825 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c5a9b9-c734-4519-911d-a8002c5a49e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:16:29.179101 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c5a9b9-c734-4519-911d-a8002c5a49e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:16:29.179835 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c5a9b9-c734-4519-911d-a8002c5a49e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:16:29.181513 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c5a9b9-c734-4519-911d-a8002c5a49e1 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:16:29.192449 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1214/2412] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 3 14:16:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 14:16:29.196346 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58887777-8d76-4152-916b-c7a49ea7cc90 admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:16:29.206540 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58887777-8d76-4152-916b-c7a49ea7cc90 admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:16:29.211529 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a229be-0cf9-45aa-a332-4ed573a20394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:16:29.212190 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a229be-0cf9-45aa-a332-4ed573a20394 admin admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:16:29.212468 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a229be-0cf9-45aa-a332-4ed573a20394 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:16:29.212786 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a229be-0cf9-45aa-a332-4ed573a20394 admin admin] PATH_INFO: `/v3/roles` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:16:29.213525 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a229be-0cf9-45aa-a332-4ed573a20394 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:16:29.215163 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a229be-0cf9-45aa-a332-4ed573a20394 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:16:29.225149 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1199/2413] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 3 14:16:29 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 14:16:29.229587 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c5a9b9-c734-4519-911d-a8002c5a49e1 admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:16:29.239530 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c5a9b9-c734-4519-911d-a8002c5a49e1 admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:16:29.244097 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5a3713-8325-4646-8f21-15a76ed987ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:16:29.245034 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5a3713-8325-4646-8f21-15a76ed987ae admin admin] REQUEST_METHOD: `PUT` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:16:29.245338 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5a3713-8325-4646-8f21-15a76ed987ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:16:29.245615 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5a3713-8325-4646-8f21-15a76ed987ae admin admin] PATH_INFO: `/v3/projects/e26e827ce3374abb9d0198b87e16c9b3/users/e33b2cd997024a32b79e5384454fafdc/roles/441fdc11e95b47f4813f72610e39018b` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:16:29.260058 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5a3713-8325-4646-8f21-15a76ed987ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=e26e827ce3374abb9d0198b87e16c9b3, user_id=e33b2cd997024a32b79e5384454fafdc, role_id=441fdc11e95b47f4813f72610e39018b)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:16:29.262953 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5a3713-8325-4646-8f21-15a76ed987ae admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:16:29.276994 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1215/2414] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 3 14:16:29 2022] PUT /identity/v3/projects/e26e827ce3374abb9d0198b87e16c9b3/users/e33b2cd997024a32b79e5384454fafdc/roles/441fdc11e95b47f4813f72610e39018b => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:16:29.287192 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea2b270-d744-479d-927a-cf78a0d60db2 None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:16:29.287709 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea2b270-d744-479d-927a-cf78a0d60db2 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:16:29.287829 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea2b270-d744-479d-927a-cf78a0d60db2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:16:29.316392 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-7ea2b270-d744-479d-927a-cf78a0d60db2 None None] MFA Rules not processed for user `e33b2cd997024a32b79e5384454fafdc`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:16:29.317696 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-7ea2b270-d744-479d-927a-cf78a0d60db2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:16:29.384976 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1200/2415] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:16:29 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:16:29.396451 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5a3713-8325-4646-8f21-15a76ed987ae admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:16:29.398308 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-5d5a3713-8325-4646-8f21-15a76ed987ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:16:29.477725 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5a3713-8325-4646-8f21-15a76ed987ae admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:16:29.481994 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96373305-f4c1-4440-a3a9-e2a4673d6a68 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b014f4c7ba1414cb8a597f5bc4033f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:16:29.482652 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96373305-f4c1-4440-a3a9-e2a4673d6a68 service cinder] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:16:29.482934 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96373305-f4c1-4440-a3a9-e2a4673d6a68 service cinder] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:16:29.483207 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96373305-f4c1-4440-a3a9-e2a4673d6a68 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:16:29.492671 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96373305-f4c1-4440-a3a9-e2a4673d6a68 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:16:29.494149 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96373305-f4c1-4440-a3a9-e2a4673d6a68 service cinder] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:16:29.503674 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1216/2416] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:16:29 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 14:16:29.871221 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5163b9a2-fa9c-485c-9ce3-0d488b18b0fb None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:16:29.871492 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5163b9a2-fa9c-485c-9ce3-0d488b18b0fb None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:16:29.871770 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5163b9a2-fa9c-485c-9ce3-0d488b18b0fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:16:29.891921 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-5163b9a2-fa9c-485c-9ce3-0d488b18b0fb None None] MFA Rules not processed for user `dec39ff0b6544a738e5aae06e9a8cb38`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:16:29.893121 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-5163b9a2-fa9c-485c-9ce3-0d488b18b0fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:16:29.946408 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1201/2417] 10.222.0.36 () {58 vars in 967 bytes} [Tue May 3 14:16:29 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:16:29.959325 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96373305-f4c1-4440-a3a9-e2a4673d6a68 service cinder] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:16:29.961023 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-96373305-f4c1-4440-a3a9-e2a4673d6a68 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:16:30.037362 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96373305-f4c1-4440-a3a9-e2a4673d6a68 service cinder] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:16:30.044964 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a81462-639c-407d-aee3-a9f71f73eca2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1180e29180d44418390cf22d3e0bd6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:16:30.045656 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a81462-639c-407d-aee3-a9f71f73eca2 service swift] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:16:30.045937 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a81462-639c-407d-aee3-a9f71f73eca2 service swift] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:16:30.046210 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a81462-639c-407d-aee3-a9f71f73eca2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:16:30.055503 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a81462-639c-407d-aee3-a9f71f73eca2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:16:30.057136 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a81462-639c-407d-aee3-a9f71f73eca2 service swift] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:16:30.065418 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1217/2418] 10.222.0.36 () {60 vars in 1384 bytes} [Tue May 3 14:16:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 03 14:16:39.695538 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5163b9a2-fa9c-485c-9ce3-0d488b18b0fb None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:16:39.763700 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5163b9a2-fa9c-485c-9ce3-0d488b18b0fb None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:16:39.774350 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c5fa8d-5a82-4915-9551-f0fb5dfef28f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:16:39.775312 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c5fa8d-5a82-4915-9551-f0fb5dfef28f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:16:39.775593 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c5fa8d-5a82-4915-9551-f0fb5dfef28f admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:16:39.775862 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c5fa8d-5a82-4915-9551-f0fb5dfef28f admin admin] PATH_INFO: `/v3/users/e33b2cd997024a32b79e5384454fafdc` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:16:39.777327 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c5fa8d-5a82-4915-9551-f0fb5dfef28f admin admin] RBAC: Authorizing `identity:delete_user(user_id=e33b2cd997024a32b79e5384454fafdc)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:16:39.779468 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c5fa8d-5a82-4915-9551-f0fb5dfef28f admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:16:39.872108 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-d8c5fa8d-5a82-4915-9551-f0fb5dfef28f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e33b2cd997024a32b79e5384454fafdc'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:16:39.881443 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-d8c5fa8d-5a82-4915-9551-f0fb5dfef28f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e33b2cd997024a32b79e5384454fafdc'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:16:39.882345 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-d8c5fa8d-5a82-4915-9551-f0fb5dfef28f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e33b2cd997024a32b79e5384454fafdc'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:16:39.895382 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-d8c5fa8d-5a82-4915-9551-f0fb5dfef28f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e33b2cd997024a32b79e5384454fafdc'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:16:39.896116 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-d8c5fa8d-5a82-4915-9551-f0fb5dfef28f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e33b2cd997024a32b79e5384454fafdc'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:16:39.913555 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1202/2419] 10.222.0.36 () {58 vars in 1223 bytes} [Tue May 3 14:16:39 2022] DELETE /identity/v3/users/e33b2cd997024a32b79e5384454fafdc => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:16:39.915379 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4de3ee-5607-414b-8077-9da2bd1798a9 None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:16:39.915845 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4de3ee-5607-414b-8077-9da2bd1798a9 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:16:39.916017 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4de3ee-5607-414b-8077-9da2bd1798a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:16:39.936479 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-9c4de3ee-5607-414b-8077-9da2bd1798a9 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:16:39.937809 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-9c4de3ee-5607-414b-8077-9da2bd1798a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:16:40.004293 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1218/2420] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:16:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:16:40.014030 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c5fa8d-5a82-4915-9551-f0fb5dfef28f admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:16:40.015539 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-d8c5fa8d-5a82-4915-9551-f0fb5dfef28f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:16:40.077279 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c5fa8d-5a82-4915-9551-f0fb5dfef28f admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:16:40.081091 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0833027f-1767-487c-8b26-c0e8fa830256 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '937bea4f355144b4a7ee11baabc3a4cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:16:40.081784 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0833027f-1767-487c-8b26-c0e8fa830256 service neutron] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:16:40.082050 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0833027f-1767-487c-8b26-c0e8fa830256 service neutron] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:16:40.082319 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0833027f-1767-487c-8b26-c0e8fa830256 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:16:40.092502 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0833027f-1767-487c-8b26-c0e8fa830256 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:16:40.094054 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0833027f-1767-487c-8b26-c0e8fa830256 service neutron] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:16:40.103670 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1203/2421] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:16:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 14:16:40.457206 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4de3ee-5607-414b-8077-9da2bd1798a9 None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:16:40.458715 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-9c4de3ee-5607-414b-8077-9da2bd1798a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:16:40.479935 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4de3ee-5607-414b-8077-9da2bd1798a9 None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:16:40.487834 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c2e839-7923-4d28-9bc9-7becb60ff592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:16:40.488760 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c2e839-7923-4d28-9bc9-7becb60ff592 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:16:40.489035 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c2e839-7923-4d28-9bc9-7becb60ff592 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:16:40.489330 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c2e839-7923-4d28-9bc9-7becb60ff592 admin admin] PATH_INFO: `/v3/projects/e26e827ce3374abb9d0198b87e16c9b3` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:16:40.490558 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c2e839-7923-4d28-9bc9-7becb60ff592 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e26e827ce3374abb9d0198b87e16c9b3)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:16:40.492615 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c2e839-7923-4d28-9bc9-7becb60ff592 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:16:40.543916 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-c3c2e839-7923-4d28-9bc9-7becb60ff592 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e26e827ce3374abb9d0198b87e16c9b3', 'request_id': 'req-c3c2e839-7923-4d28-9bc9-7becb60ff592'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:16:40.550380 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-c3c2e839-7923-4d28-9bc9-7becb60ff592 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e26e827ce3374abb9d0198b87e16c9b3', 'request_id': 'req-c3c2e839-7923-4d28-9bc9-7becb60ff592'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:16:40.559250 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-c3c2e839-7923-4d28-9bc9-7becb60ff592 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e26e827ce3374abb9d0198b87e16c9b3', 'request_id': 'req-c3c2e839-7923-4d28-9bc9-7becb60ff592'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:16:40.570886 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-c3c2e839-7923-4d28-9bc9-7becb60ff592 admin admin] The token cache is being invalidate because project e26e827ce3374abb9d0198b87e16c9b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80013) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 14:16:40.571186 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-c3c2e839-7923-4d28-9bc9-7becb60ff592 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:16:40.571830 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-c3c2e839-7923-4d28-9bc9-7becb60ff592 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:16:40.579702 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1219/2422] 10.222.0.36 () {58 vars in 1232 bytes} [Tue May 3 14:16:40 2022] DELETE /identity/v3/projects/e26e827ce3374abb9d0198b87e16c9b3 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:16:49.900831 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edefcfb-bcee-4f6c-9c9f-149880bce349 None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:16:49.901414 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edefcfb-bcee-4f6c-9c9f-149880bce349 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:16:49.901414 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edefcfb-bcee-4f6c-9c9f-149880bce349 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:16:49.918298 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-3edefcfb-bcee-4f6c-9c9f-149880bce349 None None] MFA Rules not processed for user `38de7546d3524382b4589def32732e6e`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:16:49.919487 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-3edefcfb-bcee-4f6c-9c9f-149880bce349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:16:49.972845 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1204/2423] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:16:49 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 14:17:20.882527 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe04ff14-160d-4107-821b-ecd6590666db None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:17:20.883041 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe04ff14-160d-4107-821b-ecd6590666db None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:17:20.883152 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe04ff14-160d-4107-821b-ecd6590666db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:17:20.903188 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-fe04ff14-160d-4107-821b-ecd6590666db None None] MFA Rules not processed for user `93f81a3015ce4e70a69b5d91c279b37b`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:17:20.904403 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-fe04ff14-160d-4107-821b-ecd6590666db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:17:20.962712 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1220/2424] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:17:20 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:17:28.344801 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9381f1-3b10-472a-8e8e-186ce8f9f15d None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:17:28.345319 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9381f1-3b10-472a-8e8e-186ce8f9f15d None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:17:28.345434 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9381f1-3b10-472a-8e8e-186ce8f9f15d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:17:28.365538 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-1d9381f1-3b10-472a-8e8e-186ce8f9f15d None None] MFA Rules not processed for user `dec39ff0b6544a738e5aae06e9a8cb38`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:17:28.366723 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-1d9381f1-3b10-472a-8e8e-186ce8f9f15d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:17:28.420472 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1205/2425] 10.222.0.36 () {58 vars in 967 bytes} [Tue May 3 14:17:28 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:17:28.442592 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe04ff14-160d-4107-821b-ecd6590666db None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:17:28.444191 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-fe04ff14-160d-4107-821b-ecd6590666db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:17:28.515946 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe04ff14-160d-4107-821b-ecd6590666db None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:17:28.521526 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4137714a-e99b-4ec5-8c0b-03a6e32ebd83 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1180e29180d44418390cf22d3e0bd6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:17:28.522176 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4137714a-e99b-4ec5-8c0b-03a6e32ebd83 service swift] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:17:28.522457 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4137714a-e99b-4ec5-8c0b-03a6e32ebd83 service swift] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:17:28.522727 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4137714a-e99b-4ec5-8c0b-03a6e32ebd83 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:17:28.531420 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4137714a-e99b-4ec5-8c0b-03a6e32ebd83 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:17:28.532950 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4137714a-e99b-4ec5-8c0b-03a6e32ebd83 service swift] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:17:28.541472 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1221/2426] 10.222.0.36 () {60 vars in 1384 bytes} [Tue May 3 14:17:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 03 14:17:36.577605 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9381f1-3b10-472a-8e8e-186ce8f9f15d None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:17:36.579092 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-1d9381f1-3b10-472a-8e8e-186ce8f9f15d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:17:36.693279 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9381f1-3b10-472a-8e8e-186ce8f9f15d None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:17:36.699126 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58a3962-439a-487b-9605-a9299899d11b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:17:36.702465 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58a3962-439a-487b-9605-a9299899d11b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:17:36.703141 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58a3962-439a-487b-9605-a9299899d11b admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:17:36.704868 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58a3962-439a-487b-9605-a9299899d11b admin admin] PATH_INFO: `/v3/users/39f0797cbeb448769677f54f936b915d` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:17:36.708228 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58a3962-439a-487b-9605-a9299899d11b admin admin] RBAC: Authorizing `identity:delete_user(user_id=39f0797cbeb448769677f54f936b915d)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:17:36.711401 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58a3962-439a-487b-9605-a9299899d11b admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:17:36.791305 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-d58a3962-439a-487b-9605-a9299899d11b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39f0797cbeb448769677f54f936b915d'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:17:36.799138 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-d58a3962-439a-487b-9605-a9299899d11b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39f0797cbeb448769677f54f936b915d'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:17:36.800489 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-d58a3962-439a-487b-9605-a9299899d11b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39f0797cbeb448769677f54f936b915d'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:17:36.818112 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-d58a3962-439a-487b-9605-a9299899d11b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39f0797cbeb448769677f54f936b915d'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:17:36.819133 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-d58a3962-439a-487b-9605-a9299899d11b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39f0797cbeb448769677f54f936b915d'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:17:36.837906 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1206/2427] 10.222.0.36 () {58 vars in 1223 bytes} [Tue May 3 14:17:36 2022] DELETE /identity/v3/users/39f0797cbeb448769677f54f936b915d => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:17:37.026823 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4137714a-e99b-4ec5-8c0b-03a6e32ebd83 service swift] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:17:37.042575 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4137714a-e99b-4ec5-8c0b-03a6e32ebd83 service swift] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:17:37.112013 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92228b94-6011-44f0-ad4f-4fcf744ddace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:17:37.113041 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92228b94-6011-44f0-ad4f-4fcf744ddace admin admin] REQUEST_METHOD: `DELETE` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:17:37.113413 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92228b94-6011-44f0-ad4f-4fcf744ddace admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:17:37.113982 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92228b94-6011-44f0-ad4f-4fcf744ddace admin admin] PATH_INFO: `/v3/projects/1c2479422e8c413e8ee554aa4f355bca` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:17:37.115290 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92228b94-6011-44f0-ad4f-4fcf744ddace admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c2479422e8c413e8ee554aa4f355bca)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:17:37.117184 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92228b94-6011-44f0-ad4f-4fcf744ddace admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:17:37.164028 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-92228b94-6011-44f0-ad4f-4fcf744ddace admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c2479422e8c413e8ee554aa4f355bca', 'request_id': 'req-92228b94-6011-44f0-ad4f-4fcf744ddace'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:17:37.169922 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-92228b94-6011-44f0-ad4f-4fcf744ddace admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c2479422e8c413e8ee554aa4f355bca', 'request_id': 'req-92228b94-6011-44f0-ad4f-4fcf744ddace'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:17:37.178384 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-92228b94-6011-44f0-ad4f-4fcf744ddace admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c2479422e8c413e8ee554aa4f355bca', 'request_id': 'req-92228b94-6011-44f0-ad4f-4fcf744ddace'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:17:37.189365 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-92228b94-6011-44f0-ad4f-4fcf744ddace admin admin] The token cache is being invalidate because project 1c2479422e8c413e8ee554aa4f355bca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80013) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 14:17:37.189647 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-92228b94-6011-44f0-ad4f-4fcf744ddace admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:17:37.190421 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-92228b94-6011-44f0-ad4f-4fcf744ddace admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:17:37.192110 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1222/2428] 10.222.0.36 () {58 vars in 1232 bytes} [Tue May 3 14:17:37 2022] DELETE /identity/v3/projects/1c2479422e8c413e8ee554aa4f355bca => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:17:37.196183 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58a3962-439a-487b-9605-a9299899d11b admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:17:37.197710 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-d58a3962-439a-487b-9605-a9299899d11b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:17:37.212431 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58a3962-439a-487b-9605-a9299899d11b admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:17:37.268696 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d22af43-7632-4132-bd31-7aeb35f5a3aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:17:37.269538 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d22af43-7632-4132-bd31-7aeb35f5a3aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:17:37.269824 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d22af43-7632-4132-bd31-7aeb35f5a3aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:17:37.270105 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d22af43-7632-4132-bd31-7aeb35f5a3aa admin admin] PATH_INFO: `/v3/users/646959f190b24b3fa5438b72f32b06a5` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:17:37.271302 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d22af43-7632-4132-bd31-7aeb35f5a3aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=646959f190b24b3fa5438b72f32b06a5)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:17:37.273231 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d22af43-7632-4132-bd31-7aeb35f5a3aa admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:17:37.320244 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-8d22af43-7632-4132-bd31-7aeb35f5a3aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '646959f190b24b3fa5438b72f32b06a5'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:17:37.327273 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-8d22af43-7632-4132-bd31-7aeb35f5a3aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '646959f190b24b3fa5438b72f32b06a5'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:17:37.327924 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-8d22af43-7632-4132-bd31-7aeb35f5a3aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '646959f190b24b3fa5438b72f32b06a5'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:17:37.339682 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-8d22af43-7632-4132-bd31-7aeb35f5a3aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '646959f190b24b3fa5438b72f32b06a5'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:17:37.340347 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-8d22af43-7632-4132-bd31-7aeb35f5a3aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '646959f190b24b3fa5438b72f32b06a5'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:17:37.354571 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1207/2429] 10.222.0.36 () {58 vars in 1223 bytes} [Tue May 3 14:17:37 2022] DELETE /identity/v3/users/646959f190b24b3fa5438b72f32b06a5 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 14:17:37.543175 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92228b94-6011-44f0-ad4f-4fcf744ddace admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:17:37.544671 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-92228b94-6011-44f0-ad4f-4fcf744ddace admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:17:37.558148 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92228b94-6011-44f0-ad4f-4fcf744ddace admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:17:37.616083 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2932fb-2855-4846-97f4-53ae19b75446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:17:37.616967 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2932fb-2855-4846-97f4-53ae19b75446 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:17:37.617241 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2932fb-2855-4846-97f4-53ae19b75446 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:17:37.617546 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2932fb-2855-4846-97f4-53ae19b75446 admin admin] PATH_INFO: `/v3/projects/82dd2e372240457991d34104d485914e` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:17:37.618862 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2932fb-2855-4846-97f4-53ae19b75446 admin admin] RBAC: Authorizing `identity:delete_project(project_id=82dd2e372240457991d34104d485914e)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:17:37.620837 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2932fb-2855-4846-97f4-53ae19b75446 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:17:37.667322 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-6e2932fb-2855-4846-97f4-53ae19b75446 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '82dd2e372240457991d34104d485914e', 'request_id': 'req-6e2932fb-2855-4846-97f4-53ae19b75446'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:17:37.672947 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-6e2932fb-2855-4846-97f4-53ae19b75446 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '82dd2e372240457991d34104d485914e', 'request_id': 'req-6e2932fb-2855-4846-97f4-53ae19b75446'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:17:37.682326 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-6e2932fb-2855-4846-97f4-53ae19b75446 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '82dd2e372240457991d34104d485914e', 'request_id': 'req-6e2932fb-2855-4846-97f4-53ae19b75446'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:17:37.695962 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-6e2932fb-2855-4846-97f4-53ae19b75446 admin admin] The token cache is being invalidate because project 82dd2e372240457991d34104d485914e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80013) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 14:17:37.696248 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-6e2932fb-2855-4846-97f4-53ae19b75446 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:17:37.696967 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-6e2932fb-2855-4846-97f4-53ae19b75446 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:17:37.698660 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1223/2430] 10.222.0.36 () {58 vars in 1232 bytes} [Tue May 3 14:17:37 2022] DELETE /identity/v3/projects/82dd2e372240457991d34104d485914e => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:17:40.343412 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ea73ff-a48f-486f-a9c6-4b2da867b7aa None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:17:40.344673 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ea73ff-a48f-486f-a9c6-4b2da867b7aa None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:17:40.344957 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ea73ff-a48f-486f-a9c6-4b2da867b7aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:17:40.366029 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-c7ea73ff-a48f-486f-a9c6-4b2da867b7aa None None] MFA Rules not processed for user `b67e152bc8e94244bce87e63c3b33747`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:17:40.367242 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-c7ea73ff-a48f-486f-a9c6-4b2da867b7aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:17:40.430284 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1208/2431] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:17:40 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:17:58.463767 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c84b09-a65b-4bd2-97bf-193f8af7c3dc None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:17:58.464323 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c84b09-a65b-4bd2-97bf-193f8af7c3dc None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:17:58.464323 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c84b09-a65b-4bd2-97bf-193f8af7c3dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:17:58.483098 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-08c84b09-a65b-4bd2-97bf-193f8af7c3dc None None] MFA Rules not processed for user `38de7546d3524382b4589def32732e6e`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:17:58.484304 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-08c84b09-a65b-4bd2-97bf-193f8af7c3dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:17:58.539281 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1224/2432] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:17:58 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:18:06.168388 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ea73ff-a48f-486f-a9c6-4b2da867b7aa None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:18:06.170123 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-c7ea73ff-a48f-486f-a9c6-4b2da867b7aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:18:06.225095 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ea73ff-a48f-486f-a9c6-4b2da867b7aa None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:18:06.228912 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c597e1-bde8-4ebf-9b55-8a4330e9bf68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '937bea4f355144b4a7ee11baabc3a4cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:18:06.229594 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c597e1-bde8-4ebf-9b55-8a4330e9bf68 service neutron] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:18:06.229874 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c597e1-bde8-4ebf-9b55-8a4330e9bf68 service neutron] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:18:06.230149 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c597e1-bde8-4ebf-9b55-8a4330e9bf68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:18:06.231883 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-29c597e1-bde8-4ebf-9b55-8a4330e9bf68 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:18:06.302340 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c597e1-bde8-4ebf-9b55-8a4330e9bf68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:18:06.303778 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c597e1-bde8-4ebf-9b55-8a4330e9bf68 service neutron] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:18:06.314724 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1209/2433] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:18:06 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 14:18:06.812911 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c84b09-a65b-4bd2-97bf-193f8af7c3dc None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:18:06.814492 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-08c84b09-a65b-4bd2-97bf-193f8af7c3dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:18:06.826577 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c84b09-a65b-4bd2-97bf-193f8af7c3dc None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:18:06.830087 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec3864c-9da5-4cf2-8a9e-9319bde952a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '937bea4f355144b4a7ee11baabc3a4cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:18:06.830733 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec3864c-9da5-4cf2-8a9e-9319bde952a2 service neutron] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:18:06.831036 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec3864c-9da5-4cf2-8a9e-9319bde952a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:18:06.831309 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec3864c-9da5-4cf2-8a9e-9319bde952a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:18:06.833031 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-bec3864c-9da5-4cf2-8a9e-9319bde952a2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:18:06.846684 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec3864c-9da5-4cf2-8a9e-9319bde952a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:18:06.848339 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec3864c-9da5-4cf2-8a9e-9319bde952a2 service neutron] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:18:06.859936 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1225/2434] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:18:06 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 14:18:10.257215 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b117ae5-cf68-453a-8467-cf0966856b37 None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:18:10.257783 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b117ae5-cf68-453a-8467-cf0966856b37 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:18:10.257783 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b117ae5-cf68-453a-8467-cf0966856b37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:18:10.281878 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-3b117ae5-cf68-453a-8467-cf0966856b37 None None] MFA Rules not processed for user `7b05c6d36153485c9859ce7b749ab40c`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:18:10.283128 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-3b117ae5-cf68-453a-8467-cf0966856b37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:18:10.367744 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1210/2435] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:18:10 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:18:10.694491 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec3864c-9da5-4cf2-8a9e-9319bde952a2 service neutron] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:18:10.703655 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec3864c-9da5-4cf2-8a9e-9319bde952a2 service neutron] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:18:10.707927 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f951233-3d6b-4a0e-a882-11246e614507 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '937bea4f355144b4a7ee11baabc3a4cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:18:10.708582 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f951233-3d6b-4a0e-a882-11246e614507 service neutron] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:18:10.708862 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f951233-3d6b-4a0e-a882-11246e614507 service neutron] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:18:10.709118 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f951233-3d6b-4a0e-a882-11246e614507 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:18:10.711634 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-0f951233-3d6b-4a0e-a882-11246e614507 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:18:10.722071 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f951233-3d6b-4a0e-a882-11246e614507 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:18:10.723504 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f951233-3d6b-4a0e-a882-11246e614507 service neutron] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:18:10.731878 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1226/2436] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:18:10 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 14:18:11.205721 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b117ae5-cf68-453a-8467-cf0966856b37 None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:18:11.207606 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-3b117ae5-cf68-453a-8467-cf0966856b37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:18:11.285448 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b117ae5-cf68-453a-8467-cf0966856b37 None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:18:11.290400 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b69c308-5324-431f-864c-058f3c3103fa service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '164c7f36acf644e9bf93f158e876e9e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:18:11.291055 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b69c308-5324-431f-864c-058f3c3103fa service placement] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:18:11.291334 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b69c308-5324-431f-864c-058f3c3103fa service placement] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:18:11.291610 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b69c308-5324-431f-864c-058f3c3103fa service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:18:11.293473 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-0b69c308-5324-431f-864c-058f3c3103fa service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:18:11.305052 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b69c308-5324-431f-864c-058f3c3103fa service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:18:11.306664 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b69c308-5324-431f-864c-058f3c3103fa service placement] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:18:11.316805 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1211/2437] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:18:11 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 14:18:20.687523 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f951233-3d6b-4a0e-a882-11246e614507 service neutron] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:18:20.689198 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-0f951233-3d6b-4a0e-a882-11246e614507 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:18:20.706227 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f951233-3d6b-4a0e-a882-11246e614507 service neutron] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:18:20.712633 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683a21d2-a9dc-4a26-9f04-9333db47de1b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63489e658c094a2598a2ac62159d2fda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:18:20.713261 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683a21d2-a9dc-4a26-9f04-9333db47de1b service nova] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:18:20.713570 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683a21d2-a9dc-4a26-9f04-9333db47de1b service nova] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:18:20.713846 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683a21d2-a9dc-4a26-9f04-9333db47de1b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:18:20.715788 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-683a21d2-a9dc-4a26-9f04-9333db47de1b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:18:20.726450 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683a21d2-a9dc-4a26-9f04-9333db47de1b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:18:20.728034 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683a21d2-a9dc-4a26-9f04-9333db47de1b service nova] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:18:20.737402 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1227/2438] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:18:20 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 14:18:22.944299 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b69c308-5324-431f-864c-058f3c3103fa service placement] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:18:22.954054 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b69c308-5324-431f-864c-058f3c3103fa service placement] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:18:22.957961 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2cde00-443e-4637-8bed-c1f8f382ba73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '937bea4f355144b4a7ee11baabc3a4cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:18:22.958772 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2cde00-443e-4637-8bed-c1f8f382ba73 service neutron] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:18:22.959020 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2cde00-443e-4637-8bed-c1f8f382ba73 service neutron] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:18:22.959320 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2cde00-443e-4637-8bed-c1f8f382ba73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:18:22.961749 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-eb2cde00-443e-4637-8bed-c1f8f382ba73 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:18:22.973186 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2cde00-443e-4637-8bed-c1f8f382ba73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:18:22.974664 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2cde00-443e-4637-8bed-c1f8f382ba73 service neutron] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:18:22.983856 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1212/2439] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:18:22 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 14:18:24.546625 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683a21d2-a9dc-4a26-9f04-9333db47de1b service nova] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:18:24.557894 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683a21d2-a9dc-4a26-9f04-9333db47de1b service nova] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:18:24.563638 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb1c92d-3f5d-406f-95ec-4c1319b19690 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '937bea4f355144b4a7ee11baabc3a4cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:18:24.564445 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb1c92d-3f5d-406f-95ec-4c1319b19690 service neutron] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:18:24.564817 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb1c92d-3f5d-406f-95ec-4c1319b19690 service neutron] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:18:24.565153 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb1c92d-3f5d-406f-95ec-4c1319b19690 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:18:24.567391 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-0cb1c92d-3f5d-406f-95ec-4c1319b19690 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:18:24.628711 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb1c92d-3f5d-406f-95ec-4c1319b19690 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:18:24.630214 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb1c92d-3f5d-406f-95ec-4c1319b19690 service neutron] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:18:24.639806 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1228/2440] 10.222.0.36 () {60 vars in 1396 bytes} [Tue May 3 14:18:24 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3254 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 14:18:27.956094 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2cde00-443e-4637-8bed-c1f8f382ba73 service neutron] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:18:27.970419 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2cde00-443e-4637-8bed-c1f8f382ba73 service neutron] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:18:27.976033 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6e1a1a-57b8-48a0-aa0c-0e59b5a9e418 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63489e658c094a2598a2ac62159d2fda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:18:27.976702 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6e1a1a-57b8-48a0-aa0c-0e59b5a9e418 service nova] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:18:27.976974 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6e1a1a-57b8-48a0-aa0c-0e59b5a9e418 service nova] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:18:27.977246 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6e1a1a-57b8-48a0-aa0c-0e59b5a9e418 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:18:27.979131 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-8d6e1a1a-57b8-48a0-aa0c-0e59b5a9e418 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:18:27.991812 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6e1a1a-57b8-48a0-aa0c-0e59b5a9e418 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:18:27.994208 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6e1a1a-57b8-48a0-aa0c-0e59b5a9e418 service nova] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:18:28.005168 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1213/2441] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:18:27 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 14:18:36.384002 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb1c92d-3f5d-406f-95ec-4c1319b19690 service neutron] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:18:36.385699 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-0cb1c92d-3f5d-406f-95ec-4c1319b19690 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:18:36.406905 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb1c92d-3f5d-406f-95ec-4c1319b19690 service neutron] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:18:36.414340 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b33289-187f-454f-9fd0-a8d7a3778cc2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63489e658c094a2598a2ac62159d2fda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:18:36.415083 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b33289-187f-454f-9fd0-a8d7a3778cc2 service nova] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:18:36.415367 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b33289-187f-454f-9fd0-a8d7a3778cc2 service nova] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:18:36.416424 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b33289-187f-454f-9fd0-a8d7a3778cc2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:18:36.418488 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-d2b33289-187f-454f-9fd0-a8d7a3778cc2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:18:36.443534 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b33289-187f-454f-9fd0-a8d7a3778cc2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:18:36.445143 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b33289-187f-454f-9fd0-a8d7a3778cc2 service nova] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:18:36.457730 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1229/2442] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:18:36 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 14:18:36.593754 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62767f4-b8e1-4bc2-88ac-5d513460551f None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:18:36.595048 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62767f4-b8e1-4bc2-88ac-5d513460551f None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:18:36.595310 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62767f4-b8e1-4bc2-88ac-5d513460551f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:18:36.614029 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-a62767f4-b8e1-4bc2-88ac-5d513460551f None None] MFA Rules not processed for user `dec39ff0b6544a738e5aae06e9a8cb38`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:18:36.615442 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-a62767f4-b8e1-4bc2-88ac-5d513460551f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:18:36.689152 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1214/2443] 10.222.0.36 () {58 vars in 1009 bytes} [Tue May 3 14:18:36 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:18:36.746018 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b33289-187f-454f-9fd0-a8d7a3778cc2 service nova] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:18:36.747972 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-d2b33289-187f-454f-9fd0-a8d7a3778cc2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:18:36.827977 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b33289-187f-454f-9fd0-a8d7a3778cc2 service nova] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:18:36.833173 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b40950-11af-4724-8079-8c0d2aa9cd7e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1180e29180d44418390cf22d3e0bd6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:18:36.833854 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b40950-11af-4724-8079-8c0d2aa9cd7e service swift] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:18:36.834133 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b40950-11af-4724-8079-8c0d2aa9cd7e service swift] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:18:36.834850 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b40950-11af-4724-8079-8c0d2aa9cd7e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:18:36.845232 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b40950-11af-4724-8079-8c0d2aa9cd7e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:18:36.847171 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b40950-11af-4724-8079-8c0d2aa9cd7e service swift] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:18:36.858636 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1230/2444] 10.222.0.36 () {60 vars in 1384 bytes} [Tue May 3 14:18:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 03 14:18:37.322799 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62767f4-b8e1-4bc2-88ac-5d513460551f None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:18:37.334106 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62767f4-b8e1-4bc2-88ac-5d513460551f None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:18:37.339160 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a44b9f4-d962-4ac5-b7d2-efddcca7c554 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '937bea4f355144b4a7ee11baabc3a4cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:18:37.339892 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a44b9f4-d962-4ac5-b7d2-efddcca7c554 service neutron] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:18:37.340385 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a44b9f4-d962-4ac5-b7d2-efddcca7c554 service neutron] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:18:37.340848 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a44b9f4-d962-4ac5-b7d2-efddcca7c554 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:18:37.342962 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-9a44b9f4-d962-4ac5-b7d2-efddcca7c554 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:18:37.426720 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a44b9f4-d962-4ac5-b7d2-efddcca7c554 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:18:37.428468 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a44b9f4-d962-4ac5-b7d2-efddcca7c554 service neutron] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:18:37.439343 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1215/2445] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:18:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 14:18:41.303091 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b40950-11af-4724-8079-8c0d2aa9cd7e service swift] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:18:41.304615 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-37b40950-11af-4724-8079-8c0d2aa9cd7e service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:18:41.327515 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b40950-11af-4724-8079-8c0d2aa9cd7e service swift] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:18:41.332647 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f8306e-7fca-4cda-820a-a7a0e606926f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:18:41.333659 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f8306e-7fca-4cda-820a-a7a0e606926f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:18:41.334065 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f8306e-7fca-4cda-820a-a7a0e606926f admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:18:41.334714 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f8306e-7fca-4cda-820a-a7a0e606926f admin admin] PATH_INFO: `/v3/users/b67e152bc8e94244bce87e63c3b33747` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:18:41.335991 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f8306e-7fca-4cda-820a-a7a0e606926f admin admin] RBAC: Authorizing `identity:delete_user(user_id=b67e152bc8e94244bce87e63c3b33747)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:18:41.338058 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f8306e-7fca-4cda-820a-a7a0e606926f admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:18:41.400786 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-e9f8306e-7fca-4cda-820a-a7a0e606926f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b67e152bc8e94244bce87e63c3b33747'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:18:41.412012 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-e9f8306e-7fca-4cda-820a-a7a0e606926f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b67e152bc8e94244bce87e63c3b33747'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:18:41.412731 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-e9f8306e-7fca-4cda-820a-a7a0e606926f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b67e152bc8e94244bce87e63c3b33747'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:18:41.422841 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-e9f8306e-7fca-4cda-820a-a7a0e606926f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b67e152bc8e94244bce87e63c3b33747'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:18:41.423668 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-e9f8306e-7fca-4cda-820a-a7a0e606926f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b67e152bc8e94244bce87e63c3b33747'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:18:41.445628 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1231/2446] 10.222.0.36 () {58 vars in 1223 bytes} [Tue May 3 14:18:41 2022] DELETE /identity/v3/users/b67e152bc8e94244bce87e63c3b33747 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:18:41.650564 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a44b9f4-d962-4ac5-b7d2-efddcca7c554 service neutron] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:18:41.664494 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a44b9f4-d962-4ac5-b7d2-efddcca7c554 service neutron] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:18:41.730179 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203cd07b-ef89-4b21-a5c9-690a197d4619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:18:41.732098 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203cd07b-ef89-4b21-a5c9-690a197d4619 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:18:41.732715 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203cd07b-ef89-4b21-a5c9-690a197d4619 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:18:41.733426 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203cd07b-ef89-4b21-a5c9-690a197d4619 admin admin] PATH_INFO: `/v3/projects/4e31890e50da4bcab23b81eee1c9a2d7` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:18:41.735424 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203cd07b-ef89-4b21-a5c9-690a197d4619 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e31890e50da4bcab23b81eee1c9a2d7)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:18:41.737637 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203cd07b-ef89-4b21-a5c9-690a197d4619 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:18:41.802298 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-203cd07b-ef89-4b21-a5c9-690a197d4619 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e31890e50da4bcab23b81eee1c9a2d7', 'request_id': 'req-203cd07b-ef89-4b21-a5c9-690a197d4619'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:18:41.815955 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-203cd07b-ef89-4b21-a5c9-690a197d4619 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e31890e50da4bcab23b81eee1c9a2d7', 'request_id': 'req-203cd07b-ef89-4b21-a5c9-690a197d4619'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:18:41.823500 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-203cd07b-ef89-4b21-a5c9-690a197d4619 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e31890e50da4bcab23b81eee1c9a2d7', 'request_id': 'req-203cd07b-ef89-4b21-a5c9-690a197d4619'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:18:41.840555 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-203cd07b-ef89-4b21-a5c9-690a197d4619 admin admin] The token cache is being invalidate because project 4e31890e50da4bcab23b81eee1c9a2d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80012) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 14:18:41.840871 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-203cd07b-ef89-4b21-a5c9-690a197d4619 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:18:41.841623 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-203cd07b-ef89-4b21-a5c9-690a197d4619 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:18:41.848995 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1216/2447] 10.222.0.36 () {58 vars in 1232 bytes} [Tue May 3 14:18:41 2022] DELETE /identity/v3/projects/4e31890e50da4bcab23b81eee1c9a2d7 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:18:41.850711 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10df0b0b-6934-4c74-9ff4-954c7bb18588 None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:18:41.851064 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10df0b0b-6934-4c74-9ff4-954c7bb18588 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:18:41.851410 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10df0b0b-6934-4c74-9ff4-954c7bb18588 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:18:41.869779 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-10df0b0b-6934-4c74-9ff4-954c7bb18588 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:18:41.870990 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-10df0b0b-6934-4c74-9ff4-954c7bb18588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:18:41.946336 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1232/2448] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:18:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:18:41.954027 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b666632-7533-4057-bddf-5c47b971e5fb None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:18:41.954321 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b666632-7533-4057-bddf-5c47b971e5fb None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:18:41.954602 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b666632-7533-4057-bddf-5c47b971e5fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:18:41.976453 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-4b666632-7533-4057-bddf-5c47b971e5fb None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:18:41.977841 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-4b666632-7533-4057-bddf-5c47b971e5fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:18:41.986722 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1217/2449] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:18:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 14:18:41.991916 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10df0b0b-6934-4c74-9ff4-954c7bb18588 None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:18:42.003887 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10df0b0b-6934-4c74-9ff4-954c7bb18588 None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:18:42.008818 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8f4be4-b950-4f92-8786-1647f570a835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:18:42.009610 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8f4be4-b950-4f92-8786-1647f570a835 admin admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:18:42.009956 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8f4be4-b950-4f92-8786-1647f570a835 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:18:42.010298 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8f4be4-b950-4f92-8786-1647f570a835 admin admin] PATH_INFO: `/v3/domains` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:18:42.011109 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8f4be4-b950-4f92-8786-1647f570a835 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:18:42.011501 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8f4be4-b950-4f92-8786-1647f570a835 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:18:42.013173 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8f4be4-b950-4f92-8786-1647f570a835 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:18:42.027961 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1233/2450] 10.222.0.36 () {58 vars in 1152 bytes} [Tue May 3 14:18:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:18:42.032576 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b666632-7533-4057-bddf-5c47b971e5fb None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:18:42.043880 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b666632-7533-4057-bddf-5c47b971e5fb None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:18:42.048988 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1916175a-f8f7-4255-a4ed-1e19d9cc8a87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:18:42.049792 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1916175a-f8f7-4255-a4ed-1e19d9cc8a87 admin admin] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:18:42.050136 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1916175a-f8f7-4255-a4ed-1e19d9cc8a87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:18:42.050472 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1916175a-f8f7-4255-a4ed-1e19d9cc8a87 admin admin] PATH_INFO: `/v3/projects` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:18:42.051231 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1916175a-f8f7-4255-a4ed-1e19d9cc8a87 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:18:42.054205 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1916175a-f8f7-4255-a4ed-1e19d9cc8a87 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:18:42.086381 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1218/2451] 10.222.0.36 () {60 vars in 1152 bytes} [Tue May 3 14:18:42 2022] POST /identity/v3/projects => generated 381 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 14:18:42.090769 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8f4be4-b950-4f92-8786-1647f570a835 admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:18:42.105129 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8f4be4-b950-4f92-8786-1647f570a835 admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:18:42.173087 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209dbb87-a03f-434c-a0a0-23476fa46f9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:18:42.173977 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209dbb87-a03f-434c-a0a0-23476fa46f9d admin admin] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:18:42.174382 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209dbb87-a03f-434c-a0a0-23476fa46f9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:18:42.174780 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209dbb87-a03f-434c-a0a0-23476fa46f9d admin admin] PATH_INFO: `/v3/users` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:18:42.175694 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209dbb87-a03f-434c-a0a0-23476fa46f9d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:18:42.179668 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209dbb87-a03f-434c-a0a0-23476fa46f9d admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:18:42.206529 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1234/2452] 10.222.0.36 () {60 vars in 1143 bytes} [Tue May 3 14:18:42 2022] POST /identity/v3/users => generated 291 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 14:18:42.210220 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1916175a-f8f7-4255-a4ed-1e19d9cc8a87 admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:18:42.223388 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1916175a-f8f7-4255-a4ed-1e19d9cc8a87 admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:18:42.228178 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10868f2-49dc-4f1c-b04d-645205ac7ee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:18:42.228920 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10868f2-49dc-4f1c-b04d-645205ac7ee9 admin admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:18:42.229277 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10868f2-49dc-4f1c-b04d-645205ac7ee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:18:42.229632 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10868f2-49dc-4f1c-b04d-645205ac7ee9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:18:42.230442 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10868f2-49dc-4f1c-b04d-645205ac7ee9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:18:42.232103 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10868f2-49dc-4f1c-b04d-645205ac7ee9 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:18:42.248770 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1219/2453] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 3 14:18:42 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 14:18:42.250162 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209dbb87-a03f-434c-a0a0-23476fa46f9d admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:18:42.261369 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209dbb87-a03f-434c-a0a0-23476fa46f9d admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:18:42.266750 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1109f0-1648-48b2-b279-ab70e25488ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:18:42.267761 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1109f0-1648-48b2-b279-ab70e25488ed admin admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:18:42.268381 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1109f0-1648-48b2-b279-ab70e25488ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:18:42.268874 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1109f0-1648-48b2-b279-ab70e25488ed admin admin] PATH_INFO: `/v3/roles` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:18:42.269836 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1109f0-1648-48b2-b279-ab70e25488ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:18:42.271647 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1109f0-1648-48b2-b279-ab70e25488ed admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:18:42.282694 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1235/2454] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 3 14:18:42 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 14:18:42.288265 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10868f2-49dc-4f1c-b04d-645205ac7ee9 admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:18:42.301750 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10868f2-49dc-4f1c-b04d-645205ac7ee9 admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:18:42.308877 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68c3f59-8072-403a-b7a6-c1264e2e1217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:18:42.309936 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68c3f59-8072-403a-b7a6-c1264e2e1217 admin admin] REQUEST_METHOD: `PUT` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:18:42.310261 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68c3f59-8072-403a-b7a6-c1264e2e1217 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:18:42.310634 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68c3f59-8072-403a-b7a6-c1264e2e1217 admin admin] PATH_INFO: `/v3/projects/cd769b76e20444eab5f32e809c6eda33/users/7d3a4779e6cd48b99b98d05000efad02/roles/441fdc11e95b47f4813f72610e39018b` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:18:42.335145 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68c3f59-8072-403a-b7a6-c1264e2e1217 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd769b76e20444eab5f32e809c6eda33, user_id=7d3a4779e6cd48b99b98d05000efad02, role_id=441fdc11e95b47f4813f72610e39018b)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:18:42.338655 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68c3f59-8072-403a-b7a6-c1264e2e1217 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:18:42.359038 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1220/2455] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 3 14:18:42 2022] PUT /identity/v3/projects/cd769b76e20444eab5f32e809c6eda33/users/7d3a4779e6cd48b99b98d05000efad02/roles/441fdc11e95b47f4813f72610e39018b => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 14:18:42.369442 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394ca5d9-36f8-4dad-ab99-c48ddbf5efb9 None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:18:42.369969 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394ca5d9-36f8-4dad-ab99-c48ddbf5efb9 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:18:42.370054 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394ca5d9-36f8-4dad-ab99-c48ddbf5efb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:18:42.399763 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-394ca5d9-36f8-4dad-ab99-c48ddbf5efb9 None None] MFA Rules not processed for user `7d3a4779e6cd48b99b98d05000efad02`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:18:42.401000 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-394ca5d9-36f8-4dad-ab99-c48ddbf5efb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:18:42.479538 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1236/2456] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:18:42 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:18:42.480432 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68c3f59-8072-403a-b7a6-c1264e2e1217 admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:18:42.547177 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68c3f59-8072-403a-b7a6-c1264e2e1217 admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:18:42.561309 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2324da-00a2-40b7-9d52-4a08b6dc3cc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:18:42.561309 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2324da-00a2-40b7-9d52-4a08b6dc3cc6 admin admin] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:18:42.561309 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2324da-00a2-40b7-9d52-4a08b6dc3cc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:18:42.561309 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2324da-00a2-40b7-9d52-4a08b6dc3cc6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:18:42.561819 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2324da-00a2-40b7-9d52-4a08b6dc3cc6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:18:42.561819 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2324da-00a2-40b7-9d52-4a08b6dc3cc6 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:18:42.590088 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1221/2457] 10.222.0.36 () {60 vars in 1152 bytes} [Tue May 3 14:18:42 2022] POST /identity/v3/projects => generated 381 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 14:18:42.594182 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394ca5d9-36f8-4dad-ab99-c48ddbf5efb9 None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:18:42.605876 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394ca5d9-36f8-4dad-ab99-c48ddbf5efb9 None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:18:42.666316 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b67d487-61d1-4e79-919f-3ad27a48da2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:18:42.667008 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b67d487-61d1-4e79-919f-3ad27a48da2c admin admin] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:18:42.667289 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b67d487-61d1-4e79-919f-3ad27a48da2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:18:42.667564 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b67d487-61d1-4e79-919f-3ad27a48da2c admin admin] PATH_INFO: `/v3/users` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:18:42.668273 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b67d487-61d1-4e79-919f-3ad27a48da2c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:18:42.670307 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b67d487-61d1-4e79-919f-3ad27a48da2c admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:18:42.693980 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1237/2458] 10.222.0.36 () {60 vars in 1143 bytes} [Tue May 3 14:18:42 2022] POST /identity/v3/users => generated 297 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 14:18:42.698355 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2324da-00a2-40b7-9d52-4a08b6dc3cc6 admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:18:42.709924 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2324da-00a2-40b7-9d52-4a08b6dc3cc6 admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:18:42.717536 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa1c252-06f2-4b2d-a6c1-b340b9ef7d2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:18:42.718219 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa1c252-06f2-4b2d-a6c1-b340b9ef7d2a admin admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:18:42.718502 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa1c252-06f2-4b2d-a6c1-b340b9ef7d2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:18:42.718779 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa1c252-06f2-4b2d-a6c1-b340b9ef7d2a admin admin] PATH_INFO: `/v3/roles` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:18:42.719505 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa1c252-06f2-4b2d-a6c1-b340b9ef7d2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:18:42.721553 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa1c252-06f2-4b2d-a6c1-b340b9ef7d2a admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:18:42.735880 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1222/2459] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 3 14:18:42 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 14:18:42.737048 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b67d487-61d1-4e79-919f-3ad27a48da2c admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:18:42.747447 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b67d487-61d1-4e79-919f-3ad27a48da2c admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:18:42.753850 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11f4349-803b-4cd3-8bcc-79fadd923432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:18:42.754752 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11f4349-803b-4cd3-8bcc-79fadd923432 admin admin] REQUEST_METHOD: `PUT` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:18:42.755033 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11f4349-803b-4cd3-8bcc-79fadd923432 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:18:42.755837 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11f4349-803b-4cd3-8bcc-79fadd923432 admin admin] PATH_INFO: `/v3/projects/1281d83c7e494868bebf89975c5a9d02/users/f51d3210f7ee423fa958e91cc64bc10a/roles/36abe9b50fd8479c86c4f8f70fd85aa3` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:18:42.774745 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11f4349-803b-4cd3-8bcc-79fadd923432 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1281d83c7e494868bebf89975c5a9d02, user_id=f51d3210f7ee423fa958e91cc64bc10a, role_id=36abe9b50fd8479c86c4f8f70fd85aa3)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:18:42.777710 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11f4349-803b-4cd3-8bcc-79fadd923432 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:18:42.807709 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1238/2460] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 3 14:18:42 2022] PUT /identity/v3/projects/1281d83c7e494868bebf89975c5a9d02/users/f51d3210f7ee423fa958e91cc64bc10a/roles/36abe9b50fd8479c86c4f8f70fd85aa3 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 14:18:42.811849 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa1c252-06f2-4b2d-a6c1-b340b9ef7d2a admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:18:42.822480 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa1c252-06f2-4b2d-a6c1-b340b9ef7d2a admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:18:42.884682 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8085bf8-3c0e-494a-961c-78adde4c3860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:18:42.885409 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8085bf8-3c0e-494a-961c-78adde4c3860 admin admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:18:42.885678 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8085bf8-3c0e-494a-961c-78adde4c3860 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:18:42.885955 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8085bf8-3c0e-494a-961c-78adde4c3860 admin admin] PATH_INFO: `/v3/roles` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:18:42.886841 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8085bf8-3c0e-494a-961c-78adde4c3860 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:18:42.888460 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8085bf8-3c0e-494a-961c-78adde4c3860 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:18:42.902559 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1223/2461] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 3 14:18:42 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 14:18:42.903832 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11f4349-803b-4cd3-8bcc-79fadd923432 admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:18:42.915275 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11f4349-803b-4cd3-8bcc-79fadd923432 admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:18:42.924057 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1ea04b-f4b6-4c7f-84c9-f7d1db8e6e35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:18:42.924994 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1ea04b-f4b6-4c7f-84c9-f7d1db8e6e35 admin admin] REQUEST_METHOD: `PUT` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:18:42.925276 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1ea04b-f4b6-4c7f-84c9-f7d1db8e6e35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:18:42.925632 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1ea04b-f4b6-4c7f-84c9-f7d1db8e6e35 admin admin] PATH_INFO: `/v3/projects/1281d83c7e494868bebf89975c5a9d02/users/f51d3210f7ee423fa958e91cc64bc10a/roles/36abe9b50fd8479c86c4f8f70fd85aa3` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:18:42.927746 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1ea04b-f4b6-4c7f-84c9-f7d1db8e6e35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1281d83c7e494868bebf89975c5a9d02, user_id=f51d3210f7ee423fa958e91cc64bc10a, role_id=36abe9b50fd8479c86c4f8f70fd85aa3)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:18:42.930467 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1ea04b-f4b6-4c7f-84c9-f7d1db8e6e35 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:18:42.949340 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1239/2462] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 3 14:18:42 2022] PUT /identity/v3/projects/1281d83c7e494868bebf89975c5a9d02/users/f51d3210f7ee423fa958e91cc64bc10a/roles/36abe9b50fd8479c86c4f8f70fd85aa3 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:18:42.953428 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742f14f0-a675-4c99-b1ef-16f4592af915 None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:18:42.954066 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742f14f0-a675-4c99-b1ef-16f4592af915 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:18:42.954342 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742f14f0-a675-4c99-b1ef-16f4592af915 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:18:42.991384 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-742f14f0-a675-4c99-b1ef-16f4592af915 None None] MFA Rules not processed for user `f51d3210f7ee423fa958e91cc64bc10a`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:18:42.992671 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-742f14f0-a675-4c99-b1ef-16f4592af915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:18:43.082457 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1224/2463] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:18:42 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:18:43.103119 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1ea04b-f4b6-4c7f-84c9-f7d1db8e6e35 admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:18:43.105037 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-5c1ea04b-f4b6-4c7f-84c9-f7d1db8e6e35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:18:43.216418 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1ea04b-f4b6-4c7f-84c9-f7d1db8e6e35 admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:18:43.220258 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd1f953-4e81-43f9-a3b6-12436f201879 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b014f4c7ba1414cb8a597f5bc4033f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:18:43.220969 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd1f953-4e81-43f9-a3b6-12436f201879 service cinder] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:18:43.221266 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd1f953-4e81-43f9-a3b6-12436f201879 service cinder] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:18:43.221553 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd1f953-4e81-43f9-a3b6-12436f201879 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:18:43.234859 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd1f953-4e81-43f9-a3b6-12436f201879 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:18:43.236551 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd1f953-4e81-43f9-a3b6-12436f201879 service cinder] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:18:43.251244 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1240/2464] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:18:43 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 14:18:43.340329 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742f14f0-a675-4c99-b1ef-16f4592af915 None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:18:43.352445 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742f14f0-a675-4c99-b1ef-16f4592af915 None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:18:43.355749 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d8bff2-3df0-4d2b-bc4a-ffc2fad48209 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b014f4c7ba1414cb8a597f5bc4033f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:18:43.356404 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d8bff2-3df0-4d2b-bc4a-ffc2fad48209 service cinder] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:18:43.356680 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d8bff2-3df0-4d2b-bc4a-ffc2fad48209 service cinder] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:18:43.356949 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d8bff2-3df0-4d2b-bc4a-ffc2fad48209 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:18:43.428503 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d8bff2-3df0-4d2b-bc4a-ffc2fad48209 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:18:43.430404 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d8bff2-3df0-4d2b-bc4a-ffc2fad48209 service cinder] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:18:43.440968 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1225/2465] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:18:43 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 14:18:49.103475 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd1f953-4e81-43f9-a3b6-12436f201879 service cinder] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:18:49.105037 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-8bd1f953-4e81-43f9-a3b6-12436f201879 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:18:49.177470 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd1f953-4e81-43f9-a3b6-12436f201879 service cinder] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:18:49.183444 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d9513a-b9bb-4fac-8ce2-ffee845d9765 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63489e658c094a2598a2ac62159d2fda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:18:49.184097 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d9513a-b9bb-4fac-8ce2-ffee845d9765 service nova] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:18:49.184369 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d9513a-b9bb-4fac-8ce2-ffee845d9765 service nova] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:18:49.184640 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d9513a-b9bb-4fac-8ce2-ffee845d9765 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:18:49.186799 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-42d9513a-b9bb-4fac-8ce2-ffee845d9765 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:18:49.256010 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d9513a-b9bb-4fac-8ce2-ffee845d9765 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:18:49.257634 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d9513a-b9bb-4fac-8ce2-ffee845d9765 service nova] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:18:49.266425 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1241/2466] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:18:49 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 14:18:50.437053 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d8bff2-3df0-4d2b-bc4a-ffc2fad48209 service cinder] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:18:50.450450 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d8bff2-3df0-4d2b-bc4a-ffc2fad48209 service cinder] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:18:50.456331 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93564b4a-6736-4c8b-9ec9-f3473abc9a58 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63489e658c094a2598a2ac62159d2fda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:18:50.456988 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93564b4a-6736-4c8b-9ec9-f3473abc9a58 service nova] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:18:50.457271 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93564b4a-6736-4c8b-9ec9-f3473abc9a58 service nova] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:18:50.457575 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93564b4a-6736-4c8b-9ec9-f3473abc9a58 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:18:50.459724 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-93564b4a-6736-4c8b-9ec9-f3473abc9a58 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:18:50.472042 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93564b4a-6736-4c8b-9ec9-f3473abc9a58 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:18:50.473705 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93564b4a-6736-4c8b-9ec9-f3473abc9a58 service nova] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:18:50.484159 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1226/2467] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:18:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 14:18:52.471417 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d9513a-b9bb-4fac-8ce2-ffee845d9765 service nova] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:18:52.536371 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d9513a-b9bb-4fac-8ce2-ffee845d9765 service nova] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:18:52.542701 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605d7090-4206-49a9-84ca-feb20453f93b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:18:52.543614 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605d7090-4206-49a9-84ca-feb20453f93b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:18:52.543895 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605d7090-4206-49a9-84ca-feb20453f93b admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:18:52.544180 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605d7090-4206-49a9-84ca-feb20453f93b admin admin] PATH_INFO: `/v3/users/7d3a4779e6cd48b99b98d05000efad02` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:18:52.545423 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605d7090-4206-49a9-84ca-feb20453f93b admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d3a4779e6cd48b99b98d05000efad02)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:18:52.547367 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605d7090-4206-49a9-84ca-feb20453f93b admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:18:52.599341 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-605d7090-4206-49a9-84ca-feb20453f93b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d3a4779e6cd48b99b98d05000efad02'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:18:52.606447 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-605d7090-4206-49a9-84ca-feb20453f93b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d3a4779e6cd48b99b98d05000efad02'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:18:52.607158 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-605d7090-4206-49a9-84ca-feb20453f93b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d3a4779e6cd48b99b98d05000efad02'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:18:52.616673 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-605d7090-4206-49a9-84ca-feb20453f93b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d3a4779e6cd48b99b98d05000efad02'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:18:52.617483 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-605d7090-4206-49a9-84ca-feb20453f93b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d3a4779e6cd48b99b98d05000efad02'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:18:52.635800 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1242/2468] 10.222.0.36 () {58 vars in 1223 bytes} [Tue May 3 14:18:52 2022] DELETE /identity/v3/users/7d3a4779e6cd48b99b98d05000efad02 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:18:52.640780 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85124e1-bb49-4c2a-82d0-9d412eeea52b None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:18:52.641260 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85124e1-bb49-4c2a-82d0-9d412eeea52b None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:18:52.641407 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85124e1-bb49-4c2a-82d0-9d412eeea52b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:18:52.659079 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-a85124e1-bb49-4c2a-82d0-9d412eeea52b None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:18:52.660430 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-a85124e1-bb49-4c2a-82d0-9d412eeea52b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:18:52.722186 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1227/2469] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:18:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 14:18:52.734641 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605d7090-4206-49a9-84ca-feb20453f93b admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:18:52.736547 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-605d7090-4206-49a9-84ca-feb20453f93b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:18:52.796920 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605d7090-4206-49a9-84ca-feb20453f93b admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:18:52.801240 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3757dab1-d305-4a2c-8f6e-883b4a4ad254 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '937bea4f355144b4a7ee11baabc3a4cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:18:52.801971 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3757dab1-d305-4a2c-8f6e-883b4a4ad254 service neutron] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:18:52.802444 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3757dab1-d305-4a2c-8f6e-883b4a4ad254 service neutron] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:18:52.802724 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3757dab1-d305-4a2c-8f6e-883b4a4ad254 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:18:52.816192 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3757dab1-d305-4a2c-8f6e-883b4a4ad254 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:18:52.817869 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3757dab1-d305-4a2c-8f6e-883b4a4ad254 service neutron] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:18:52.828618 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1243/2470] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:18:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 14:18:53.119383 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85124e1-bb49-4c2a-82d0-9d412eeea52b None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:18:53.120932 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-a85124e1-bb49-4c2a-82d0-9d412eeea52b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:18:53.134180 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85124e1-bb49-4c2a-82d0-9d412eeea52b None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:18:53.140099 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd97bfcb-ee91-4de8-b2bf-112d74c3e415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:18:53.140980 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd97bfcb-ee91-4de8-b2bf-112d74c3e415 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:18:53.141260 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd97bfcb-ee91-4de8-b2bf-112d74c3e415 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:18:53.141565 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd97bfcb-ee91-4de8-b2bf-112d74c3e415 admin admin] PATH_INFO: `/v3/projects/cd769b76e20444eab5f32e809c6eda33` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:18:53.142884 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd97bfcb-ee91-4de8-b2bf-112d74c3e415 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd769b76e20444eab5f32e809c6eda33)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:18:53.145081 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd97bfcb-ee91-4de8-b2bf-112d74c3e415 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:18:53.196119 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-fd97bfcb-ee91-4de8-b2bf-112d74c3e415 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd769b76e20444eab5f32e809c6eda33', 'request_id': 'req-fd97bfcb-ee91-4de8-b2bf-112d74c3e415'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:18:53.202415 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-fd97bfcb-ee91-4de8-b2bf-112d74c3e415 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd769b76e20444eab5f32e809c6eda33', 'request_id': 'req-fd97bfcb-ee91-4de8-b2bf-112d74c3e415'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:18:53.207882 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-fd97bfcb-ee91-4de8-b2bf-112d74c3e415 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd769b76e20444eab5f32e809c6eda33', 'request_id': 'req-fd97bfcb-ee91-4de8-b2bf-112d74c3e415'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:18:53.222382 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-fd97bfcb-ee91-4de8-b2bf-112d74c3e415 admin admin] The token cache is being invalidate because project cd769b76e20444eab5f32e809c6eda33 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80012) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 14:18:53.222785 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-fd97bfcb-ee91-4de8-b2bf-112d74c3e415 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:18:53.223490 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-fd97bfcb-ee91-4de8-b2bf-112d74c3e415 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:18:53.225315 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1228/2471] 10.222.0.36 () {58 vars in 1232 bytes} [Tue May 3 14:18:53 2022] DELETE /identity/v3/projects/cd769b76e20444eab5f32e809c6eda33 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:18:53.229472 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3757dab1-d305-4a2c-8f6e-883b4a4ad254 service neutron] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:18:53.239480 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3757dab1-d305-4a2c-8f6e-883b4a4ad254 service neutron] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:18:53.296632 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2c4eb6-d52c-4d51-bab5-b77014aba3c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:18:53.297544 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2c4eb6-d52c-4d51-bab5-b77014aba3c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:18:53.297821 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2c4eb6-d52c-4d51-bab5-b77014aba3c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:18:53.298106 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2c4eb6-d52c-4d51-bab5-b77014aba3c2 admin admin] PATH_INFO: `/v3/users/f51d3210f7ee423fa958e91cc64bc10a` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:18:53.299386 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2c4eb6-d52c-4d51-bab5-b77014aba3c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f51d3210f7ee423fa958e91cc64bc10a)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:18:53.301411 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2c4eb6-d52c-4d51-bab5-b77014aba3c2 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:18:53.350059 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-0e2c4eb6-d52c-4d51-bab5-b77014aba3c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f51d3210f7ee423fa958e91cc64bc10a'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:18:53.357536 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-0e2c4eb6-d52c-4d51-bab5-b77014aba3c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f51d3210f7ee423fa958e91cc64bc10a'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:18:53.358258 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-0e2c4eb6-d52c-4d51-bab5-b77014aba3c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f51d3210f7ee423fa958e91cc64bc10a'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:18:53.366305 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-0e2c4eb6-d52c-4d51-bab5-b77014aba3c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f51d3210f7ee423fa958e91cc64bc10a'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:18:53.367174 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-0e2c4eb6-d52c-4d51-bab5-b77014aba3c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f51d3210f7ee423fa958e91cc64bc10a'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:18:53.387174 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1244/2472] 10.222.0.36 () {58 vars in 1223 bytes} [Tue May 3 14:18:53 2022] DELETE /identity/v3/users/f51d3210f7ee423fa958e91cc64bc10a => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:18:53.570931 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19d327e-c366-4df5-88d3-1939f7d1a7be None None] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:18:53.571264 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19d327e-c366-4df5-88d3-1939f7d1a7be None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:18:53.571922 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19d327e-c366-4df5-88d3-1939f7d1a7be None None] PATH_INFO: `/` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:18:53.573464 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1229/2473] 10.222.0.36 () {54 vars in 921 bytes} [Tue May 3 14:18:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 14:18:53.579781 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812d214a-472a-4472-8e86-89d2eb4f4427 None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:18:53.580295 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812d214a-472a-4472-8e86-89d2eb4f4427 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:18:53.580406 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812d214a-472a-4472-8e86-89d2eb4f4427 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:18:53.599064 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-812d214a-472a-4472-8e86-89d2eb4f4427 None None] MFA Rules not processed for user `63489e658c094a2598a2ac62159d2fda`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:18:53.600306 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-812d214a-472a-4472-8e86-89d2eb4f4427 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:18:53.668579 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1245/2474] 10.222.0.36 () {58 vars in 1018 bytes} [Tue May 3 14:18:53 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 14:18:53.680666 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19d327e-c366-4df5-88d3-1939f7d1a7be None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:18:53.682568 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-c19d327e-c366-4df5-88d3-1939f7d1a7be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:18:53.733010 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812d214a-472a-4472-8e86-89d2eb4f4427 None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:18:53.734798 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-812d214a-472a-4472-8e86-89d2eb4f4427 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:18:53.773116 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19d327e-c366-4df5-88d3-1939f7d1a7be None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:18:53.777030 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abb8695-9d7b-43df-87c5-073539daba05 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '616de5e7daed46849efc75ad77ea054e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:18:53.777714 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abb8695-9d7b-43df-87c5-073539daba05 service glance] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:18:53.778055 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abb8695-9d7b-43df-87c5-073539daba05 service glance] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:18:53.778391 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abb8695-9d7b-43df-87c5-073539daba05 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:18:53.789812 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abb8695-9d7b-43df-87c5-073539daba05 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:18:53.791557 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abb8695-9d7b-43df-87c5-073539daba05 service glance] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:18:53.802749 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1230/2475] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:18:53 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 14:18:53.807823 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812d214a-472a-4472-8e86-89d2eb4f4427 None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:18:53.812621 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94723ec-5036-4062-ba1e-0c7eb8283ffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:18:53.813517 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94723ec-5036-4062-ba1e-0c7eb8283ffa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:18:53.813799 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94723ec-5036-4062-ba1e-0c7eb8283ffa admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:18:53.814075 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94723ec-5036-4062-ba1e-0c7eb8283ffa admin admin] PATH_INFO: `/v3/projects/1281d83c7e494868bebf89975c5a9d02` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:18:53.815341 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94723ec-5036-4062-ba1e-0c7eb8283ffa admin admin] RBAC: Authorizing `identity:delete_project(project_id=1281d83c7e494868bebf89975c5a9d02)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:18:53.817505 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94723ec-5036-4062-ba1e-0c7eb8283ffa admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:18:53.864275 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-c94723ec-5036-4062-ba1e-0c7eb8283ffa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1281d83c7e494868bebf89975c5a9d02', 'request_id': 'req-c94723ec-5036-4062-ba1e-0c7eb8283ffa'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:18:53.869765 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b4a79f-fda9-4803-99cf-95989aba562f None None] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:18:53.870054 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b4a79f-fda9-4803-99cf-95989aba562f None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:18:53.870266 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-c94723ec-5036-4062-ba1e-0c7eb8283ffa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1281d83c7e494868bebf89975c5a9d02', 'request_id': 'req-c94723ec-5036-4062-ba1e-0c7eb8283ffa'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:18:53.870368 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b4a79f-fda9-4803-99cf-95989aba562f None None] PATH_INFO: `/` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:18:53.871691 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1231/2476] 10.222.0.36 () {54 vars in 921 bytes} [Tue May 3 14:18:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 14:18:53.876042 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbb16c7-fab9-4aa4-83db-f3ac20f48d21 None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:18:53.876454 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbb16c7-fab9-4aa4-83db-f3ac20f48d21 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:18:53.876759 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbb16c7-fab9-4aa4-83db-f3ac20f48d21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:18:53.881428 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-c94723ec-5036-4062-ba1e-0c7eb8283ffa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1281d83c7e494868bebf89975c5a9d02', 'request_id': 'req-c94723ec-5036-4062-ba1e-0c7eb8283ffa'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:18:53.893011 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-c94723ec-5036-4062-ba1e-0c7eb8283ffa admin admin] The token cache is being invalidate because project 1281d83c7e494868bebf89975c5a9d02 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80013) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 14:18:53.893321 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-c94723ec-5036-4062-ba1e-0c7eb8283ffa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:18:53.894015 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-c94723ec-5036-4062-ba1e-0c7eb8283ffa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:18:53.894832 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-fbbb16c7-fab9-4aa4-83db-f3ac20f48d21 None None] MFA Rules not processed for user `937bea4f355144b4a7ee11baabc3a4cb`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:18:53.895596 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1246/2477] 10.222.0.36 () {58 vars in 1232 bytes} [Tue May 3 14:18:53 2022] DELETE /identity/v3/projects/1281d83c7e494868bebf89975c5a9d02 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 14:18:53.898990 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-fbbb16c7-fab9-4aa4-83db-f3ac20f48d21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:18:53.900360 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3df60f2-f2fc-4759-895d-dff5c1debd0c None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:18:53.900643 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3df60f2-f2fc-4759-895d-dff5c1debd0c None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:18:53.900916 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3df60f2-f2fc-4759-895d-dff5c1debd0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:18:53.919927 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-c3df60f2-f2fc-4759-895d-dff5c1debd0c None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:18:53.921134 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-c3df60f2-f2fc-4759-895d-dff5c1debd0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:18:53.946264 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1232/2478] 10.222.0.36 () {58 vars in 1018 bytes} [Tue May 3 14:18:53 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 14:18:53.958488 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbb16c7-fab9-4aa4-83db-f3ac20f48d21 None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:18:53.960195 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-fbbb16c7-fab9-4aa4-83db-f3ac20f48d21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:18:53.970318 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbb16c7-fab9-4aa4-83db-f3ac20f48d21 None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:18:53.974174 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a68290f-cd67-4c09-9fe8-597a857bd67b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '937bea4f355144b4a7ee11baabc3a4cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:18:53.974813 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a68290f-cd67-4c09-9fe8-597a857bd67b service neutron] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:18:53.975093 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a68290f-cd67-4c09-9fe8-597a857bd67b service neutron] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:18:53.975371 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a68290f-cd67-4c09-9fe8-597a857bd67b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:18:53.979643 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1247/2479] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:18:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 14:18:53.982614 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a68290f-cd67-4c09-9fe8-597a857bd67b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:18:53.984068 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a68290f-cd67-4c09-9fe8-597a857bd67b service neutron] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:18:53.987881 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea78534e-e0c2-47f3-8535-96929e226cf3 None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:18:53.988567 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea78534e-e0c2-47f3-8535-96929e226cf3 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:18:53.988567 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea78534e-e0c2-47f3-8535-96929e226cf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:18:53.992211 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1233/2480] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:18:53 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 03 14:18:54.006766 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-ea78534e-e0c2-47f3-8535-96929e226cf3 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:18:54.007980 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-ea78534e-e0c2-47f3-8535-96929e226cf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:18:54.016053 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1248/2481] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:18:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:18:54.020411 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a68290f-cd67-4c09-9fe8-597a857bd67b service neutron] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:18:54.032234 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a68290f-cd67-4c09-9fe8-597a857bd67b service neutron] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:18:54.036712 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fbf032-5a0a-4b1b-805c-7dd94308953e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:18:54.037413 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fbf032-5a0a-4b1b-805c-7dd94308953e admin admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:18:54.037695 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fbf032-5a0a-4b1b-805c-7dd94308953e admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:18:54.037971 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fbf032-5a0a-4b1b-805c-7dd94308953e admin admin] PATH_INFO: `/v3/domains` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:18:54.038688 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fbf032-5a0a-4b1b-805c-7dd94308953e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80012) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:18:54.039139 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fbf032-5a0a-4b1b-805c-7dd94308953e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:18:54.040765 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fbf032-5a0a-4b1b-805c-7dd94308953e admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:18:54.055987 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1234/2482] 10.222.0.36 () {58 vars in 1152 bytes} [Tue May 3 14:18:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:18:54.059416 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea78534e-e0c2-47f3-8535-96929e226cf3 None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:18:54.069947 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea78534e-e0c2-47f3-8535-96929e226cf3 None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:18:54.074458 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f48d90-8b9d-4133-bfa8-d23ba3a09cb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:18:54.075111 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f48d90-8b9d-4133-bfa8-d23ba3a09cb6 admin admin] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:18:54.075385 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f48d90-8b9d-4133-bfa8-d23ba3a09cb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:18:54.075652 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f48d90-8b9d-4133-bfa8-d23ba3a09cb6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:18:54.076338 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f48d90-8b9d-4133-bfa8-d23ba3a09cb6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:18:54.079464 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610b0692-51d7-4a9d-b1e4-04e2e8712365 None None] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:18:54.079753 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610b0692-51d7-4a9d-b1e4-04e2e8712365 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:18:54.080027 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610b0692-51d7-4a9d-b1e4-04e2e8712365 None None] PATH_INFO: `/` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:18:54.081596 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1235/2483] 10.222.0.36 () {54 vars in 921 bytes} [Tue May 3 14:18:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 14:18:54.082011 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f48d90-8b9d-4133-bfa8-d23ba3a09cb6 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:18:54.087389 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1fc30a-db1a-4f6d-81a5-02b9c5657e20 None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:18:54.087672 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1fc30a-db1a-4f6d-81a5-02b9c5657e20 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:18:54.087944 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1fc30a-db1a-4f6d-81a5-02b9c5657e20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:18:54.106836 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-9a1fc30a-db1a-4f6d-81a5-02b9c5657e20 None None] MFA Rules not processed for user `63489e658c094a2598a2ac62159d2fda`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:18:54.108020 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-9a1fc30a-db1a-4f6d-81a5-02b9c5657e20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:18:54.109235 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1249/2484] 10.222.0.36 () {60 vars in 1152 bytes} [Tue May 3 14:18:54 2022] POST /identity/v3/projects => generated 367 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 14:18:54.113529 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f48d90-8b9d-4133-bfa8-d23ba3a09cb6 admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:18:54.172242 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1236/2485] 10.222.0.36 () {58 vars in 1018 bytes} [Tue May 3 14:18:54 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 14:18:54.180304 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f48d90-8b9d-4133-bfa8-d23ba3a09cb6 admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:18:54.182952 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1fc30a-db1a-4f6d-81a5-02b9c5657e20 None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:18:54.185273 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d353e7-bd14-499f-8668-cb4130188e13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:18:54.186052 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d353e7-bd14-499f-8668-cb4130188e13 admin admin] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:18:54.186301 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d353e7-bd14-499f-8668-cb4130188e13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:18:54.186604 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d353e7-bd14-499f-8668-cb4130188e13 admin admin] PATH_INFO: `/v3/users` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:18:54.187288 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d353e7-bd14-499f-8668-cb4130188e13 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:18:54.189185 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d353e7-bd14-499f-8668-cb4130188e13 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:18:54.213869 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1250/2486] 10.222.0.36 () {60 vars in 1143 bytes} [Tue May 3 14:18:54 2022] POST /identity/v3/users => generated 284 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 14:18:54.215217 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d353e7-bd14-499f-8668-cb4130188e13 admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:18:54.225159 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d353e7-bd14-499f-8668-cb4130188e13 admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:18:54.229815 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794b4725-98ff-4247-9b86-36318a7112ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:18:54.230490 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794b4725-98ff-4247-9b86-36318a7112ab admin admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:18:54.230764 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794b4725-98ff-4247-9b86-36318a7112ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:18:54.231034 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794b4725-98ff-4247-9b86-36318a7112ab admin admin] PATH_INFO: `/v3/roles` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:18:54.231748 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794b4725-98ff-4247-9b86-36318a7112ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:18:54.233513 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794b4725-98ff-4247-9b86-36318a7112ab admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:18:54.238031 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1fc30a-db1a-4f6d-81a5-02b9c5657e20 None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:18:54.242133 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd95c20-e059-4cee-8da5-5e9a3ef2b827 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '937bea4f355144b4a7ee11baabc3a4cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:18:54.242819 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd95c20-e059-4cee-8da5-5e9a3ef2b827 service neutron] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:18:54.243100 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd95c20-e059-4cee-8da5-5e9a3ef2b827 service neutron] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:18:54.243367 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1251/2487] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 3 14:18:54 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 14:18:54.243475 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd95c20-e059-4cee-8da5-5e9a3ef2b827 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:18:54.247655 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794b4725-98ff-4247-9b86-36318a7112ab admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:18:54.254069 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd95c20-e059-4cee-8da5-5e9a3ef2b827 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:18:54.255486 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd95c20-e059-4cee-8da5-5e9a3ef2b827 service neutron] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:18:54.256995 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794b4725-98ff-4247-9b86-36318a7112ab admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:18:54.261621 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccb75df-3531-472c-8ed8-b82f31aef8b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:18:54.262249 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccb75df-3531-472c-8ed8-b82f31aef8b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:18:54.262521 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccb75df-3531-472c-8ed8-b82f31aef8b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:18:54.262788 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccb75df-3531-472c-8ed8-b82f31aef8b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:18:54.263490 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccb75df-3531-472c-8ed8-b82f31aef8b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:18:54.265049 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccb75df-3531-472c-8ed8-b82f31aef8b1 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:18:54.265873 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1237/2488] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:18:54 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 03 14:18:54.280869 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1252/2489] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 3 14:18:54 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 14:18:54.285206 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd95c20-e059-4cee-8da5-5e9a3ef2b827 service neutron] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:18:54.295522 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd95c20-e059-4cee-8da5-5e9a3ef2b827 service neutron] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:18:54.300877 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fef3c5-f4d6-4ada-92ef-6d6b6281e917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:18:54.301900 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fef3c5-f4d6-4ada-92ef-6d6b6281e917 admin admin] REQUEST_METHOD: `PUT` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:18:54.302180 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fef3c5-f4d6-4ada-92ef-6d6b6281e917 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:18:54.302455 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fef3c5-f4d6-4ada-92ef-6d6b6281e917 admin admin] PATH_INFO: `/v3/projects/06e39d698e55440aab208ff54b15d1f8/users/c18a2e9490324ec0961ec7209afd7d24/roles/441fdc11e95b47f4813f72610e39018b` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:18:54.318227 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fef3c5-f4d6-4ada-92ef-6d6b6281e917 admin admin] RBAC: Authorizing `identity:create_grant(project_id=06e39d698e55440aab208ff54b15d1f8, user_id=c18a2e9490324ec0961ec7209afd7d24, role_id=441fdc11e95b47f4813f72610e39018b)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:18:54.320877 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fef3c5-f4d6-4ada-92ef-6d6b6281e917 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:18:54.336653 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1238/2490] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 3 14:18:54 2022] PUT /identity/v3/projects/06e39d698e55440aab208ff54b15d1f8/users/c18a2e9490324ec0961ec7209afd7d24/roles/441fdc11e95b47f4813f72610e39018b => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:18:54.347216 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116b677a-94d0-4a1a-b489-537a84498784 None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:18:54.347514 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116b677a-94d0-4a1a-b489-537a84498784 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:18:54.347786 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116b677a-94d0-4a1a-b489-537a84498784 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:18:54.374111 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-116b677a-94d0-4a1a-b489-537a84498784 None None] MFA Rules not processed for user `c18a2e9490324ec0961ec7209afd7d24`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:18:54.375319 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-116b677a-94d0-4a1a-b489-537a84498784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:18:54.440039 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1253/2491] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:18:54 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:18:54.444367 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fef3c5-f4d6-4ada-92ef-6d6b6281e917 admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:18:54.509147 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fef3c5-f4d6-4ada-92ef-6d6b6281e917 admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:18:54.514004 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf9f804-3c0f-43e8-af23-673e60163c2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:18:54.514668 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf9f804-3c0f-43e8-af23-673e60163c2a admin admin] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:18:54.514947 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf9f804-3c0f-43e8-af23-673e60163c2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:18:54.515218 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf9f804-3c0f-43e8-af23-673e60163c2a admin admin] PATH_INFO: `/v3/projects` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:18:54.515914 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf9f804-3c0f-43e8-af23-673e60163c2a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:18:54.517862 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf9f804-3c0f-43e8-af23-673e60163c2a admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:18:54.543722 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1239/2492] 10.222.0.36 () {60 vars in 1152 bytes} [Tue May 3 14:18:54 2022] POST /identity/v3/projects => generated 369 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 14:18:54.547785 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116b677a-94d0-4a1a-b489-537a84498784 None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:18:54.558960 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116b677a-94d0-4a1a-b489-537a84498784 None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:18:54.619052 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7979b055-43a6-42a0-8a8b-123a6b86b584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:18:54.619779 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7979b055-43a6-42a0-8a8b-123a6b86b584 admin admin] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:18:54.619990 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7979b055-43a6-42a0-8a8b-123a6b86b584 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:18:54.620284 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7979b055-43a6-42a0-8a8b-123a6b86b584 admin admin] PATH_INFO: `/v3/users` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:18:54.620974 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7979b055-43a6-42a0-8a8b-123a6b86b584 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:18:54.622937 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7979b055-43a6-42a0-8a8b-123a6b86b584 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:18:54.645337 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1254/2493] 10.222.0.36 () {60 vars in 1143 bytes} [Tue May 3 14:18:54 2022] POST /identity/v3/users => generated 291 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 14:18:54.649492 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf9f804-3c0f-43e8-af23-673e60163c2a admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:18:54.659801 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf9f804-3c0f-43e8-af23-673e60163c2a admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:18:54.664819 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f1c068-ca27-4ab3-9e4b-d93f7e206fdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:18:54.665516 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f1c068-ca27-4ab3-9e4b-d93f7e206fdd admin admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:18:54.665792 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f1c068-ca27-4ab3-9e4b-d93f7e206fdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:18:54.666058 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f1c068-ca27-4ab3-9e4b-d93f7e206fdd admin admin] PATH_INFO: `/v3/roles` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:18:54.666771 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f1c068-ca27-4ab3-9e4b-d93f7e206fdd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:18:54.668371 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f1c068-ca27-4ab3-9e4b-d93f7e206fdd admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:18:54.679192 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1240/2494] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 3 14:18:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 14:18:54.683475 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7979b055-43a6-42a0-8a8b-123a6b86b584 admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:18:54.693639 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7979b055-43a6-42a0-8a8b-123a6b86b584 admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:18:54.698162 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7df560f-0f79-4863-a1fe-298e0bf7af4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:18:54.699074 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7df560f-0f79-4863-a1fe-298e0bf7af4a admin admin] REQUEST_METHOD: `PUT` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:18:54.699349 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7df560f-0f79-4863-a1fe-298e0bf7af4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:18:54.699618 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7df560f-0f79-4863-a1fe-298e0bf7af4a admin admin] PATH_INFO: `/v3/projects/f57abd7ab1ff4788b1c5733a576bb529/users/2f3f9cabb0564ee99df28766da06b24b/roles/36abe9b50fd8479c86c4f8f70fd85aa3` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:18:54.715918 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7df560f-0f79-4863-a1fe-298e0bf7af4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f57abd7ab1ff4788b1c5733a576bb529, user_id=2f3f9cabb0564ee99df28766da06b24b, role_id=36abe9b50fd8479c86c4f8f70fd85aa3)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:18:54.718608 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7df560f-0f79-4863-a1fe-298e0bf7af4a admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:18:54.733137 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1255/2495] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 3 14:18:54 2022] PUT /identity/v3/projects/f57abd7ab1ff4788b1c5733a576bb529/users/2f3f9cabb0564ee99df28766da06b24b/roles/36abe9b50fd8479c86c4f8f70fd85aa3 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 14:18:54.737531 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f1c068-ca27-4ab3-9e4b-d93f7e206fdd admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:18:54.748344 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f1c068-ca27-4ab3-9e4b-d93f7e206fdd admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:18:54.811772 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fcbb17-b0cd-4232-b755-5e79299b41b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:18:54.812357 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fcbb17-b0cd-4232-b755-5e79299b41b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:18:54.812633 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fcbb17-b0cd-4232-b755-5e79299b41b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:18:54.812908 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fcbb17-b0cd-4232-b755-5e79299b41b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:18:54.813656 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fcbb17-b0cd-4232-b755-5e79299b41b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:18:54.815487 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fcbb17-b0cd-4232-b755-5e79299b41b8 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:18:54.829668 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1241/2496] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 3 14:18:54 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 14:18:54.831160 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7df560f-0f79-4863-a1fe-298e0bf7af4a admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:18:54.842616 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7df560f-0f79-4863-a1fe-298e0bf7af4a admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:18:54.847564 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552da72d-d203-4e28-aac9-ee54661f7cb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:18:54.848562 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552da72d-d203-4e28-aac9-ee54661f7cb8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:18:54.848901 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552da72d-d203-4e28-aac9-ee54661f7cb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:18:54.849238 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552da72d-d203-4e28-aac9-ee54661f7cb8 admin admin] PATH_INFO: `/v3/projects/f57abd7ab1ff4788b1c5733a576bb529/users/2f3f9cabb0564ee99df28766da06b24b/roles/36abe9b50fd8479c86c4f8f70fd85aa3` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:18:54.851263 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552da72d-d203-4e28-aac9-ee54661f7cb8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f57abd7ab1ff4788b1c5733a576bb529, user_id=2f3f9cabb0564ee99df28766da06b24b, role_id=36abe9b50fd8479c86c4f8f70fd85aa3)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:18:54.853949 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552da72d-d203-4e28-aac9-ee54661f7cb8 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:18:54.864688 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1256/2497] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 3 14:18:54 2022] PUT /identity/v3/projects/f57abd7ab1ff4788b1c5733a576bb529/users/2f3f9cabb0564ee99df28766da06b24b/roles/36abe9b50fd8479c86c4f8f70fd85aa3 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:18:54.876321 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c1441c-2063-4675-b3fd-a2fe319ee141 None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:18:54.876659 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c1441c-2063-4675-b3fd-a2fe319ee141 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:18:54.876969 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c1441c-2063-4675-b3fd-a2fe319ee141 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:18:54.903864 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-f3c1441c-2063-4675-b3fd-a2fe319ee141 None None] MFA Rules not processed for user `2f3f9cabb0564ee99df28766da06b24b`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:18:54.905063 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-f3c1441c-2063-4675-b3fd-a2fe319ee141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:18:54.972052 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1242/2498] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:18:54 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:18:54.983031 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552da72d-d203-4e28-aac9-ee54661f7cb8 admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:18:54.985097 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-552da72d-d203-4e28-aac9-ee54661f7cb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:18:55.050922 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552da72d-d203-4e28-aac9-ee54661f7cb8 admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:18:55.055687 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66246cc-994d-42a0-a929-e8f4165fbed2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b014f4c7ba1414cb8a597f5bc4033f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:18:55.056342 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66246cc-994d-42a0-a929-e8f4165fbed2 service cinder] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:18:55.056595 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66246cc-994d-42a0-a929-e8f4165fbed2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:18:55.056865 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66246cc-994d-42a0-a929-e8f4165fbed2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:18:55.067778 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66246cc-994d-42a0-a929-e8f4165fbed2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:18:55.068775 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66246cc-994d-42a0-a929-e8f4165fbed2 service cinder] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:18:55.078647 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1257/2499] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:18:54 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 14:18:55.870503 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cc39b5-4b55-4ec6-84f6-053b63b67782 None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:18:55.870992 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cc39b5-4b55-4ec6-84f6-053b63b67782 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:18:55.870992 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cc39b5-4b55-4ec6-84f6-053b63b67782 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:18:55.888595 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-62cc39b5-4b55-4ec6-84f6-053b63b67782 None None] MFA Rules not processed for user `dec39ff0b6544a738e5aae06e9a8cb38`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:18:55.889838 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-62cc39b5-4b55-4ec6-84f6-053b63b67782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:18:55.943558 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1243/2500] 10.222.0.36 () {58 vars in 1009 bytes} [Tue May 3 14:18:55 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:18:55.958103 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66246cc-994d-42a0-a929-e8f4165fbed2 service cinder] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:18:55.960746 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-e66246cc-994d-42a0-a929-e8f4165fbed2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:18:56.039999 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66246cc-994d-42a0-a929-e8f4165fbed2 service cinder] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:18:56.055047 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df32a5a-21c2-4ad2-857c-acca3fbff2c5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1180e29180d44418390cf22d3e0bd6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:18:56.055726 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df32a5a-21c2-4ad2-857c-acca3fbff2c5 service swift] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:18:56.056004 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df32a5a-21c2-4ad2-857c-acca3fbff2c5 service swift] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:18:56.056276 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df32a5a-21c2-4ad2-857c-acca3fbff2c5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:18:56.065468 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df32a5a-21c2-4ad2-857c-acca3fbff2c5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:18:56.067973 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df32a5a-21c2-4ad2-857c-acca3fbff2c5 service swift] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:18:56.078676 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1258/2501] 10.222.0.36 () {60 vars in 1384 bytes} [Tue May 3 14:18:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 03 14:18:56.619396 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cc39b5-4b55-4ec6-84f6-053b63b67782 None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:18:56.692103 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cc39b5-4b55-4ec6-84f6-053b63b67782 None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:18:56.698204 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419a5aa5-6e57-42a6-85ff-c9c4e3f6a920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:18:56.699594 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419a5aa5-6e57-42a6-85ff-c9c4e3f6a920 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:18:56.700137 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419a5aa5-6e57-42a6-85ff-c9c4e3f6a920 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:18:56.700675 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419a5aa5-6e57-42a6-85ff-c9c4e3f6a920 admin admin] PATH_INFO: `/v3/users/c18a2e9490324ec0961ec7209afd7d24` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:18:56.703567 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419a5aa5-6e57-42a6-85ff-c9c4e3f6a920 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c18a2e9490324ec0961ec7209afd7d24)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:18:56.706328 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419a5aa5-6e57-42a6-85ff-c9c4e3f6a920 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:18:56.763031 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-419a5aa5-6e57-42a6-85ff-c9c4e3f6a920 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c18a2e9490324ec0961ec7209afd7d24'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:18:56.770653 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-419a5aa5-6e57-42a6-85ff-c9c4e3f6a920 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c18a2e9490324ec0961ec7209afd7d24'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:18:56.771464 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-419a5aa5-6e57-42a6-85ff-c9c4e3f6a920 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c18a2e9490324ec0961ec7209afd7d24'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:18:56.782917 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-419a5aa5-6e57-42a6-85ff-c9c4e3f6a920 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c18a2e9490324ec0961ec7209afd7d24'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:18:56.783743 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-419a5aa5-6e57-42a6-85ff-c9c4e3f6a920 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c18a2e9490324ec0961ec7209afd7d24'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:18:56.800500 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1244/2502] 10.222.0.36 () {58 vars in 1223 bytes} [Tue May 3 14:18:56 2022] DELETE /identity/v3/users/c18a2e9490324ec0961ec7209afd7d24 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:18:56.805948 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469eb156-ca20-4ebe-8c60-c1ed862bed18 None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:18:56.806495 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469eb156-ca20-4ebe-8c60-c1ed862bed18 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:18:56.806948 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469eb156-ca20-4ebe-8c60-c1ed862bed18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:18:56.825319 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-469eb156-ca20-4ebe-8c60-c1ed862bed18 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:18:56.826625 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-469eb156-ca20-4ebe-8c60-c1ed862bed18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:18:56.892471 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1259/2503] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:18:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 14:18:56.904931 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419a5aa5-6e57-42a6-85ff-c9c4e3f6a920 admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:18:56.907352 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-419a5aa5-6e57-42a6-85ff-c9c4e3f6a920 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:18:56.965616 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419a5aa5-6e57-42a6-85ff-c9c4e3f6a920 admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:18:56.969398 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7367ad59-b1de-4798-902d-ac13987b79a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '937bea4f355144b4a7ee11baabc3a4cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:18:56.970068 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7367ad59-b1de-4798-902d-ac13987b79a9 service neutron] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:18:56.970347 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7367ad59-b1de-4798-902d-ac13987b79a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:18:56.970622 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7367ad59-b1de-4798-902d-ac13987b79a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:18:56.980838 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7367ad59-b1de-4798-902d-ac13987b79a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:18:56.982498 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7367ad59-b1de-4798-902d-ac13987b79a9 service neutron] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:18:56.993400 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1245/2504] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:18:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 14:18:57.396052 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469eb156-ca20-4ebe-8c60-c1ed862bed18 None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:18:57.398315 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-469eb156-ca20-4ebe-8c60-c1ed862bed18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:18:57.420344 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469eb156-ca20-4ebe-8c60-c1ed862bed18 None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:18:57.425398 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd3be45-77f6-487c-8dfe-67a98dc9ba65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:18:57.426491 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd3be45-77f6-487c-8dfe-67a98dc9ba65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:18:57.427328 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd3be45-77f6-487c-8dfe-67a98dc9ba65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:18:57.428011 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd3be45-77f6-487c-8dfe-67a98dc9ba65 admin admin] PATH_INFO: `/v3/projects/06e39d698e55440aab208ff54b15d1f8` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:18:57.430336 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd3be45-77f6-487c-8dfe-67a98dc9ba65 admin admin] RBAC: Authorizing `identity:delete_project(project_id=06e39d698e55440aab208ff54b15d1f8)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:18:57.432832 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd3be45-77f6-487c-8dfe-67a98dc9ba65 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:18:57.485087 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-6fd3be45-77f6-487c-8dfe-67a98dc9ba65 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06e39d698e55440aab208ff54b15d1f8', 'request_id': 'req-6fd3be45-77f6-487c-8dfe-67a98dc9ba65'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:18:57.491227 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-6fd3be45-77f6-487c-8dfe-67a98dc9ba65 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06e39d698e55440aab208ff54b15d1f8', 'request_id': 'req-6fd3be45-77f6-487c-8dfe-67a98dc9ba65'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:18:57.500088 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-6fd3be45-77f6-487c-8dfe-67a98dc9ba65 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06e39d698e55440aab208ff54b15d1f8', 'request_id': 'req-6fd3be45-77f6-487c-8dfe-67a98dc9ba65'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:18:57.512743 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-6fd3be45-77f6-487c-8dfe-67a98dc9ba65 admin admin] The token cache is being invalidate because project 06e39d698e55440aab208ff54b15d1f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80013) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 14:18:57.512963 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-6fd3be45-77f6-487c-8dfe-67a98dc9ba65 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:18:57.513603 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-6fd3be45-77f6-487c-8dfe-67a98dc9ba65 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:18:57.518253 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1260/2505] 10.222.0.36 () {58 vars in 1232 bytes} [Tue May 3 14:18:57 2022] DELETE /identity/v3/projects/06e39d698e55440aab208ff54b15d1f8 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:18:57.519960 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7367ad59-b1de-4798-902d-ac13987b79a9 service neutron] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:18:57.529999 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7367ad59-b1de-4798-902d-ac13987b79a9 service neutron] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:18:57.587973 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf2609d-fd7f-478e-bf3d-e61e579f3e36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:18:57.588916 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf2609d-fd7f-478e-bf3d-e61e579f3e36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:18:57.589145 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf2609d-fd7f-478e-bf3d-e61e579f3e36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:18:57.589449 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf2609d-fd7f-478e-bf3d-e61e579f3e36 admin admin] PATH_INFO: `/v3/users/2f3f9cabb0564ee99df28766da06b24b` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:18:57.590641 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf2609d-fd7f-478e-bf3d-e61e579f3e36 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f3f9cabb0564ee99df28766da06b24b)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:18:57.592587 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf2609d-fd7f-478e-bf3d-e61e579f3e36 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:18:57.644169 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-abf2609d-fd7f-478e-bf3d-e61e579f3e36 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f3f9cabb0564ee99df28766da06b24b'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:18:57.653624 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-abf2609d-fd7f-478e-bf3d-e61e579f3e36 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f3f9cabb0564ee99df28766da06b24b'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:18:57.654988 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-abf2609d-fd7f-478e-bf3d-e61e579f3e36 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f3f9cabb0564ee99df28766da06b24b'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:18:57.669894 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-abf2609d-fd7f-478e-bf3d-e61e579f3e36 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f3f9cabb0564ee99df28766da06b24b'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:18:57.670724 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-abf2609d-fd7f-478e-bf3d-e61e579f3e36 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f3f9cabb0564ee99df28766da06b24b'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:18:57.685879 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1246/2506] 10.222.0.36 () {58 vars in 1223 bytes} [Tue May 3 14:18:57 2022] DELETE /identity/v3/users/2f3f9cabb0564ee99df28766da06b24b => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:18:57.986042 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd3be45-77f6-487c-8dfe-67a98dc9ba65 admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:18:57.988017 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-6fd3be45-77f6-487c-8dfe-67a98dc9ba65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:18:58.002855 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd3be45-77f6-487c-8dfe-67a98dc9ba65 admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:18:58.086150 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31bfab6-c41b-445c-ad81-aebb16e4666c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:18:58.087080 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31bfab6-c41b-445c-ad81-aebb16e4666c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:18:58.087353 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31bfab6-c41b-445c-ad81-aebb16e4666c admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:18:58.087623 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31bfab6-c41b-445c-ad81-aebb16e4666c admin admin] PATH_INFO: `/v3/projects/f57abd7ab1ff4788b1c5733a576bb529` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:18:58.088812 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31bfab6-c41b-445c-ad81-aebb16e4666c admin admin] RBAC: Authorizing `identity:delete_project(project_id=f57abd7ab1ff4788b1c5733a576bb529)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:18:58.090759 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31bfab6-c41b-445c-ad81-aebb16e4666c admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:18:58.141437 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-a31bfab6-c41b-445c-ad81-aebb16e4666c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f57abd7ab1ff4788b1c5733a576bb529', 'request_id': 'req-a31bfab6-c41b-445c-ad81-aebb16e4666c'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:18:58.146937 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-a31bfab6-c41b-445c-ad81-aebb16e4666c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f57abd7ab1ff4788b1c5733a576bb529', 'request_id': 'req-a31bfab6-c41b-445c-ad81-aebb16e4666c'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:18:58.156571 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-a31bfab6-c41b-445c-ad81-aebb16e4666c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f57abd7ab1ff4788b1c5733a576bb529', 'request_id': 'req-a31bfab6-c41b-445c-ad81-aebb16e4666c'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:18:58.170608 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-a31bfab6-c41b-445c-ad81-aebb16e4666c admin admin] The token cache is being invalidate because project f57abd7ab1ff4788b1c5733a576bb529 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80013) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 14:18:58.171145 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-a31bfab6-c41b-445c-ad81-aebb16e4666c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:18:58.171951 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-a31bfab6-c41b-445c-ad81-aebb16e4666c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:18:58.173883 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1261/2507] 10.222.0.36 () {58 vars in 1232 bytes} [Tue May 3 14:18:57 2022] DELETE /identity/v3/projects/f57abd7ab1ff4788b1c5733a576bb529 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:18:58.179043 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd08b170-7bdb-4c32-bffa-aa932360ff87 None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:18:58.179570 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd08b170-7bdb-4c32-bffa-aa932360ff87 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:18:58.179702 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd08b170-7bdb-4c32-bffa-aa932360ff87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:18:58.199477 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-fd08b170-7bdb-4c32-bffa-aa932360ff87 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:18:58.200702 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-fd08b170-7bdb-4c32-bffa-aa932360ff87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:18:58.259232 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1247/2508] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:18:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:18:58.267184 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c372d929-7b6d-4e7c-8688-493fa43b4394 None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:18:58.267612 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c372d929-7b6d-4e7c-8688-493fa43b4394 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:18:58.268078 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c372d929-7b6d-4e7c-8688-493fa43b4394 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:18:58.288204 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-c372d929-7b6d-4e7c-8688-493fa43b4394 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:18:58.289661 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-c372d929-7b6d-4e7c-8688-493fa43b4394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:18:58.298935 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1262/2509] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:18:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:18:58.303627 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd08b170-7bdb-4c32-bffa-aa932360ff87 None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:18:58.314101 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd08b170-7bdb-4c32-bffa-aa932360ff87 None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:18:58.319797 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a75770c-76e5-4f9d-981f-b2e7709640ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:18:58.324936 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a75770c-76e5-4f9d-981f-b2e7709640ca admin admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:18:58.324936 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a75770c-76e5-4f9d-981f-b2e7709640ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:18:58.324936 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a75770c-76e5-4f9d-981f-b2e7709640ca admin admin] PATH_INFO: `/v3/domains` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:18:58.324936 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a75770c-76e5-4f9d-981f-b2e7709640ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80012) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:18:58.324936 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a75770c-76e5-4f9d-981f-b2e7709640ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:18:58.324936 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a75770c-76e5-4f9d-981f-b2e7709640ca admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:18:58.338378 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1248/2510] 10.222.0.36 () {58 vars in 1152 bytes} [Tue May 3 14:18:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:18:58.343154 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c372d929-7b6d-4e7c-8688-493fa43b4394 None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:18:58.353977 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c372d929-7b6d-4e7c-8688-493fa43b4394 None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:18:58.361118 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef18090-ef75-4011-b799-80988683d6db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:18:58.362055 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef18090-ef75-4011-b799-80988683d6db admin admin] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:18:58.362450 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef18090-ef75-4011-b799-80988683d6db admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:18:58.362887 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef18090-ef75-4011-b799-80988683d6db admin admin] PATH_INFO: `/v3/projects` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:18:58.363781 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef18090-ef75-4011-b799-80988683d6db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:18:58.366286 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef18090-ef75-4011-b799-80988683d6db admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:18:58.412183 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1263/2511] 10.222.0.36 () {60 vars in 1152 bytes} [Tue May 3 14:18:58 2022] POST /identity/v3/projects => generated 379 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 14:18:58.416490 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a75770c-76e5-4f9d-981f-b2e7709640ca admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:18:58.427573 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a75770c-76e5-4f9d-981f-b2e7709640ca admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:18:58.493717 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5394bfa1-ad5a-4acc-ab83-fd7c1215c0e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:18:58.494994 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5394bfa1-ad5a-4acc-ab83-fd7c1215c0e9 admin admin] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:18:58.495500 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5394bfa1-ad5a-4acc-ab83-fd7c1215c0e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:18:58.495992 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5394bfa1-ad5a-4acc-ab83-fd7c1215c0e9 admin admin] PATH_INFO: `/v3/users` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:18:58.496982 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5394bfa1-ad5a-4acc-ab83-fd7c1215c0e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:18:58.499197 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5394bfa1-ad5a-4acc-ab83-fd7c1215c0e9 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:18:58.524259 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1249/2512] 10.222.0.36 () {60 vars in 1143 bytes} [Tue May 3 14:18:58 2022] POST /identity/v3/users => generated 290 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 14:18:58.529106 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef18090-ef75-4011-b799-80988683d6db admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:18:58.541891 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef18090-ef75-4011-b799-80988683d6db admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:18:58.546526 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c84991-9f12-4ae4-b07e-033cd4dd1f9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:18:58.547200 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c84991-9f12-4ae4-b07e-033cd4dd1f9a admin admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:18:58.547475 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c84991-9f12-4ae4-b07e-033cd4dd1f9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:18:58.547744 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c84991-9f12-4ae4-b07e-033cd4dd1f9a admin admin] PATH_INFO: `/v3/roles` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:18:58.548788 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c84991-9f12-4ae4-b07e-033cd4dd1f9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:18:58.550871 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c84991-9f12-4ae4-b07e-033cd4dd1f9a admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:18:58.572172 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1264/2513] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 3 14:18:58 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 14:18:58.575756 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5394bfa1-ad5a-4acc-ab83-fd7c1215c0e9 admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:18:58.599106 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5394bfa1-ad5a-4acc-ab83-fd7c1215c0e9 admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:18:58.606726 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a63cbf-69b4-4880-99d5-f1beb264fe52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:18:58.607734 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a63cbf-69b4-4880-99d5-f1beb264fe52 admin admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:18:58.608121 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a63cbf-69b4-4880-99d5-f1beb264fe52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:18:58.608559 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a63cbf-69b4-4880-99d5-f1beb264fe52 admin admin] PATH_INFO: `/v3/roles` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:18:58.609543 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a63cbf-69b4-4880-99d5-f1beb264fe52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:18:58.611720 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a63cbf-69b4-4880-99d5-f1beb264fe52 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:18:58.623871 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1250/2514] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 3 14:18:58 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 14:18:58.628200 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c84991-9f12-4ae4-b07e-033cd4dd1f9a admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:18:58.638635 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c84991-9f12-4ae4-b07e-033cd4dd1f9a admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:18:58.643683 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced9efba-75ca-49a3-998d-79cc53a5bb36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:18:58.644540 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced9efba-75ca-49a3-998d-79cc53a5bb36 admin admin] REQUEST_METHOD: `PUT` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:18:58.644824 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced9efba-75ca-49a3-998d-79cc53a5bb36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:18:58.645097 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced9efba-75ca-49a3-998d-79cc53a5bb36 admin admin] PATH_INFO: `/v3/projects/96ea0b979abc42ec8fa17b097992a8f4/users/55b36c89f4234c70a384af8852694f13/roles/441fdc11e95b47f4813f72610e39018b` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:18:58.661076 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced9efba-75ca-49a3-998d-79cc53a5bb36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=96ea0b979abc42ec8fa17b097992a8f4, user_id=55b36c89f4234c70a384af8852694f13, role_id=441fdc11e95b47f4813f72610e39018b)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:18:58.663831 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced9efba-75ca-49a3-998d-79cc53a5bb36 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:18:58.686973 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1265/2515] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 3 14:18:58 2022] PUT /identity/v3/projects/96ea0b979abc42ec8fa17b097992a8f4/users/55b36c89f4234c70a384af8852694f13/roles/441fdc11e95b47f4813f72610e39018b => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:18:58.693911 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868a7cd6-0613-44e1-8ea6-e41d423cf9ab None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:18:58.694199 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868a7cd6-0613-44e1-8ea6-e41d423cf9ab None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:18:58.694479 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868a7cd6-0613-44e1-8ea6-e41d423cf9ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:18:58.724392 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-868a7cd6-0613-44e1-8ea6-e41d423cf9ab None None] MFA Rules not processed for user `55b36c89f4234c70a384af8852694f13`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:18:58.725727 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-868a7cd6-0613-44e1-8ea6-e41d423cf9ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:18:58.794117 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1251/2516] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:18:58 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:18:58.798132 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced9efba-75ca-49a3-998d-79cc53a5bb36 admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:18:58.868701 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced9efba-75ca-49a3-998d-79cc53a5bb36 admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:18:58.873532 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903b3227-b258-4676-b39f-eabdfb8f0e90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:18:58.874215 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903b3227-b258-4676-b39f-eabdfb8f0e90 admin admin] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:18:58.874494 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903b3227-b258-4676-b39f-eabdfb8f0e90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:18:58.874770 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903b3227-b258-4676-b39f-eabdfb8f0e90 admin admin] PATH_INFO: `/v3/projects` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:18:58.875485 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903b3227-b258-4676-b39f-eabdfb8f0e90 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:18:58.877692 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903b3227-b258-4676-b39f-eabdfb8f0e90 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:18:58.909434 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1266/2517] 10.222.0.36 () {60 vars in 1152 bytes} [Tue May 3 14:18:58 2022] POST /identity/v3/projects => generated 381 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 14:18:58.913620 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868a7cd6-0613-44e1-8ea6-e41d423cf9ab None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:18:58.927456 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868a7cd6-0613-44e1-8ea6-e41d423cf9ab None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:18:58.989525 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7a512e-acd5-4d7d-80b2-332d80f48d6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:18:58.990433 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7a512e-acd5-4d7d-80b2-332d80f48d6f admin admin] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:18:58.990766 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7a512e-acd5-4d7d-80b2-332d80f48d6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:18:58.991000 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7a512e-acd5-4d7d-80b2-332d80f48d6f admin admin] PATH_INFO: `/v3/users` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:18:58.991721 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7a512e-acd5-4d7d-80b2-332d80f48d6f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:18:58.993750 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7a512e-acd5-4d7d-80b2-332d80f48d6f admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:18:59.019279 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1252/2518] 10.222.0.36 () {60 vars in 1143 bytes} [Tue May 3 14:18:58 2022] POST /identity/v3/users => generated 297 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 14:18:59.023564 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903b3227-b258-4676-b39f-eabdfb8f0e90 admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:18:59.034470 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903b3227-b258-4676-b39f-eabdfb8f0e90 admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:18:59.039620 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fb5705-85d0-4429-9491-4bb780c95a11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:18:59.040311 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fb5705-85d0-4429-9491-4bb780c95a11 admin admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:18:59.040602 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fb5705-85d0-4429-9491-4bb780c95a11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:18:59.040866 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fb5705-85d0-4429-9491-4bb780c95a11 admin admin] PATH_INFO: `/v3/roles` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:18:59.041631 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fb5705-85d0-4429-9491-4bb780c95a11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:18:59.043768 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fb5705-85d0-4429-9491-4bb780c95a11 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:18:59.055568 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1267/2519] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 3 14:18:59 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 14:18:59.059860 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7a512e-acd5-4d7d-80b2-332d80f48d6f admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:18:59.070194 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7a512e-acd5-4d7d-80b2-332d80f48d6f admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:18:59.076956 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c18f132-5594-457e-bcfd-fab8f024be38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:18:59.078070 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c18f132-5594-457e-bcfd-fab8f024be38 admin admin] REQUEST_METHOD: `PUT` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:18:59.078587 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c18f132-5594-457e-bcfd-fab8f024be38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:18:59.078932 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c18f132-5594-457e-bcfd-fab8f024be38 admin admin] PATH_INFO: `/v3/projects/ecc350b659f34a4fb4e593c2536ab06b/users/88201e52abb940728c8ba7e4b27a4597/roles/36abe9b50fd8479c86c4f8f70fd85aa3` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:18:59.095971 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c18f132-5594-457e-bcfd-fab8f024be38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ecc350b659f34a4fb4e593c2536ab06b, user_id=88201e52abb940728c8ba7e4b27a4597, role_id=36abe9b50fd8479c86c4f8f70fd85aa3)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:18:59.098805 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c18f132-5594-457e-bcfd-fab8f024be38 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:18:59.115985 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1253/2520] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 3 14:18:59 2022] PUT /identity/v3/projects/ecc350b659f34a4fb4e593c2536ab06b/users/88201e52abb940728c8ba7e4b27a4597/roles/36abe9b50fd8479c86c4f8f70fd85aa3 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 14:18:59.122247 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fb5705-85d0-4429-9491-4bb780c95a11 admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:18:59.133021 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fb5705-85d0-4429-9491-4bb780c95a11 admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:18:59.194449 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43f6e99-7f78-4b8e-8832-3037853bda00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:18:59.195132 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43f6e99-7f78-4b8e-8832-3037853bda00 admin admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:18:59.195414 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43f6e99-7f78-4b8e-8832-3037853bda00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:18:59.195689 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43f6e99-7f78-4b8e-8832-3037853bda00 admin admin] PATH_INFO: `/v3/roles` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:18:59.196418 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43f6e99-7f78-4b8e-8832-3037853bda00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:18:59.198133 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43f6e99-7f78-4b8e-8832-3037853bda00 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:18:59.207908 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1268/2521] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 3 14:18:59 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 14:18:59.212433 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c18f132-5594-457e-bcfd-fab8f024be38 admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:18:59.226040 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c18f132-5594-457e-bcfd-fab8f024be38 admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:18:59.231875 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f7167f-4765-4bad-a4b2-9f84200328e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:18:59.233383 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f7167f-4765-4bad-a4b2-9f84200328e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:18:59.233383 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f7167f-4765-4bad-a4b2-9f84200328e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:18:59.233741 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f7167f-4765-4bad-a4b2-9f84200328e1 admin admin] PATH_INFO: `/v3/projects/ecc350b659f34a4fb4e593c2536ab06b/users/88201e52abb940728c8ba7e4b27a4597/roles/36abe9b50fd8479c86c4f8f70fd85aa3` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:18:59.235778 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f7167f-4765-4bad-a4b2-9f84200328e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ecc350b659f34a4fb4e593c2536ab06b, user_id=88201e52abb940728c8ba7e4b27a4597, role_id=36abe9b50fd8479c86c4f8f70fd85aa3)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:18:59.238585 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f7167f-4765-4bad-a4b2-9f84200328e1 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:18:59.250698 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1254/2522] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 3 14:18:59 2022] PUT /identity/v3/projects/ecc350b659f34a4fb4e593c2536ab06b/users/88201e52abb940728c8ba7e4b27a4597/roles/36abe9b50fd8479c86c4f8f70fd85aa3 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:18:59.262532 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d81c5ef-155c-47fc-a43b-56c74e7fe2d4 None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:18:59.263117 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d81c5ef-155c-47fc-a43b-56c74e7fe2d4 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:18:59.263460 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d81c5ef-155c-47fc-a43b-56c74e7fe2d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:18:59.292494 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-0d81c5ef-155c-47fc-a43b-56c74e7fe2d4 None None] MFA Rules not processed for user `88201e52abb940728c8ba7e4b27a4597`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:18:59.293524 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-0d81c5ef-155c-47fc-a43b-56c74e7fe2d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:18:59.372378 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1269/2523] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:18:59 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 14:18:59.380382 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f7167f-4765-4bad-a4b2-9f84200328e1 admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:18:59.382412 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-89f7167f-4765-4bad-a4b2-9f84200328e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:18:59.445640 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f7167f-4765-4bad-a4b2-9f84200328e1 admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:18:59.449709 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9d33ef-42ff-4fb1-91d2-09a16468c157 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b014f4c7ba1414cb8a597f5bc4033f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:18:59.450490 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9d33ef-42ff-4fb1-91d2-09a16468c157 service cinder] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:18:59.450880 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9d33ef-42ff-4fb1-91d2-09a16468c157 service cinder] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:18:59.453648 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9d33ef-42ff-4fb1-91d2-09a16468c157 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:18:59.475473 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9d33ef-42ff-4fb1-91d2-09a16468c157 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:18:59.477123 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9d33ef-42ff-4fb1-91d2-09a16468c157 service cinder] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:18:59.488828 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1255/2524] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:18:59 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 14:18:59.889152 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d81c5ef-155c-47fc-a43b-56c74e7fe2d4 None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:18:59.899133 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d81c5ef-155c-47fc-a43b-56c74e7fe2d4 None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:18:59.903656 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ba7cec-c89a-498c-a9b1-c0aaaf5c74ea tempest-VolumeQuotaClassesTest-2055395814 tempest-VolumeQuotaClassesTest-2055395814-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88201e52abb940728c8ba7e4b27a4597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecc350b659f34a4fb4e593c2536ab06b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:18:59.904329 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ba7cec-c89a-498c-a9b1-c0aaaf5c74ea tempest-VolumeQuotaClassesTest-2055395814 tempest-VolumeQuotaClassesTest-2055395814-project-admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:18:59.904610 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ba7cec-c89a-498c-a9b1-c0aaaf5c74ea tempest-VolumeQuotaClassesTest-2055395814 tempest-VolumeQuotaClassesTest-2055395814-project-admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:18:59.904886 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ba7cec-c89a-498c-a9b1-c0aaaf5c74ea tempest-VolumeQuotaClassesTest-2055395814 tempest-VolumeQuotaClassesTest-2055395814-project-admin] PATH_INFO: `/v3/domains` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:18:59.905651 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ba7cec-c89a-498c-a9b1-c0aaaf5c74ea tempest-VolumeQuotaClassesTest-2055395814 tempest-VolumeQuotaClassesTest-2055395814-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:18:59.905957 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ba7cec-c89a-498c-a9b1-c0aaaf5c74ea tempest-VolumeQuotaClassesTest-2055395814 tempest-VolumeQuotaClassesTest-2055395814-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:18:59.907561 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ba7cec-c89a-498c-a9b1-c0aaaf5c74ea tempest-VolumeQuotaClassesTest-2055395814 tempest-VolumeQuotaClassesTest-2055395814-project-admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:18:59.919710 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1270/2525] 10.222.0.36 () {58 vars in 1152 bytes} [Tue May 3 14:18:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:18:59.926105 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9d33ef-42ff-4fb1-91d2-09a16468c157 service cinder] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:18:59.936241 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9d33ef-42ff-4fb1-91d2-09a16468c157 service cinder] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:18:59.941791 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d31d5a6-9d28-408b-8e8a-63143dc71ec1 tempest-VolumeQuotaClassesTest-2055395814 tempest-VolumeQuotaClassesTest-2055395814-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88201e52abb940728c8ba7e4b27a4597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecc350b659f34a4fb4e593c2536ab06b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:18:59.942690 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d31d5a6-9d28-408b-8e8a-63143dc71ec1 tempest-VolumeQuotaClassesTest-2055395814 tempest-VolumeQuotaClassesTest-2055395814-project-admin] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:18:59.943067 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d31d5a6-9d28-408b-8e8a-63143dc71ec1 tempest-VolumeQuotaClassesTest-2055395814 tempest-VolumeQuotaClassesTest-2055395814-project-admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:18:59.943374 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d31d5a6-9d28-408b-8e8a-63143dc71ec1 tempest-VolumeQuotaClassesTest-2055395814 tempest-VolumeQuotaClassesTest-2055395814-project-admin] PATH_INFO: `/v3/projects` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:18:59.944284 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d31d5a6-9d28-408b-8e8a-63143dc71ec1 tempest-VolumeQuotaClassesTest-2055395814 tempest-VolumeQuotaClassesTest-2055395814-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:18:59.946528 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d31d5a6-9d28-408b-8e8a-63143dc71ec1 tempest-VolumeQuotaClassesTest-2055395814 tempest-VolumeQuotaClassesTest-2055395814-project-admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:18:59.977741 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1256/2526] 10.222.0.36 () {60 vars in 1152 bytes} [Tue May 3 14:18:59 2022] POST /identity/v3/projects => generated 354 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 14:18:59.982071 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ba7cec-c89a-498c-a9b1-c0aaaf5c74ea tempest-VolumeQuotaClassesTest-2055395814 tempest-VolumeQuotaClassesTest-2055395814-project-admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:18:59.992409 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ba7cec-c89a-498c-a9b1-c0aaaf5c74ea tempest-VolumeQuotaClassesTest-2055395814 tempest-VolumeQuotaClassesTest-2055395814-project-admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:19:00.056456 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7da06e-2d14-435d-9eb1-9c90337d4475 tempest-VolumeQuotaClassesTest-2055395814 tempest-VolumeQuotaClassesTest-2055395814-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88201e52abb940728c8ba7e4b27a4597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecc350b659f34a4fb4e593c2536ab06b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:19:00.057404 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7da06e-2d14-435d-9eb1-9c90337d4475 tempest-VolumeQuotaClassesTest-2055395814 tempest-VolumeQuotaClassesTest-2055395814-project-admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:19:00.057740 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7da06e-2d14-435d-9eb1-9c90337d4475 tempest-VolumeQuotaClassesTest-2055395814 tempest-VolumeQuotaClassesTest-2055395814-project-admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:19:00.058122 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7da06e-2d14-435d-9eb1-9c90337d4475 tempest-VolumeQuotaClassesTest-2055395814 tempest-VolumeQuotaClassesTest-2055395814-project-admin] PATH_INFO: `/v3/domains` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:19:00.059174 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7da06e-2d14-435d-9eb1-9c90337d4475 tempest-VolumeQuotaClassesTest-2055395814 tempest-VolumeQuotaClassesTest-2055395814-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:19:00.059454 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7da06e-2d14-435d-9eb1-9c90337d4475 tempest-VolumeQuotaClassesTest-2055395814 tempest-VolumeQuotaClassesTest-2055395814-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:19:00.063853 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7da06e-2d14-435d-9eb1-9c90337d4475 tempest-VolumeQuotaClassesTest-2055395814 tempest-VolumeQuotaClassesTest-2055395814-project-admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:19:00.078773 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1271/2527] 10.222.0.36 () {58 vars in 1152 bytes} [Tue May 3 14:18:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 14:19:00.113645 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d31d5a6-9d28-408b-8e8a-63143dc71ec1 tempest-VolumeQuotaClassesTest-2055395814 tempest-VolumeQuotaClassesTest-2055395814-project-admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:19:00.123904 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d31d5a6-9d28-408b-8e8a-63143dc71ec1 tempest-VolumeQuotaClassesTest-2055395814 tempest-VolumeQuotaClassesTest-2055395814-project-admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:19:00.128400 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23174a39-ca50-47f8-9dda-4d662266f435 tempest-VolumeQuotaClassesTest-2055395814 tempest-VolumeQuotaClassesTest-2055395814-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88201e52abb940728c8ba7e4b27a4597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecc350b659f34a4fb4e593c2536ab06b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:19:00.129263 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23174a39-ca50-47f8-9dda-4d662266f435 tempest-VolumeQuotaClassesTest-2055395814 tempest-VolumeQuotaClassesTest-2055395814-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:19:00.129573 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23174a39-ca50-47f8-9dda-4d662266f435 tempest-VolumeQuotaClassesTest-2055395814 tempest-VolumeQuotaClassesTest-2055395814-project-admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:19:00.129841 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23174a39-ca50-47f8-9dda-4d662266f435 tempest-VolumeQuotaClassesTest-2055395814 tempest-VolumeQuotaClassesTest-2055395814-project-admin] PATH_INFO: `/v3/projects/b384329f398b48e0ae91251d612ecfa5` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:19:00.131014 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23174a39-ca50-47f8-9dda-4d662266f435 tempest-VolumeQuotaClassesTest-2055395814 tempest-VolumeQuotaClassesTest-2055395814-project-admin] RBAC: Authorizing `identity:delete_project(project_id=b384329f398b48e0ae91251d612ecfa5)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:19:00.133211 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23174a39-ca50-47f8-9dda-4d662266f435 tempest-VolumeQuotaClassesTest-2055395814 tempest-VolumeQuotaClassesTest-2055395814-project-admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:19:00.189132 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-23174a39-ca50-47f8-9dda-4d662266f435 tempest-VolumeQuotaClassesTest-2055395814 tempest-VolumeQuotaClassesTest-2055395814-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b384329f398b48e0ae91251d612ecfa5', 'request_id': 'req-23174a39-ca50-47f8-9dda-4d662266f435'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:19:00.196549 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-23174a39-ca50-47f8-9dda-4d662266f435 tempest-VolumeQuotaClassesTest-2055395814 tempest-VolumeQuotaClassesTest-2055395814-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b384329f398b48e0ae91251d612ecfa5', 'request_id': 'req-23174a39-ca50-47f8-9dda-4d662266f435'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:19:00.204133 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-23174a39-ca50-47f8-9dda-4d662266f435 tempest-VolumeQuotaClassesTest-2055395814 tempest-VolumeQuotaClassesTest-2055395814-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b384329f398b48e0ae91251d612ecfa5', 'request_id': 'req-23174a39-ca50-47f8-9dda-4d662266f435'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:19:00.219208 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-23174a39-ca50-47f8-9dda-4d662266f435 tempest-VolumeQuotaClassesTest-2055395814 tempest-VolumeQuotaClassesTest-2055395814-project-admin] The token cache is being invalidate because project b384329f398b48e0ae91251d612ecfa5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80012) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 14:19:00.219994 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-23174a39-ca50-47f8-9dda-4d662266f435 tempest-VolumeQuotaClassesTest-2055395814 tempest-VolumeQuotaClassesTest-2055395814-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:19:00.220401 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-23174a39-ca50-47f8-9dda-4d662266f435 tempest-VolumeQuotaClassesTest-2055395814 tempest-VolumeQuotaClassesTest-2055395814-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:19:00.226349 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1257/2528] 10.222.0.36 () {58 vars in 1232 bytes} [Tue May 3 14:19:00 2022] DELETE /identity/v3/projects/b384329f398b48e0ae91251d612ecfa5 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:19:00.461576 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7da06e-2d14-435d-9eb1-9c90337d4475 tempest-VolumeQuotaClassesTest-2055395814 tempest-VolumeQuotaClassesTest-2055395814-project-admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:19:00.463564 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-ef7da06e-2d14-435d-9eb1-9c90337d4475 tempest-VolumeQuotaClassesTest-2055395814 tempest-VolumeQuotaClassesTest-2055395814-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:19:00.546373 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7da06e-2d14-435d-9eb1-9c90337d4475 tempest-VolumeQuotaClassesTest-2055395814 tempest-VolumeQuotaClassesTest-2055395814-project-admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:19:00.611897 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62af50a2-1990-4029-9d09-038698ddf9ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:19:00.612823 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62af50a2-1990-4029-9d09-038698ddf9ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:19:00.613100 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62af50a2-1990-4029-9d09-038698ddf9ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:19:00.613441 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62af50a2-1990-4029-9d09-038698ddf9ab admin admin] PATH_INFO: `/v3/users/55b36c89f4234c70a384af8852694f13` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:19:00.614745 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62af50a2-1990-4029-9d09-038698ddf9ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=55b36c89f4234c70a384af8852694f13)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:19:00.616741 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62af50a2-1990-4029-9d09-038698ddf9ab admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:19:00.664123 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-62af50a2-1990-4029-9d09-038698ddf9ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55b36c89f4234c70a384af8852694f13'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:19:00.671119 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-62af50a2-1990-4029-9d09-038698ddf9ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55b36c89f4234c70a384af8852694f13'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:19:00.671973 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-62af50a2-1990-4029-9d09-038698ddf9ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55b36c89f4234c70a384af8852694f13'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:19:00.681665 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-62af50a2-1990-4029-9d09-038698ddf9ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55b36c89f4234c70a384af8852694f13'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:19:00.682411 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-62af50a2-1990-4029-9d09-038698ddf9ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55b36c89f4234c70a384af8852694f13'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:19:00.703738 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1272/2529] 10.222.0.36 () {58 vars in 1223 bytes} [Tue May 3 14:19:00 2022] DELETE /identity/v3/users/55b36c89f4234c70a384af8852694f13 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:19:00.708830 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e0b407-a5ca-4b2e-a1fb-3530654c6e57 None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:19:00.709121 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e0b407-a5ca-4b2e-a1fb-3530654c6e57 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:19:00.709743 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e0b407-a5ca-4b2e-a1fb-3530654c6e57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:19:00.729234 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-77e0b407-a5ca-4b2e-a1fb-3530654c6e57 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:19:00.730515 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-77e0b407-a5ca-4b2e-a1fb-3530654c6e57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:19:00.794660 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1258/2530] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:19:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 14:19:00.806493 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62af50a2-1990-4029-9d09-038698ddf9ab admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:19:00.808168 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-62af50a2-1990-4029-9d09-038698ddf9ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:19:00.876280 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62af50a2-1990-4029-9d09-038698ddf9ab admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:19:00.880436 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1a25a3-c6bf-43b5-84d8-edff2b606990 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '937bea4f355144b4a7ee11baabc3a4cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:19:00.881104 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1a25a3-c6bf-43b5-84d8-edff2b606990 service neutron] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:19:00.881419 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1a25a3-c6bf-43b5-84d8-edff2b606990 service neutron] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:19:00.881696 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1a25a3-c6bf-43b5-84d8-edff2b606990 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:19:00.894839 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1a25a3-c6bf-43b5-84d8-edff2b606990 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:19:00.896521 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1a25a3-c6bf-43b5-84d8-edff2b606990 service neutron] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:19:00.910394 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1273/2531] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:19:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 14:19:01.231043 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e0b407-a5ca-4b2e-a1fb-3530654c6e57 None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:19:01.232488 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-77e0b407-a5ca-4b2e-a1fb-3530654c6e57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:19:01.246692 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e0b407-a5ca-4b2e-a1fb-3530654c6e57 None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:19:01.251795 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e569d876-ad3e-4f0b-835d-f4486cdab6f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:19:01.253073 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e569d876-ad3e-4f0b-835d-f4486cdab6f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:19:01.253392 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e569d876-ad3e-4f0b-835d-f4486cdab6f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:19:01.253661 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e569d876-ad3e-4f0b-835d-f4486cdab6f6 admin admin] PATH_INFO: `/v3/projects/96ea0b979abc42ec8fa17b097992a8f4` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:19:01.254895 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e569d876-ad3e-4f0b-835d-f4486cdab6f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=96ea0b979abc42ec8fa17b097992a8f4)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:19:01.262015 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e569d876-ad3e-4f0b-835d-f4486cdab6f6 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:19:01.310443 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-e569d876-ad3e-4f0b-835d-f4486cdab6f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96ea0b979abc42ec8fa17b097992a8f4', 'request_id': 'req-e569d876-ad3e-4f0b-835d-f4486cdab6f6'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:19:01.316549 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-e569d876-ad3e-4f0b-835d-f4486cdab6f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96ea0b979abc42ec8fa17b097992a8f4', 'request_id': 'req-e569d876-ad3e-4f0b-835d-f4486cdab6f6'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:19:01.322093 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-e569d876-ad3e-4f0b-835d-f4486cdab6f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96ea0b979abc42ec8fa17b097992a8f4', 'request_id': 'req-e569d876-ad3e-4f0b-835d-f4486cdab6f6'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:19:01.336018 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-e569d876-ad3e-4f0b-835d-f4486cdab6f6 admin admin] The token cache is being invalidate because project 96ea0b979abc42ec8fa17b097992a8f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80012) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 14:19:01.336332 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-e569d876-ad3e-4f0b-835d-f4486cdab6f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:19:01.337203 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-e569d876-ad3e-4f0b-835d-f4486cdab6f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:19:01.339120 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1259/2532] 10.222.0.36 () {58 vars in 1232 bytes} [Tue May 3 14:19:01 2022] DELETE /identity/v3/projects/96ea0b979abc42ec8fa17b097992a8f4 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 14:19:01.343564 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1a25a3-c6bf-43b5-84d8-edff2b606990 service neutron] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:19:01.354248 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1a25a3-c6bf-43b5-84d8-edff2b606990 service neutron] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:19:01.411619 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134ccb9c-43f6-4bc2-b65a-d9986327132a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:19:01.412782 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134ccb9c-43f6-4bc2-b65a-d9986327132a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:19:01.413273 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134ccb9c-43f6-4bc2-b65a-d9986327132a admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:19:01.413578 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134ccb9c-43f6-4bc2-b65a-d9986327132a admin admin] PATH_INFO: `/v3/users/88201e52abb940728c8ba7e4b27a4597` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:19:01.414829 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134ccb9c-43f6-4bc2-b65a-d9986327132a admin admin] RBAC: Authorizing `identity:delete_user(user_id=88201e52abb940728c8ba7e4b27a4597)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:19:01.416785 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134ccb9c-43f6-4bc2-b65a-d9986327132a admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:19:01.469129 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-134ccb9c-43f6-4bc2-b65a-d9986327132a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88201e52abb940728c8ba7e4b27a4597'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:19:01.476134 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-134ccb9c-43f6-4bc2-b65a-d9986327132a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88201e52abb940728c8ba7e4b27a4597'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:19:01.476761 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-134ccb9c-43f6-4bc2-b65a-d9986327132a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88201e52abb940728c8ba7e4b27a4597'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:19:01.492867 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-134ccb9c-43f6-4bc2-b65a-d9986327132a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88201e52abb940728c8ba7e4b27a4597'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:19:01.493772 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-134ccb9c-43f6-4bc2-b65a-d9986327132a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88201e52abb940728c8ba7e4b27a4597'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:19:01.516336 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1274/2533] 10.222.0.36 () {58 vars in 1223 bytes} [Tue May 3 14:19:01 2022] DELETE /identity/v3/users/88201e52abb940728c8ba7e4b27a4597 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 14:19:01.840546 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e569d876-ad3e-4f0b-835d-f4486cdab6f6 admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:19:01.841968 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-e569d876-ad3e-4f0b-835d-f4486cdab6f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:19:01.856056 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e569d876-ad3e-4f0b-835d-f4486cdab6f6 admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:19:01.915554 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99da3bb-8d51-4353-88bc-7d1f131077c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:19:01.916597 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99da3bb-8d51-4353-88bc-7d1f131077c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:19:01.916873 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99da3bb-8d51-4353-88bc-7d1f131077c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:19:01.917142 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99da3bb-8d51-4353-88bc-7d1f131077c6 admin admin] PATH_INFO: `/v3/projects/ecc350b659f34a4fb4e593c2536ab06b` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:19:01.918440 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99da3bb-8d51-4353-88bc-7d1f131077c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ecc350b659f34a4fb4e593c2536ab06b)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:19:01.920399 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99da3bb-8d51-4353-88bc-7d1f131077c6 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:19:01.969228 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-e99da3bb-8d51-4353-88bc-7d1f131077c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ecc350b659f34a4fb4e593c2536ab06b', 'request_id': 'req-e99da3bb-8d51-4353-88bc-7d1f131077c6'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:19:01.976176 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-e99da3bb-8d51-4353-88bc-7d1f131077c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ecc350b659f34a4fb4e593c2536ab06b', 'request_id': 'req-e99da3bb-8d51-4353-88bc-7d1f131077c6'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:19:01.981964 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-e99da3bb-8d51-4353-88bc-7d1f131077c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ecc350b659f34a4fb4e593c2536ab06b', 'request_id': 'req-e99da3bb-8d51-4353-88bc-7d1f131077c6'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:19:01.996698 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-e99da3bb-8d51-4353-88bc-7d1f131077c6 admin admin] The token cache is being invalidate because project ecc350b659f34a4fb4e593c2536ab06b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80012) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 14:19:01.997086 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-e99da3bb-8d51-4353-88bc-7d1f131077c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:19:01.997863 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-e99da3bb-8d51-4353-88bc-7d1f131077c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:19:01.999502 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1260/2534] 10.222.0.36 () {58 vars in 1232 bytes} [Tue May 3 14:19:01 2022] DELETE /identity/v3/projects/ecc350b659f34a4fb4e593c2536ab06b => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:19:02.004805 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b867615f-16dd-4289-a1c7-de43af6ead76 None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:19:02.005350 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b867615f-16dd-4289-a1c7-de43af6ead76 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:19:02.005487 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b867615f-16dd-4289-a1c7-de43af6ead76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:19:02.023109 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-b867615f-16dd-4289-a1c7-de43af6ead76 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:19:02.024306 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-b867615f-16dd-4289-a1c7-de43af6ead76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:19:02.105471 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1275/2535] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:19:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:19:02.114474 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022542a9-8ba2-497d-938d-8e9de0b8b8d0 None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:19:02.114764 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022542a9-8ba2-497d-938d-8e9de0b8b8d0 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:19:02.115026 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022542a9-8ba2-497d-938d-8e9de0b8b8d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:19:02.137860 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-022542a9-8ba2-497d-938d-8e9de0b8b8d0 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:19:02.139134 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-022542a9-8ba2-497d-938d-8e9de0b8b8d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:19:02.148733 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1261/2536] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:19:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:19:02.153190 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b867615f-16dd-4289-a1c7-de43af6ead76 None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:19:02.164949 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b867615f-16dd-4289-a1c7-de43af6ead76 None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:19:02.177097 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9178ab9-744d-447d-8cfd-c5704a39c7e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:19:02.178606 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9178ab9-744d-447d-8cfd-c5704a39c7e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:19:02.178964 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9178ab9-744d-447d-8cfd-c5704a39c7e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:19:02.179249 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9178ab9-744d-447d-8cfd-c5704a39c7e2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:19:02.179995 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9178ab9-744d-447d-8cfd-c5704a39c7e2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:19:02.180339 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9178ab9-744d-447d-8cfd-c5704a39c7e2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:19:02.182212 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9178ab9-744d-447d-8cfd-c5704a39c7e2 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:19:02.214495 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022542a9-8ba2-497d-938d-8e9de0b8b8d0 None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:19:02.218088 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1276/2537] 10.222.0.36 () {58 vars in 1152 bytes} [Tue May 3 14:19:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:19:02.225854 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022542a9-8ba2-497d-938d-8e9de0b8b8d0 None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:19:02.230965 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9174a0e2-d8db-4703-bc4b-5c5d8bbe9608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:19:02.231655 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9174a0e2-d8db-4703-bc4b-5c5d8bbe9608 admin admin] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:19:02.232241 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9174a0e2-d8db-4703-bc4b-5c5d8bbe9608 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:19:02.232241 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9174a0e2-d8db-4703-bc4b-5c5d8bbe9608 admin admin] PATH_INFO: `/v3/projects` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:19:02.232886 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9174a0e2-d8db-4703-bc4b-5c5d8bbe9608 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:19:02.235638 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9174a0e2-d8db-4703-bc4b-5c5d8bbe9608 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:19:02.271616 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1262/2538] 10.222.0.36 () {60 vars in 1152 bytes} [Tue May 3 14:19:02 2022] POST /identity/v3/projects => generated 379 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 14:19:02.275975 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9178ab9-744d-447d-8cfd-c5704a39c7e2 admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:19:02.287756 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9178ab9-744d-447d-8cfd-c5704a39c7e2 admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:19:02.374405 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3189764-c82c-4723-98e2-4a0f1f4b8ec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:19:02.375556 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3189764-c82c-4723-98e2-4a0f1f4b8ec8 admin admin] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:19:02.376002 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3189764-c82c-4723-98e2-4a0f1f4b8ec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:19:02.376437 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3189764-c82c-4723-98e2-4a0f1f4b8ec8 admin admin] PATH_INFO: `/v3/users` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:19:02.377470 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3189764-c82c-4723-98e2-4a0f1f4b8ec8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:19:02.379927 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3189764-c82c-4723-98e2-4a0f1f4b8ec8 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:19:02.407996 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9174a0e2-d8db-4703-bc4b-5c5d8bbe9608 admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:19:02.409660 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1277/2539] 10.222.0.36 () {60 vars in 1143 bytes} [Tue May 3 14:19:02 2022] POST /identity/v3/users => generated 290 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 14:19:02.420191 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9174a0e2-d8db-4703-bc4b-5c5d8bbe9608 admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:19:02.425309 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2786c9-85f8-455a-873a-36f3e3f46b7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:19:02.425996 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2786c9-85f8-455a-873a-36f3e3f46b7b admin admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:19:02.426307 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2786c9-85f8-455a-873a-36f3e3f46b7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:19:02.426583 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2786c9-85f8-455a-873a-36f3e3f46b7b admin admin] PATH_INFO: `/v3/roles` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:19:02.427363 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2786c9-85f8-455a-873a-36f3e3f46b7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:19:02.428979 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2786c9-85f8-455a-873a-36f3e3f46b7b admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:19:02.443365 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1263/2540] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 3 14:19:02 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 14:19:02.446035 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3189764-c82c-4723-98e2-4a0f1f4b8ec8 admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:19:02.469258 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3189764-c82c-4723-98e2-4a0f1f4b8ec8 admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:19:02.475449 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaaae0e-07e6-4beb-b4cf-a3acd5f6d319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:19:02.476140 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaaae0e-07e6-4beb-b4cf-a3acd5f6d319 admin admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:19:02.476421 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaaae0e-07e6-4beb-b4cf-a3acd5f6d319 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:19:02.476697 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaaae0e-07e6-4beb-b4cf-a3acd5f6d319 admin admin] PATH_INFO: `/v3/roles` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:19:02.477480 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aaaae0e-07e6-4beb-b4cf-a3acd5f6d319 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:19:02.479115 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aaaae0e-07e6-4beb-b4cf-a3acd5f6d319 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:19:02.490607 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1278/2541] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 3 14:19:02 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 14:19:02.496357 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2786c9-85f8-455a-873a-36f3e3f46b7b admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:19:02.508417 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2786c9-85f8-455a-873a-36f3e3f46b7b admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:19:02.513549 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14cbbba-52c2-4652-bae5-9541eb98321a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:19:02.514604 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14cbbba-52c2-4652-bae5-9541eb98321a admin admin] REQUEST_METHOD: `PUT` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:19:02.514846 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14cbbba-52c2-4652-bae5-9541eb98321a admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:19:02.515091 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14cbbba-52c2-4652-bae5-9541eb98321a admin admin] PATH_INFO: `/v3/projects/114bd737375041f7afea8d05cb1ea64d/users/f5002b940a27414b86a75faef36941fa/roles/441fdc11e95b47f4813f72610e39018b` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:19:02.532317 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14cbbba-52c2-4652-bae5-9541eb98321a admin admin] RBAC: Authorizing `identity:create_grant(project_id=114bd737375041f7afea8d05cb1ea64d, user_id=f5002b940a27414b86a75faef36941fa, role_id=441fdc11e95b47f4813f72610e39018b)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:19:02.535383 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14cbbba-52c2-4652-bae5-9541eb98321a admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:19:02.551954 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1264/2542] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 3 14:19:02 2022] PUT /identity/v3/projects/114bd737375041f7afea8d05cb1ea64d/users/f5002b940a27414b86a75faef36941fa/roles/441fdc11e95b47f4813f72610e39018b => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:19:02.563874 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ca599f-c94f-4382-b98f-b5dbb374cc2f None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:19:02.564162 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ca599f-c94f-4382-b98f-b5dbb374cc2f None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:19:02.564432 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ca599f-c94f-4382-b98f-b5dbb374cc2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:19:02.607306 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-00ca599f-c94f-4382-b98f-b5dbb374cc2f None None] MFA Rules not processed for user `f5002b940a27414b86a75faef36941fa`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:19:02.608536 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-00ca599f-c94f-4382-b98f-b5dbb374cc2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:19:02.694393 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1279/2543] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:19:02 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:19:02.699015 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14cbbba-52c2-4652-bae5-9541eb98321a admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:19:02.762890 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14cbbba-52c2-4652-bae5-9541eb98321a admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:19:02.768119 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcee0c5c-619c-420b-a73d-fa7d5014aeb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:19:02.768895 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcee0c5c-619c-420b-a73d-fa7d5014aeb8 admin admin] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:19:02.769354 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcee0c5c-619c-420b-a73d-fa7d5014aeb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:19:02.769637 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcee0c5c-619c-420b-a73d-fa7d5014aeb8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:19:02.770401 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcee0c5c-619c-420b-a73d-fa7d5014aeb8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:19:02.772396 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcee0c5c-619c-420b-a73d-fa7d5014aeb8 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:19:02.804568 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1265/2544] 10.222.0.36 () {60 vars in 1152 bytes} [Tue May 3 14:19:02 2022] POST /identity/v3/projects => generated 381 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 14:19:02.808529 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ca599f-c94f-4382-b98f-b5dbb374cc2f None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:19:02.821626 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ca599f-c94f-4382-b98f-b5dbb374cc2f None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:19:02.882207 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3027257-30da-4711-bf97-525792ccb4d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:19:02.882893 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3027257-30da-4711-bf97-525792ccb4d6 admin admin] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:19:02.883170 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3027257-30da-4711-bf97-525792ccb4d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:19:02.883446 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3027257-30da-4711-bf97-525792ccb4d6 admin admin] PATH_INFO: `/v3/users` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:19:02.884371 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3027257-30da-4711-bf97-525792ccb4d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:19:02.886349 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3027257-30da-4711-bf97-525792ccb4d6 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:19:02.911694 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1280/2545] 10.222.0.36 () {60 vars in 1143 bytes} [Tue May 3 14:19:02 2022] POST /identity/v3/users => generated 297 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 14:19:02.915861 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcee0c5c-619c-420b-a73d-fa7d5014aeb8 admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:19:02.926524 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcee0c5c-619c-420b-a73d-fa7d5014aeb8 admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:19:02.931442 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85b1dfd-b944-4b40-83fd-01678937e814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:19:02.932108 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85b1dfd-b944-4b40-83fd-01678937e814 admin admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:19:02.932408 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85b1dfd-b944-4b40-83fd-01678937e814 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:19:02.932722 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85b1dfd-b944-4b40-83fd-01678937e814 admin admin] PATH_INFO: `/v3/roles` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:19:02.933509 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85b1dfd-b944-4b40-83fd-01678937e814 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:19:02.935117 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85b1dfd-b944-4b40-83fd-01678937e814 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:19:02.949155 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1266/2546] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 3 14:19:02 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 14:19:02.951047 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3027257-30da-4711-bf97-525792ccb4d6 admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:19:02.962509 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3027257-30da-4711-bf97-525792ccb4d6 admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:19:02.967296 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa3edf3-0bb5-47e4-9f04-6b08244ca7ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:19:02.968201 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa3edf3-0bb5-47e4-9f04-6b08244ca7ad admin admin] REQUEST_METHOD: `PUT` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:19:02.968475 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa3edf3-0bb5-47e4-9f04-6b08244ca7ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:19:02.968749 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa3edf3-0bb5-47e4-9f04-6b08244ca7ad admin admin] PATH_INFO: `/v3/projects/25bae3d3b75d4c1aac27812a56afdd27/users/b1c2356931574b68a0f47efc19b52506/roles/36abe9b50fd8479c86c4f8f70fd85aa3` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:19:02.985340 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa3edf3-0bb5-47e4-9f04-6b08244ca7ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=25bae3d3b75d4c1aac27812a56afdd27, user_id=b1c2356931574b68a0f47efc19b52506, role_id=36abe9b50fd8479c86c4f8f70fd85aa3)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:19:02.988146 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa3edf3-0bb5-47e4-9f04-6b08244ca7ad admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:19:03.003015 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1281/2547] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 3 14:19:02 2022] PUT /identity/v3/projects/25bae3d3b75d4c1aac27812a56afdd27/users/b1c2356931574b68a0f47efc19b52506/roles/36abe9b50fd8479c86c4f8f70fd85aa3 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:19:03.007537 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85b1dfd-b944-4b40-83fd-01678937e814 admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:19:03.017795 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85b1dfd-b944-4b40-83fd-01678937e814 admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:19:03.079384 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28098d21-e7d3-4e91-98bd-3ebc782e300f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:19:03.080067 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28098d21-e7d3-4e91-98bd-3ebc782e300f admin admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:19:03.080421 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28098d21-e7d3-4e91-98bd-3ebc782e300f admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:19:03.080713 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28098d21-e7d3-4e91-98bd-3ebc782e300f admin admin] PATH_INFO: `/v3/roles` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:19:03.081600 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28098d21-e7d3-4e91-98bd-3ebc782e300f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:19:03.083219 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28098d21-e7d3-4e91-98bd-3ebc782e300f admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:19:03.094308 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1267/2548] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 3 14:19:03 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 14:19:03.098730 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa3edf3-0bb5-47e4-9f04-6b08244ca7ad admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:19:03.109479 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa3edf3-0bb5-47e4-9f04-6b08244ca7ad admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:19:03.115381 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fbdbfc-7802-482e-93ce-81ab76c1a35b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:19:03.116468 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fbdbfc-7802-482e-93ce-81ab76c1a35b admin admin] REQUEST_METHOD: `PUT` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:19:03.116774 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fbdbfc-7802-482e-93ce-81ab76c1a35b admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:19:03.117006 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fbdbfc-7802-482e-93ce-81ab76c1a35b admin admin] PATH_INFO: `/v3/projects/25bae3d3b75d4c1aac27812a56afdd27/users/b1c2356931574b68a0f47efc19b52506/roles/36abe9b50fd8479c86c4f8f70fd85aa3` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:19:03.119151 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fbdbfc-7802-482e-93ce-81ab76c1a35b admin admin] RBAC: Authorizing `identity:create_grant(project_id=25bae3d3b75d4c1aac27812a56afdd27, user_id=b1c2356931574b68a0f47efc19b52506, role_id=36abe9b50fd8479c86c4f8f70fd85aa3)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:19:03.121904 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fbdbfc-7802-482e-93ce-81ab76c1a35b admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:19:03.145366 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1282/2549] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 3 14:19:03 2022] PUT /identity/v3/projects/25bae3d3b75d4c1aac27812a56afdd27/users/b1c2356931574b68a0f47efc19b52506/roles/36abe9b50fd8479c86c4f8f70fd85aa3 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 14:19:03.160445 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250fb316-0a33-40a4-8cd6-5604898546a0 None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:19:03.160801 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250fb316-0a33-40a4-8cd6-5604898546a0 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:19:03.161019 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250fb316-0a33-40a4-8cd6-5604898546a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:19:03.194905 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-250fb316-0a33-40a4-8cd6-5604898546a0 None None] MFA Rules not processed for user `b1c2356931574b68a0f47efc19b52506`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:19:03.196268 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-250fb316-0a33-40a4-8cd6-5604898546a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:19:03.289271 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1268/2550] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:19:03 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:19:03.301687 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fbdbfc-7802-482e-93ce-81ab76c1a35b admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:19:03.304588 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-50fbdbfc-7802-482e-93ce-81ab76c1a35b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:19:03.406695 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fbdbfc-7802-482e-93ce-81ab76c1a35b admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:19:03.410782 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dc663d-69c2-4d25-8f25-6a5bd058b8dc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b014f4c7ba1414cb8a597f5bc4033f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:19:03.412240 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dc663d-69c2-4d25-8f25-6a5bd058b8dc service cinder] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:19:03.412604 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dc663d-69c2-4d25-8f25-6a5bd058b8dc service cinder] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:19:03.412941 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dc663d-69c2-4d25-8f25-6a5bd058b8dc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:19:03.425234 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dc663d-69c2-4d25-8f25-6a5bd058b8dc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:19:03.426861 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dc663d-69c2-4d25-8f25-6a5bd058b8dc service cinder] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:19:03.449488 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1283/2551] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:19:03 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 14:19:03.850197 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250fb316-0a33-40a4-8cd6-5604898546a0 None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:19:03.916502 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250fb316-0a33-40a4-8cd6-5604898546a0 None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:19:03.921418 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d16090b-9988-4960-bc49-55dde411c540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:19:03.922300 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d16090b-9988-4960-bc49-55dde411c540 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:19:03.922575 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d16090b-9988-4960-bc49-55dde411c540 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:19:03.922843 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d16090b-9988-4960-bc49-55dde411c540 admin admin] PATH_INFO: `/v3/users/f5002b940a27414b86a75faef36941fa` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:19:03.924151 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d16090b-9988-4960-bc49-55dde411c540 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5002b940a27414b86a75faef36941fa)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:19:03.926104 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d16090b-9988-4960-bc49-55dde411c540 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:19:03.978436 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-1d16090b-9988-4960-bc49-55dde411c540 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5002b940a27414b86a75faef36941fa'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:19:03.985993 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-1d16090b-9988-4960-bc49-55dde411c540 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5002b940a27414b86a75faef36941fa'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:19:03.986849 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-1d16090b-9988-4960-bc49-55dde411c540 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5002b940a27414b86a75faef36941fa'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:19:03.999110 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-1d16090b-9988-4960-bc49-55dde411c540 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5002b940a27414b86a75faef36941fa'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:19:03.999816 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-1d16090b-9988-4960-bc49-55dde411c540 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5002b940a27414b86a75faef36941fa'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:19:04.015546 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1269/2552] 10.222.0.36 () {58 vars in 1223 bytes} [Tue May 3 14:19:03 2022] DELETE /identity/v3/users/f5002b940a27414b86a75faef36941fa => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:19:04.020947 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594ba655-7f77-4d4c-b1d1-f7a2084c0ac1 None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:19:04.021233 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594ba655-7f77-4d4c-b1d1-f7a2084c0ac1 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:19:04.021549 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594ba655-7f77-4d4c-b1d1-f7a2084c0ac1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:19:04.041185 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-594ba655-7f77-4d4c-b1d1-f7a2084c0ac1 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:19:04.042764 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-594ba655-7f77-4d4c-b1d1-f7a2084c0ac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:19:04.106151 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1284/2553] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:19:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:19:04.116658 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d16090b-9988-4960-bc49-55dde411c540 admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:19:04.118276 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-1d16090b-9988-4960-bc49-55dde411c540 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:19:04.183418 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d16090b-9988-4960-bc49-55dde411c540 admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:19:04.187595 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8b5714-8393-4b9f-b0bf-7774ce015e8e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '937bea4f355144b4a7ee11baabc3a4cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:19:04.188274 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8b5714-8393-4b9f-b0bf-7774ce015e8e service neutron] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:19:04.188525 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8b5714-8393-4b9f-b0bf-7774ce015e8e service neutron] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:19:04.188822 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8b5714-8393-4b9f-b0bf-7774ce015e8e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:19:04.198610 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8b5714-8393-4b9f-b0bf-7774ce015e8e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:19:04.200038 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8b5714-8393-4b9f-b0bf-7774ce015e8e service neutron] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:19:04.210072 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1270/2554] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:19:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 14:19:04.484920 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594ba655-7f77-4d4c-b1d1-f7a2084c0ac1 None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:19:04.486408 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-594ba655-7f77-4d4c-b1d1-f7a2084c0ac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:19:04.500170 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594ba655-7f77-4d4c-b1d1-f7a2084c0ac1 None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:19:04.507663 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845dc50a-4651-4480-81ff-66614bf70497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:19:04.508769 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845dc50a-4651-4480-81ff-66614bf70497 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:19:04.509224 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845dc50a-4651-4480-81ff-66614bf70497 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:19:04.509515 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845dc50a-4651-4480-81ff-66614bf70497 admin admin] PATH_INFO: `/v3/projects/114bd737375041f7afea8d05cb1ea64d` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:19:04.510983 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845dc50a-4651-4480-81ff-66614bf70497 admin admin] RBAC: Authorizing `identity:delete_project(project_id=114bd737375041f7afea8d05cb1ea64d)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:19:04.513239 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845dc50a-4651-4480-81ff-66614bf70497 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:19:04.565943 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-845dc50a-4651-4480-81ff-66614bf70497 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '114bd737375041f7afea8d05cb1ea64d', 'request_id': 'req-845dc50a-4651-4480-81ff-66614bf70497'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:19:04.571972 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-845dc50a-4651-4480-81ff-66614bf70497 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '114bd737375041f7afea8d05cb1ea64d', 'request_id': 'req-845dc50a-4651-4480-81ff-66614bf70497'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:19:04.581274 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-845dc50a-4651-4480-81ff-66614bf70497 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '114bd737375041f7afea8d05cb1ea64d', 'request_id': 'req-845dc50a-4651-4480-81ff-66614bf70497'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:19:04.593248 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-845dc50a-4651-4480-81ff-66614bf70497 admin admin] The token cache is being invalidate because project 114bd737375041f7afea8d05cb1ea64d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80013) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 14:19:04.593568 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-845dc50a-4651-4480-81ff-66614bf70497 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:19:04.594231 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-845dc50a-4651-4480-81ff-66614bf70497 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:19:04.596126 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1285/2555] 10.222.0.36 () {58 vars in 1232 bytes} [Tue May 3 14:19:04 2022] DELETE /identity/v3/projects/114bd737375041f7afea8d05cb1ea64d => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:19:04.600005 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8b5714-8393-4b9f-b0bf-7774ce015e8e service neutron] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:19:04.609834 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8b5714-8393-4b9f-b0bf-7774ce015e8e service neutron] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:19:04.666585 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc4e051-4acd-439c-8d7d-226fb1579332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:19:04.667493 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc4e051-4acd-439c-8d7d-226fb1579332 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:19:04.667755 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc4e051-4acd-439c-8d7d-226fb1579332 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:19:04.668029 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc4e051-4acd-439c-8d7d-226fb1579332 admin admin] PATH_INFO: `/v3/users/b1c2356931574b68a0f47efc19b52506` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:19:04.669211 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc4e051-4acd-439c-8d7d-226fb1579332 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1c2356931574b68a0f47efc19b52506)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:19:04.671152 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc4e051-4acd-439c-8d7d-226fb1579332 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:19:04.719856 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-9bc4e051-4acd-439c-8d7d-226fb1579332 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1c2356931574b68a0f47efc19b52506'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:19:04.726319 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-9bc4e051-4acd-439c-8d7d-226fb1579332 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1c2356931574b68a0f47efc19b52506'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:19:04.727012 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-9bc4e051-4acd-439c-8d7d-226fb1579332 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1c2356931574b68a0f47efc19b52506'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:19:04.738404 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-9bc4e051-4acd-439c-8d7d-226fb1579332 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1c2356931574b68a0f47efc19b52506'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:19:04.739140 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-9bc4e051-4acd-439c-8d7d-226fb1579332 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1c2356931574b68a0f47efc19b52506'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:19:04.753874 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1271/2556] 10.222.0.36 () {58 vars in 1223 bytes} [Tue May 3 14:19:04 2022] DELETE /identity/v3/users/b1c2356931574b68a0f47efc19b52506 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:19:05.044054 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845dc50a-4651-4480-81ff-66614bf70497 admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:19:05.045605 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-845dc50a-4651-4480-81ff-66614bf70497 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:19:05.061115 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845dc50a-4651-4480-81ff-66614bf70497 admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:19:05.120478 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8002f62-fad5-405e-bd46-e81ccd930126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:19:05.121242 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8002f62-fad5-405e-bd46-e81ccd930126 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:19:05.121531 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8002f62-fad5-405e-bd46-e81ccd930126 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:19:05.121804 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8002f62-fad5-405e-bd46-e81ccd930126 admin admin] PATH_INFO: `/v3/projects/25bae3d3b75d4c1aac27812a56afdd27` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:19:05.122977 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8002f62-fad5-405e-bd46-e81ccd930126 admin admin] RBAC: Authorizing `identity:delete_project(project_id=25bae3d3b75d4c1aac27812a56afdd27)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:19:05.124884 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8002f62-fad5-405e-bd46-e81ccd930126 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:19:05.172590 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-c8002f62-fad5-405e-bd46-e81ccd930126 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25bae3d3b75d4c1aac27812a56afdd27', 'request_id': 'req-c8002f62-fad5-405e-bd46-e81ccd930126'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:19:05.177948 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-c8002f62-fad5-405e-bd46-e81ccd930126 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25bae3d3b75d4c1aac27812a56afdd27', 'request_id': 'req-c8002f62-fad5-405e-bd46-e81ccd930126'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:19:05.186533 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-c8002f62-fad5-405e-bd46-e81ccd930126 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25bae3d3b75d4c1aac27812a56afdd27', 'request_id': 'req-c8002f62-fad5-405e-bd46-e81ccd930126'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:19:05.197850 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-c8002f62-fad5-405e-bd46-e81ccd930126 admin admin] The token cache is being invalidate because project 25bae3d3b75d4c1aac27812a56afdd27 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80013) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 14:19:05.198135 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-c8002f62-fad5-405e-bd46-e81ccd930126 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:19:05.198774 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-c8002f62-fad5-405e-bd46-e81ccd930126 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:19:05.200290 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1286/2557] 10.222.0.36 () {58 vars in 1232 bytes} [Tue May 3 14:19:05 2022] DELETE /identity/v3/projects/25bae3d3b75d4c1aac27812a56afdd27 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:19:05.205595 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d114f8-3066-4bf0-ad99-4c663968814f None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:19:05.205873 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d114f8-3066-4bf0-ad99-4c663968814f None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:19:05.206153 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d114f8-3066-4bf0-ad99-4c663968814f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:19:05.225232 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-c4d114f8-3066-4bf0-ad99-4c663968814f None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:19:05.226473 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-c4d114f8-3066-4bf0-ad99-4c663968814f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:19:05.298488 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1272/2558] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:19:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:19:05.308157 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f5a883-676e-462c-b63b-0645311e60b4 None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:19:05.308431 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f5a883-676e-462c-b63b-0645311e60b4 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:19:05.308703 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f5a883-676e-462c-b63b-0645311e60b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:19:05.331202 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-88f5a883-676e-462c-b63b-0645311e60b4 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:19:05.332973 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-88f5a883-676e-462c-b63b-0645311e60b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:19:05.347071 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1287/2559] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:19:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:19:05.351647 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d114f8-3066-4bf0-ad99-4c663968814f None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:19:05.361609 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d114f8-3066-4bf0-ad99-4c663968814f None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:19:05.366611 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cba2634-e025-4afe-9be7-81680d91ab67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:19:05.367261 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cba2634-e025-4afe-9be7-81680d91ab67 admin admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:19:05.367536 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cba2634-e025-4afe-9be7-81680d91ab67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:19:05.367848 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cba2634-e025-4afe-9be7-81680d91ab67 admin admin] PATH_INFO: `/v3/domains` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:19:05.368650 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cba2634-e025-4afe-9be7-81680d91ab67 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80012) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:19:05.368885 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cba2634-e025-4afe-9be7-81680d91ab67 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:19:05.370545 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cba2634-e025-4afe-9be7-81680d91ab67 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:19:05.382928 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1273/2560] 10.222.0.36 () {58 vars in 1152 bytes} [Tue May 3 14:19:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 14:19:05.387609 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f5a883-676e-462c-b63b-0645311e60b4 None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:19:05.397440 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f5a883-676e-462c-b63b-0645311e60b4 None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:19:05.403206 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06c11a4-0eeb-46f5-9d18-d36b3dba9bcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:19:05.403905 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06c11a4-0eeb-46f5-9d18-d36b3dba9bcf admin admin] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:19:05.404184 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06c11a4-0eeb-46f5-9d18-d36b3dba9bcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:19:05.404458 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06c11a4-0eeb-46f5-9d18-d36b3dba9bcf admin admin] PATH_INFO: `/v3/projects` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:19:05.405147 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06c11a4-0eeb-46f5-9d18-d36b3dba9bcf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:19:05.407110 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06c11a4-0eeb-46f5-9d18-d36b3dba9bcf admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:19:05.435573 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1288/2561] 10.222.0.36 () {60 vars in 1152 bytes} [Tue May 3 14:19:05 2022] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 14:19:05.440186 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cba2634-e025-4afe-9be7-81680d91ab67 admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:19:05.451684 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cba2634-e025-4afe-9be7-81680d91ab67 admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:19:05.511749 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3dfa09-714a-4612-9f06-3226200b8fab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:19:05.512487 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3dfa09-714a-4612-9f06-3226200b8fab admin admin] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:19:05.512769 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3dfa09-714a-4612-9f06-3226200b8fab admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:19:05.513050 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3dfa09-714a-4612-9f06-3226200b8fab admin admin] PATH_INFO: `/v3/users` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:19:05.513859 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3dfa09-714a-4612-9f06-3226200b8fab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:19:05.515880 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3dfa09-714a-4612-9f06-3226200b8fab admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:19:05.537990 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1274/2562] 10.222.0.36 () {60 vars in 1143 bytes} [Tue May 3 14:19:05 2022] POST /identity/v3/users => generated 293 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 14:19:05.542449 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06c11a4-0eeb-46f5-9d18-d36b3dba9bcf admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:19:05.553021 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06c11a4-0eeb-46f5-9d18-d36b3dba9bcf admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:19:05.558247 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f40b5a-4179-489f-986a-f1b1131a3db8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:19:05.558955 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f40b5a-4179-489f-986a-f1b1131a3db8 admin admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:19:05.559229 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f40b5a-4179-489f-986a-f1b1131a3db8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:19:05.559496 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f40b5a-4179-489f-986a-f1b1131a3db8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:19:05.560217 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f40b5a-4179-489f-986a-f1b1131a3db8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:19:05.561872 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f40b5a-4179-489f-986a-f1b1131a3db8 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:19:05.572563 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1289/2563] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 3 14:19:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 14:19:05.577079 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3dfa09-714a-4612-9f06-3226200b8fab admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:19:05.588706 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3dfa09-714a-4612-9f06-3226200b8fab admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:19:05.594544 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cd9c43-526e-4b36-85df-80c4c140ac52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:19:05.595268 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cd9c43-526e-4b36-85df-80c4c140ac52 admin admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:19:05.595527 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cd9c43-526e-4b36-85df-80c4c140ac52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:19:05.595803 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cd9c43-526e-4b36-85df-80c4c140ac52 admin admin] PATH_INFO: `/v3/roles` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:19:05.596526 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cd9c43-526e-4b36-85df-80c4c140ac52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:19:05.598240 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cd9c43-526e-4b36-85df-80c4c140ac52 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:19:05.608730 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1275/2564] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 3 14:19:05 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 14:19:05.613364 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f40b5a-4179-489f-986a-f1b1131a3db8 admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:19:05.623515 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f40b5a-4179-489f-986a-f1b1131a3db8 admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:19:05.628626 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f21d37d-e3c6-4c5a-b60f-fe1d1a92e70a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:19:05.629560 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f21d37d-e3c6-4c5a-b60f-fe1d1a92e70a admin admin] REQUEST_METHOD: `PUT` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:19:05.629837 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f21d37d-e3c6-4c5a-b60f-fe1d1a92e70a admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:19:05.630104 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f21d37d-e3c6-4c5a-b60f-fe1d1a92e70a admin admin] PATH_INFO: `/v3/projects/ec5f1db5f04e4c7f8a708a3eb3ffe15c/users/ea47ae7410574d95abfb95367621b317/roles/441fdc11e95b47f4813f72610e39018b` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:19:05.644193 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f21d37d-e3c6-4c5a-b60f-fe1d1a92e70a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec5f1db5f04e4c7f8a708a3eb3ffe15c, user_id=ea47ae7410574d95abfb95367621b317, role_id=441fdc11e95b47f4813f72610e39018b)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:19:05.646877 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f21d37d-e3c6-4c5a-b60f-fe1d1a92e70a admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:19:05.662720 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1290/2565] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 3 14:19:05 2022] PUT /identity/v3/projects/ec5f1db5f04e4c7f8a708a3eb3ffe15c/users/ea47ae7410574d95abfb95367621b317/roles/441fdc11e95b47f4813f72610e39018b => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:19:05.673196 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efef969e-15a5-46fa-af24-f4ca042e460a None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:19:05.673535 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efef969e-15a5-46fa-af24-f4ca042e460a None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:19:05.673895 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efef969e-15a5-46fa-af24-f4ca042e460a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:19:05.700832 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-efef969e-15a5-46fa-af24-f4ca042e460a None None] MFA Rules not processed for user `ea47ae7410574d95abfb95367621b317`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:19:05.702294 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-efef969e-15a5-46fa-af24-f4ca042e460a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:19:05.767001 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1276/2566] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:19:05 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 14:19:05.771700 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f21d37d-e3c6-4c5a-b60f-fe1d1a92e70a admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:19:05.837972 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f21d37d-e3c6-4c5a-b60f-fe1d1a92e70a admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:19:05.844155 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecab883-2384-4504-9b8c-61b19234dc89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:19:05.844359 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecab883-2384-4504-9b8c-61b19234dc89 admin admin] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:19:05.844737 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecab883-2384-4504-9b8c-61b19234dc89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:19:05.845111 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecab883-2384-4504-9b8c-61b19234dc89 admin admin] PATH_INFO: `/v3/projects` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:19:05.846153 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecab883-2384-4504-9b8c-61b19234dc89 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:19:05.848426 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecab883-2384-4504-9b8c-61b19234dc89 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:19:05.876505 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1291/2567] 10.222.0.36 () {60 vars in 1152 bytes} [Tue May 3 14:19:05 2022] POST /identity/v3/projects => generated 385 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 14:19:05.880765 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efef969e-15a5-46fa-af24-f4ca042e460a None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:19:05.893184 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efef969e-15a5-46fa-af24-f4ca042e460a None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:19:05.952268 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9b9375-569a-44f2-a370-e081070fd551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:19:05.952939 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9b9375-569a-44f2-a370-e081070fd551 admin admin] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:19:05.953220 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9b9375-569a-44f2-a370-e081070fd551 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:19:05.953524 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9b9375-569a-44f2-a370-e081070fd551 admin admin] PATH_INFO: `/v3/users` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:19:05.954226 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9b9375-569a-44f2-a370-e081070fd551 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:19:05.957138 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9b9375-569a-44f2-a370-e081070fd551 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:19:05.983586 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1277/2568] 10.222.0.36 () {60 vars in 1143 bytes} [Tue May 3 14:19:05 2022] POST /identity/v3/users => generated 299 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 14:19:05.989745 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecab883-2384-4504-9b8c-61b19234dc89 admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:19:06.004758 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecab883-2384-4504-9b8c-61b19234dc89 admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:19:06.009693 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97499b94-37e7-4bcf-968b-451a1559d499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:19:06.010354 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97499b94-37e7-4bcf-968b-451a1559d499 admin admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:19:06.010639 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97499b94-37e7-4bcf-968b-451a1559d499 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:19:06.010908 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97499b94-37e7-4bcf-968b-451a1559d499 admin admin] PATH_INFO: `/v3/roles` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:19:06.011664 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97499b94-37e7-4bcf-968b-451a1559d499 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:19:06.013308 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97499b94-37e7-4bcf-968b-451a1559d499 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:19:06.025070 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1292/2569] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 3 14:19:05 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 14:19:06.029374 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9b9375-569a-44f2-a370-e081070fd551 admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:19:06.040119 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9b9375-569a-44f2-a370-e081070fd551 admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:19:06.046130 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7393063b-29a7-407a-913f-71ba4484c726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:19:06.046812 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7393063b-29a7-407a-913f-71ba4484c726 admin admin] REQUEST_METHOD: `PUT` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:19:06.047138 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7393063b-29a7-407a-913f-71ba4484c726 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:19:06.047442 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7393063b-29a7-407a-913f-71ba4484c726 admin admin] PATH_INFO: `/v3/projects/4ee774b78f134793a9af372509c5ad10/users/3643cfbe48e046158d8f87511045e4b1/roles/36abe9b50fd8479c86c4f8f70fd85aa3` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:19:06.066430 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7393063b-29a7-407a-913f-71ba4484c726 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ee774b78f134793a9af372509c5ad10, user_id=3643cfbe48e046158d8f87511045e4b1, role_id=36abe9b50fd8479c86c4f8f70fd85aa3)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:19:06.069105 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7393063b-29a7-407a-913f-71ba4484c726 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:19:06.085147 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1278/2570] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 3 14:19:06 2022] PUT /identity/v3/projects/4ee774b78f134793a9af372509c5ad10/users/3643cfbe48e046158d8f87511045e4b1/roles/36abe9b50fd8479c86c4f8f70fd85aa3 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:19:06.089191 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97499b94-37e7-4bcf-968b-451a1559d499 admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:19:06.099451 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97499b94-37e7-4bcf-968b-451a1559d499 admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:19:06.157813 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a33a350-4ecb-4c4d-a1d0-3b53366cd099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:19:06.158589 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a33a350-4ecb-4c4d-a1d0-3b53366cd099 admin admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:19:06.158864 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a33a350-4ecb-4c4d-a1d0-3b53366cd099 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:19:06.159168 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a33a350-4ecb-4c4d-a1d0-3b53366cd099 admin admin] PATH_INFO: `/v3/roles` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:19:06.160039 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a33a350-4ecb-4c4d-a1d0-3b53366cd099 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:19:06.161800 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a33a350-4ecb-4c4d-a1d0-3b53366cd099 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:19:06.171776 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1293/2571] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 3 14:19:06 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 14:19:06.176178 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7393063b-29a7-407a-913f-71ba4484c726 admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:19:06.186889 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7393063b-29a7-407a-913f-71ba4484c726 admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:19:06.192032 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b4d2ce-a45b-4b26-8d34-7e579feda4cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:19:06.192914 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b4d2ce-a45b-4b26-8d34-7e579feda4cc admin admin] REQUEST_METHOD: `PUT` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:19:06.193192 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b4d2ce-a45b-4b26-8d34-7e579feda4cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:19:06.193487 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b4d2ce-a45b-4b26-8d34-7e579feda4cc admin admin] PATH_INFO: `/v3/projects/4ee774b78f134793a9af372509c5ad10/users/3643cfbe48e046158d8f87511045e4b1/roles/36abe9b50fd8479c86c4f8f70fd85aa3` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:19:06.195445 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b4d2ce-a45b-4b26-8d34-7e579feda4cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ee774b78f134793a9af372509c5ad10, user_id=3643cfbe48e046158d8f87511045e4b1, role_id=36abe9b50fd8479c86c4f8f70fd85aa3)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:19:06.198202 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b4d2ce-a45b-4b26-8d34-7e579feda4cc admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:19:06.208768 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1279/2572] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 3 14:19:06 2022] PUT /identity/v3/projects/4ee774b78f134793a9af372509c5ad10/users/3643cfbe48e046158d8f87511045e4b1/roles/36abe9b50fd8479c86c4f8f70fd85aa3 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:19:06.219522 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f58c4e7-ac7f-422a-b044-fc3714296a2e None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:19:06.219807 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f58c4e7-ac7f-422a-b044-fc3714296a2e None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:19:06.220080 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f58c4e7-ac7f-422a-b044-fc3714296a2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:19:06.247898 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-2f58c4e7-ac7f-422a-b044-fc3714296a2e None None] MFA Rules not processed for user `3643cfbe48e046158d8f87511045e4b1`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:19:06.249123 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-2f58c4e7-ac7f-422a-b044-fc3714296a2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:19:06.317803 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1294/2573] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:19:06 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:19:06.332160 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b4d2ce-a45b-4b26-8d34-7e579feda4cc admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:19:06.334515 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-00b4d2ce-a45b-4b26-8d34-7e579feda4cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:19:06.396852 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b4d2ce-a45b-4b26-8d34-7e579feda4cc admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:19:06.400671 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636588c4-2129-4701-9861-c9b14204cf36 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b014f4c7ba1414cb8a597f5bc4033f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:19:06.401323 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636588c4-2129-4701-9861-c9b14204cf36 service cinder] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:19:06.401612 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636588c4-2129-4701-9861-c9b14204cf36 service cinder] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:19:06.401888 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636588c4-2129-4701-9861-c9b14204cf36 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:19:06.460693 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636588c4-2129-4701-9861-c9b14204cf36 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:19:06.462200 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636588c4-2129-4701-9861-c9b14204cf36 service cinder] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:19:06.471400 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1280/2574] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:19:06 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 03 14:19:10.696769 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f58c4e7-ac7f-422a-b044-fc3714296a2e None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:19:10.706320 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f58c4e7-ac7f-422a-b044-fc3714296a2e None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:19:10.710424 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904478c7-86af-43c6-b17b-1a874f6826da service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b014f4c7ba1414cb8a597f5bc4033f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:19:10.711192 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904478c7-86af-43c6-b17b-1a874f6826da service cinder] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:19:10.711534 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904478c7-86af-43c6-b17b-1a874f6826da service cinder] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:19:10.711815 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904478c7-86af-43c6-b17b-1a874f6826da service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:19:10.721439 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904478c7-86af-43c6-b17b-1a874f6826da service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:19:10.722923 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904478c7-86af-43c6-b17b-1a874f6826da service cinder] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:19:10.733046 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1295/2575] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:19:10 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 14:19:11.132164 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1991895a-bee0-4847-a3e8-8ddb3388612f None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:19:11.132671 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1991895a-bee0-4847-a3e8-8ddb3388612f None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:19:11.132772 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1991895a-bee0-4847-a3e8-8ddb3388612f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:19:11.153688 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-1991895a-bee0-4847-a3e8-8ddb3388612f None None] MFA Rules not processed for user `dec39ff0b6544a738e5aae06e9a8cb38`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:19:11.154941 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-1991895a-bee0-4847-a3e8-8ddb3388612f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:19:11.221853 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1281/2576] 10.222.0.36 () {58 vars in 967 bytes} [Tue May 3 14:19:11 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:19:11.234403 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904478c7-86af-43c6-b17b-1a874f6826da service cinder] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:19:11.236855 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-904478c7-86af-43c6-b17b-1a874f6826da service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:19:11.325923 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904478c7-86af-43c6-b17b-1a874f6826da service cinder] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:19:11.332988 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ff4512-e057-4321-a8b0-b33e5ff51516 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1180e29180d44418390cf22d3e0bd6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:19:11.333791 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ff4512-e057-4321-a8b0-b33e5ff51516 service swift] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:19:11.334140 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ff4512-e057-4321-a8b0-b33e5ff51516 service swift] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:19:11.334809 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ff4512-e057-4321-a8b0-b33e5ff51516 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:19:11.344505 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ff4512-e057-4321-a8b0-b33e5ff51516 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:19:11.346421 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ff4512-e057-4321-a8b0-b33e5ff51516 service swift] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:19:11.356378 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1296/2577] 10.222.0.36 () {60 vars in 1384 bytes} [Tue May 3 14:19:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 03 14:19:15.763835 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1991895a-bee0-4847-a3e8-8ddb3388612f None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:19:15.831506 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1991895a-bee0-4847-a3e8-8ddb3388612f None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:19:15.837661 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe7298d-a570-4133-ad48-ace412166b27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:19:15.838547 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe7298d-a570-4133-ad48-ace412166b27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:19:15.838839 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe7298d-a570-4133-ad48-ace412166b27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:19:15.839049 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe7298d-a570-4133-ad48-ace412166b27 admin admin] PATH_INFO: `/v3/users/ea47ae7410574d95abfb95367621b317` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:19:15.840422 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe7298d-a570-4133-ad48-ace412166b27 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea47ae7410574d95abfb95367621b317)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:19:15.842594 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe7298d-a570-4133-ad48-ace412166b27 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:19:15.890780 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-bbe7298d-a570-4133-ad48-ace412166b27 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea47ae7410574d95abfb95367621b317'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:19:15.898202 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-bbe7298d-a570-4133-ad48-ace412166b27 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea47ae7410574d95abfb95367621b317'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:19:15.898953 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-bbe7298d-a570-4133-ad48-ace412166b27 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea47ae7410574d95abfb95367621b317'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:19:15.911426 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-bbe7298d-a570-4133-ad48-ace412166b27 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea47ae7410574d95abfb95367621b317'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:19:15.912050 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-bbe7298d-a570-4133-ad48-ace412166b27 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea47ae7410574d95abfb95367621b317'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:19:15.926807 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1282/2578] 10.222.0.36 () {58 vars in 1223 bytes} [Tue May 3 14:19:15 2022] DELETE /identity/v3/users/ea47ae7410574d95abfb95367621b317 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:19:15.931739 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6583241e-4873-4614-abc3-86f9f0272d8a None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:19:15.932250 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6583241e-4873-4614-abc3-86f9f0272d8a None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:19:15.932250 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6583241e-4873-4614-abc3-86f9f0272d8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:19:15.949326 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-6583241e-4873-4614-abc3-86f9f0272d8a None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:19:15.950534 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-6583241e-4873-4614-abc3-86f9f0272d8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:19:16.007344 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1297/2579] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:19:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:19:16.017660 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe7298d-a570-4133-ad48-ace412166b27 admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:19:16.019077 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-bbe7298d-a570-4133-ad48-ace412166b27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:19:16.081450 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe7298d-a570-4133-ad48-ace412166b27 admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:19:16.085976 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b773bb9b-492c-4eb4-9787-9698646f977e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '937bea4f355144b4a7ee11baabc3a4cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:19:16.086624 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b773bb9b-492c-4eb4-9787-9698646f977e service neutron] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:19:16.086899 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b773bb9b-492c-4eb4-9787-9698646f977e service neutron] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:19:16.087168 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b773bb9b-492c-4eb4-9787-9698646f977e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:19:16.096462 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b773bb9b-492c-4eb4-9787-9698646f977e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:19:16.098238 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b773bb9b-492c-4eb4-9787-9698646f977e service neutron] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:19:16.108126 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1283/2580] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:19:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 14:19:16.386508 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6583241e-4873-4614-abc3-86f9f0272d8a None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:19:16.388134 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-6583241e-4873-4614-abc3-86f9f0272d8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:19:16.401268 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6583241e-4873-4614-abc3-86f9f0272d8a None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:19:16.407179 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7c6f6e-53ee-4227-b197-c0b5bb675455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:19:16.408317 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7c6f6e-53ee-4227-b197-c0b5bb675455 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:19:16.408595 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7c6f6e-53ee-4227-b197-c0b5bb675455 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:19:16.408869 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7c6f6e-53ee-4227-b197-c0b5bb675455 admin admin] PATH_INFO: `/v3/projects/ec5f1db5f04e4c7f8a708a3eb3ffe15c` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:19:16.410256 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7c6f6e-53ee-4227-b197-c0b5bb675455 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec5f1db5f04e4c7f8a708a3eb3ffe15c)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:19:16.412211 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7c6f6e-53ee-4227-b197-c0b5bb675455 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:19:16.460552 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-1c7c6f6e-53ee-4227-b197-c0b5bb675455 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec5f1db5f04e4c7f8a708a3eb3ffe15c', 'request_id': 'req-1c7c6f6e-53ee-4227-b197-c0b5bb675455'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:19:16.465762 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-1c7c6f6e-53ee-4227-b197-c0b5bb675455 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec5f1db5f04e4c7f8a708a3eb3ffe15c', 'request_id': 'req-1c7c6f6e-53ee-4227-b197-c0b5bb675455'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:19:16.476220 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-1c7c6f6e-53ee-4227-b197-c0b5bb675455 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec5f1db5f04e4c7f8a708a3eb3ffe15c', 'request_id': 'req-1c7c6f6e-53ee-4227-b197-c0b5bb675455'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:19:16.486967 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-1c7c6f6e-53ee-4227-b197-c0b5bb675455 admin admin] The token cache is being invalidate because project ec5f1db5f04e4c7f8a708a3eb3ffe15c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80013) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 14:19:16.487246 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-1c7c6f6e-53ee-4227-b197-c0b5bb675455 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:19:16.487843 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-1c7c6f6e-53ee-4227-b197-c0b5bb675455 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:19:16.489456 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1298/2581] 10.222.0.36 () {58 vars in 1232 bytes} [Tue May 3 14:19:16 2022] DELETE /identity/v3/projects/ec5f1db5f04e4c7f8a708a3eb3ffe15c => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:19:16.493586 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b773bb9b-492c-4eb4-9787-9698646f977e service neutron] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:19:16.503263 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b773bb9b-492c-4eb4-9787-9698646f977e service neutron] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:19:16.565308 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87440553-5fbd-4575-aaf0-716036fdd3c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:19:16.566236 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87440553-5fbd-4575-aaf0-716036fdd3c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:19:16.566692 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87440553-5fbd-4575-aaf0-716036fdd3c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:19:16.566965 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87440553-5fbd-4575-aaf0-716036fdd3c2 admin admin] PATH_INFO: `/v3/users/3643cfbe48e046158d8f87511045e4b1` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:19:16.568176 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87440553-5fbd-4575-aaf0-716036fdd3c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3643cfbe48e046158d8f87511045e4b1)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:19:16.570289 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87440553-5fbd-4575-aaf0-716036fdd3c2 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:19:16.590881 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7c6f6e-53ee-4227-b197-c0b5bb675455 admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:19:16.592406 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-1c7c6f6e-53ee-4227-b197-c0b5bb675455 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:19:16.616911 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-87440553-5fbd-4575-aaf0-716036fdd3c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3643cfbe48e046158d8f87511045e4b1'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:19:16.623695 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-87440553-5fbd-4575-aaf0-716036fdd3c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3643cfbe48e046158d8f87511045e4b1'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:19:16.624348 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-87440553-5fbd-4575-aaf0-716036fdd3c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3643cfbe48e046158d8f87511045e4b1'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:19:16.635947 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-87440553-5fbd-4575-aaf0-716036fdd3c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3643cfbe48e046158d8f87511045e4b1'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:19:16.636595 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-87440553-5fbd-4575-aaf0-716036fdd3c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3643cfbe48e046158d8f87511045e4b1'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:19:16.649838 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7c6f6e-53ee-4227-b197-c0b5bb675455 admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:19:16.650742 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1284/2582] 10.222.0.36 () {58 vars in 1223 bytes} [Tue May 3 14:19:16 2022] DELETE /identity/v3/users/3643cfbe48e046158d8f87511045e4b1 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:19:16.699201 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b20443f-5075-488c-ab75-d8ca987e44cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '937bea4f355144b4a7ee11baabc3a4cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:19:16.699931 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b20443f-5075-488c-ab75-d8ca987e44cf service neutron] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:19:16.700205 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b20443f-5075-488c-ab75-d8ca987e44cf service neutron] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:19:16.700498 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b20443f-5075-488c-ab75-d8ca987e44cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:19:16.702567 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-0b20443f-5075-488c-ab75-d8ca987e44cf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:19:16.766352 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b20443f-5075-488c-ab75-d8ca987e44cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:19:16.767842 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b20443f-5075-488c-ab75-d8ca987e44cf service neutron] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:19:16.778436 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1299/2583] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:19:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 03 14:19:16.927699 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87440553-5fbd-4575-aaf0-716036fdd3c2 admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:19:16.929434 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-87440553-5fbd-4575-aaf0-716036fdd3c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:19:16.944904 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87440553-5fbd-4575-aaf0-716036fdd3c2 admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:19:16.949846 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8736a0d1-203e-4b67-9bca-ba4ddc234488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:19:16.950921 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8736a0d1-203e-4b67-9bca-ba4ddc234488 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:19:16.951241 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8736a0d1-203e-4b67-9bca-ba4ddc234488 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:19:16.951522 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8736a0d1-203e-4b67-9bca-ba4ddc234488 admin admin] PATH_INFO: `/v3/projects/4ee774b78f134793a9af372509c5ad10` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:19:16.952806 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8736a0d1-203e-4b67-9bca-ba4ddc234488 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ee774b78f134793a9af372509c5ad10)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:19:16.954764 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8736a0d1-203e-4b67-9bca-ba4ddc234488 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:19:17.005116 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-8736a0d1-203e-4b67-9bca-ba4ddc234488 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ee774b78f134793a9af372509c5ad10', 'request_id': 'req-8736a0d1-203e-4b67-9bca-ba4ddc234488'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:19:17.010979 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-8736a0d1-203e-4b67-9bca-ba4ddc234488 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ee774b78f134793a9af372509c5ad10', 'request_id': 'req-8736a0d1-203e-4b67-9bca-ba4ddc234488'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:19:17.016258 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-8736a0d1-203e-4b67-9bca-ba4ddc234488 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ee774b78f134793a9af372509c5ad10', 'request_id': 'req-8736a0d1-203e-4b67-9bca-ba4ddc234488'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:19:17.031349 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-8736a0d1-203e-4b67-9bca-ba4ddc234488 admin admin] The token cache is being invalidate because project 4ee774b78f134793a9af372509c5ad10 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80012) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 14:19:17.031639 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-8736a0d1-203e-4b67-9bca-ba4ddc234488 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:19:17.032298 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-8736a0d1-203e-4b67-9bca-ba4ddc234488 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:19:17.033886 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1285/2584] 10.222.0.36 () {58 vars in 1232 bytes} [Tue May 3 14:19:16 2022] DELETE /identity/v3/projects/4ee774b78f134793a9af372509c5ad10 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:19:17.040119 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d40b308-e8f6-405b-becb-1d4fbefcaae5 None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:19:17.040683 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d40b308-e8f6-405b-becb-1d4fbefcaae5 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:19:17.040683 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d40b308-e8f6-405b-becb-1d4fbefcaae5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:19:17.059352 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-3d40b308-e8f6-405b-becb-1d4fbefcaae5 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:19:17.060540 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-3d40b308-e8f6-405b-becb-1d4fbefcaae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:19:17.122288 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1300/2585] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:19:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:19:17.131902 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a51e57-b0a3-4869-8d01-5a1b165f7f4b None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:19:17.132343 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a51e57-b0a3-4869-8d01-5a1b165f7f4b None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:19:17.132479 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a51e57-b0a3-4869-8d01-5a1b165f7f4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:19:17.151252 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-98a51e57-b0a3-4869-8d01-5a1b165f7f4b None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:19:17.152599 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-98a51e57-b0a3-4869-8d01-5a1b165f7f4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:19:17.161651 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1286/2586] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:19:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:19:17.166085 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d40b308-e8f6-405b-becb-1d4fbefcaae5 None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:19:17.175468 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d40b308-e8f6-405b-becb-1d4fbefcaae5 None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:19:17.180264 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a439a202-3bd3-428e-a7ca-dddae123dc2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:19:17.180913 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a439a202-3bd3-428e-a7ca-dddae123dc2a admin admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:19:17.181189 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a439a202-3bd3-428e-a7ca-dddae123dc2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:19:17.181483 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a439a202-3bd3-428e-a7ca-dddae123dc2a admin admin] PATH_INFO: `/v3/domains` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:19:17.182205 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a439a202-3bd3-428e-a7ca-dddae123dc2a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:19:17.182506 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a439a202-3bd3-428e-a7ca-dddae123dc2a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:19:17.184091 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a439a202-3bd3-428e-a7ca-dddae123dc2a admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:19:17.199042 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1301/2587] 10.222.0.36 () {58 vars in 1152 bytes} [Tue May 3 14:19:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:19:17.200264 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a51e57-b0a3-4869-8d01-5a1b165f7f4b None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:19:17.209941 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a51e57-b0a3-4869-8d01-5a1b165f7f4b None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:19:17.216367 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d43f88-47f8-4dcb-bea8-658f5d7d3212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:19:17.217025 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d43f88-47f8-4dcb-bea8-658f5d7d3212 admin admin] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:19:17.217330 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d43f88-47f8-4dcb-bea8-658f5d7d3212 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:19:17.217607 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d43f88-47f8-4dcb-bea8-658f5d7d3212 admin admin] PATH_INFO: `/v3/projects` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:19:17.218294 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d43f88-47f8-4dcb-bea8-658f5d7d3212 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:19:17.220184 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d43f88-47f8-4dcb-bea8-658f5d7d3212 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:19:17.247017 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1287/2588] 10.222.0.36 () {60 vars in 1152 bytes} [Tue May 3 14:19:17 2022] POST /identity/v3/projects => generated 375 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 14:19:17.251247 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a439a202-3bd3-428e-a7ca-dddae123dc2a admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:19:17.262074 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a439a202-3bd3-428e-a7ca-dddae123dc2a admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:19:17.323891 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705d6e8b-9574-4257-94da-755f3fc01d24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:19:17.324586 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705d6e8b-9574-4257-94da-755f3fc01d24 admin admin] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:19:17.324870 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705d6e8b-9574-4257-94da-755f3fc01d24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:19:17.325146 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705d6e8b-9574-4257-94da-755f3fc01d24 admin admin] PATH_INFO: `/v3/users` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:19:17.325880 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705d6e8b-9574-4257-94da-755f3fc01d24 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:19:17.327869 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705d6e8b-9574-4257-94da-755f3fc01d24 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:19:17.353077 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1302/2589] 10.222.0.36 () {60 vars in 1143 bytes} [Tue May 3 14:19:17 2022] POST /identity/v3/users => generated 288 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 14:19:17.354591 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d43f88-47f8-4dcb-bea8-658f5d7d3212 admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:19:17.366224 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d43f88-47f8-4dcb-bea8-658f5d7d3212 admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:19:17.377852 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50c1bad-bc90-4907-bfbf-90e70a51a5d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:19:17.378642 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50c1bad-bc90-4907-bfbf-90e70a51a5d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:19:17.379112 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50c1bad-bc90-4907-bfbf-90e70a51a5d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:19:17.379431 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50c1bad-bc90-4907-bfbf-90e70a51a5d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:19:17.380476 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50c1bad-bc90-4907-bfbf-90e70a51a5d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:19:17.382766 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50c1bad-bc90-4907-bfbf-90e70a51a5d4 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:19:17.394499 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1288/2590] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 3 14:19:17 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 14:19:17.398917 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705d6e8b-9574-4257-94da-755f3fc01d24 admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:19:17.409784 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705d6e8b-9574-4257-94da-755f3fc01d24 admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:19:17.415419 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701a53e4-e83a-4945-af2f-507fb102abd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:19:17.416123 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701a53e4-e83a-4945-af2f-507fb102abd6 admin admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:19:17.416411 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701a53e4-e83a-4945-af2f-507fb102abd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:19:17.416682 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701a53e4-e83a-4945-af2f-507fb102abd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:19:17.417448 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701a53e4-e83a-4945-af2f-507fb102abd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:19:17.419063 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701a53e4-e83a-4945-af2f-507fb102abd6 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:19:17.432315 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1303/2591] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 3 14:19:17 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 14:19:17.436242 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50c1bad-bc90-4907-bfbf-90e70a51a5d4 admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:19:17.447601 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50c1bad-bc90-4907-bfbf-90e70a51a5d4 admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:19:17.452644 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70e934a-6f5b-4499-aeaf-0029a95b2b95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:19:17.453587 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70e934a-6f5b-4499-aeaf-0029a95b2b95 admin admin] REQUEST_METHOD: `PUT` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:19:17.453864 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70e934a-6f5b-4499-aeaf-0029a95b2b95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:19:17.454138 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70e934a-6f5b-4499-aeaf-0029a95b2b95 admin admin] PATH_INFO: `/v3/projects/cde3d9cdc9f14d2dab43eb60e403ec9f/users/2fcab7f923af45de8c15754532eec221/roles/441fdc11e95b47f4813f72610e39018b` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:19:17.470494 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70e934a-6f5b-4499-aeaf-0029a95b2b95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cde3d9cdc9f14d2dab43eb60e403ec9f, user_id=2fcab7f923af45de8c15754532eec221, role_id=441fdc11e95b47f4813f72610e39018b)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:19:17.473195 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70e934a-6f5b-4499-aeaf-0029a95b2b95 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:19:17.487308 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1289/2592] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 3 14:19:17 2022] PUT /identity/v3/projects/cde3d9cdc9f14d2dab43eb60e403ec9f/users/2fcab7f923af45de8c15754532eec221/roles/441fdc11e95b47f4813f72610e39018b => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:19:17.498872 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d257a88-0021-4dc4-8699-00d80c4c0f3a None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:19:17.499192 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d257a88-0021-4dc4-8699-00d80c4c0f3a None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:19:17.499459 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d257a88-0021-4dc4-8699-00d80c4c0f3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:19:17.528354 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-2d257a88-0021-4dc4-8699-00d80c4c0f3a None None] MFA Rules not processed for user `2fcab7f923af45de8c15754532eec221`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:19:17.529685 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-2d257a88-0021-4dc4-8699-00d80c4c0f3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:19:17.597570 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1304/2593] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:19:17 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:19:17.602114 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70e934a-6f5b-4499-aeaf-0029a95b2b95 admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:19:17.663234 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70e934a-6f5b-4499-aeaf-0029a95b2b95 admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:19:17.668147 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c230e672-5ebc-445a-9541-cf86a01e5c07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:19:17.668804 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c230e672-5ebc-445a-9541-cf86a01e5c07 admin admin] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:19:17.669075 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c230e672-5ebc-445a-9541-cf86a01e5c07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:19:17.669381 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c230e672-5ebc-445a-9541-cf86a01e5c07 admin admin] PATH_INFO: `/v3/projects` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:19:17.670077 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c230e672-5ebc-445a-9541-cf86a01e5c07 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:19:17.671999 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c230e672-5ebc-445a-9541-cf86a01e5c07 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:19:17.698425 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1290/2594] 10.222.0.36 () {60 vars in 1152 bytes} [Tue May 3 14:19:17 2022] POST /identity/v3/projects => generated 373 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 14:19:17.702205 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d257a88-0021-4dc4-8699-00d80c4c0f3a None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:19:17.713947 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d257a88-0021-4dc4-8699-00d80c4c0f3a None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:19:17.770157 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328baf3a-9e15-46cb-b043-ffedb35b5200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:19:17.770842 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328baf3a-9e15-46cb-b043-ffedb35b5200 admin admin] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:19:17.771121 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328baf3a-9e15-46cb-b043-ffedb35b5200 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:19:17.771401 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328baf3a-9e15-46cb-b043-ffedb35b5200 admin admin] PATH_INFO: `/v3/users` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:19:17.772081 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328baf3a-9e15-46cb-b043-ffedb35b5200 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:19:17.774050 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328baf3a-9e15-46cb-b043-ffedb35b5200 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:19:17.800239 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1305/2595] 10.222.0.36 () {60 vars in 1143 bytes} [Tue May 3 14:19:17 2022] POST /identity/v3/users => generated 293 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 14:19:17.801790 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c230e672-5ebc-445a-9541-cf86a01e5c07 admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:19:17.812253 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c230e672-5ebc-445a-9541-cf86a01e5c07 admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:19:17.817759 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018fd0e6-d2fb-431c-9806-ef75bb103c9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:19:17.818499 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018fd0e6-d2fb-431c-9806-ef75bb103c9c admin admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:19:17.818762 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018fd0e6-d2fb-431c-9806-ef75bb103c9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:19:17.819028 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018fd0e6-d2fb-431c-9806-ef75bb103c9c admin admin] PATH_INFO: `/v3/roles` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:19:17.819780 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018fd0e6-d2fb-431c-9806-ef75bb103c9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:19:17.821380 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018fd0e6-d2fb-431c-9806-ef75bb103c9c admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:19:17.833475 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1291/2596] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 3 14:19:17 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 14:19:17.838089 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328baf3a-9e15-46cb-b043-ffedb35b5200 admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:19:17.848476 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328baf3a-9e15-46cb-b043-ffedb35b5200 admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:19:17.854862 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb09343b-3361-43f6-be5e-8acb3c6d35ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:19:17.855767 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb09343b-3361-43f6-be5e-8acb3c6d35ad admin admin] REQUEST_METHOD: `PUT` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:19:17.856039 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb09343b-3361-43f6-be5e-8acb3c6d35ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:19:17.856310 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb09343b-3361-43f6-be5e-8acb3c6d35ad admin admin] PATH_INFO: `/v3/projects/75716045cb07499c93ed8de5b171e84b/users/47d7b83d18fa49d787996676c5508176/roles/36abe9b50fd8479c86c4f8f70fd85aa3` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:19:17.870782 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb09343b-3361-43f6-be5e-8acb3c6d35ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=75716045cb07499c93ed8de5b171e84b, user_id=47d7b83d18fa49d787996676c5508176, role_id=36abe9b50fd8479c86c4f8f70fd85aa3)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:19:17.873466 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb09343b-3361-43f6-be5e-8acb3c6d35ad admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:19:17.887556 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1306/2597] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 3 14:19:17 2022] PUT /identity/v3/projects/75716045cb07499c93ed8de5b171e84b/users/47d7b83d18fa49d787996676c5508176/roles/36abe9b50fd8479c86c4f8f70fd85aa3 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:19:17.891644 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018fd0e6-d2fb-431c-9806-ef75bb103c9c admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:19:17.902245 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018fd0e6-d2fb-431c-9806-ef75bb103c9c admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:19:17.963724 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a04162c-fef4-46b7-9f7d-060155fa9156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:19:17.964378 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a04162c-fef4-46b7-9f7d-060155fa9156 admin admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:19:17.964680 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a04162c-fef4-46b7-9f7d-060155fa9156 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:19:17.964970 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a04162c-fef4-46b7-9f7d-060155fa9156 admin admin] PATH_INFO: `/v3/roles` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:19:17.965698 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a04162c-fef4-46b7-9f7d-060155fa9156 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:19:17.967273 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a04162c-fef4-46b7-9f7d-060155fa9156 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:19:17.979686 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1292/2598] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 3 14:19:17 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 14:19:17.984026 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb09343b-3361-43f6-be5e-8acb3c6d35ad admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:19:18.000226 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb09343b-3361-43f6-be5e-8acb3c6d35ad admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:19:18.005357 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc902d6-6c4b-4e7f-8fe5-4a4e57dee82a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:19:18.006283 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc902d6-6c4b-4e7f-8fe5-4a4e57dee82a admin admin] REQUEST_METHOD: `PUT` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:19:18.006564 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc902d6-6c4b-4e7f-8fe5-4a4e57dee82a admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:19:18.006850 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc902d6-6c4b-4e7f-8fe5-4a4e57dee82a admin admin] PATH_INFO: `/v3/projects/75716045cb07499c93ed8de5b171e84b/users/47d7b83d18fa49d787996676c5508176/roles/36abe9b50fd8479c86c4f8f70fd85aa3` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:19:18.008928 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc902d6-6c4b-4e7f-8fe5-4a4e57dee82a admin admin] RBAC: Authorizing `identity:create_grant(project_id=75716045cb07499c93ed8de5b171e84b, user_id=47d7b83d18fa49d787996676c5508176, role_id=36abe9b50fd8479c86c4f8f70fd85aa3)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:19:18.012122 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc902d6-6c4b-4e7f-8fe5-4a4e57dee82a admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:19:18.023327 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1307/2599] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 3 14:19:17 2022] PUT /identity/v3/projects/75716045cb07499c93ed8de5b171e84b/users/47d7b83d18fa49d787996676c5508176/roles/36abe9b50fd8479c86c4f8f70fd85aa3 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 14:19:18.034078 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc28ccf2-545a-459a-9c4b-bb306a127ffe None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:19:18.034376 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc28ccf2-545a-459a-9c4b-bb306a127ffe None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:19:18.034660 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc28ccf2-545a-459a-9c4b-bb306a127ffe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:19:18.071255 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-cc28ccf2-545a-459a-9c4b-bb306a127ffe None None] MFA Rules not processed for user `47d7b83d18fa49d787996676c5508176`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:19:18.072485 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-cc28ccf2-545a-459a-9c4b-bb306a127ffe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:19:18.149746 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1293/2600] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:19:18 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:19:18.162734 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc902d6-6c4b-4e7f-8fe5-4a4e57dee82a admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:19:18.164646 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-cfc902d6-6c4b-4e7f-8fe5-4a4e57dee82a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:19:18.219468 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc902d6-6c4b-4e7f-8fe5-4a4e57dee82a admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:19:18.223472 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426e53f9-8fd6-46ee-bacd-1a90aef87b84 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b014f4c7ba1414cb8a597f5bc4033f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:19:18.224100 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426e53f9-8fd6-46ee-bacd-1a90aef87b84 service cinder] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:19:18.224379 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426e53f9-8fd6-46ee-bacd-1a90aef87b84 service cinder] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:19:18.224684 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426e53f9-8fd6-46ee-bacd-1a90aef87b84 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:19:18.278931 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426e53f9-8fd6-46ee-bacd-1a90aef87b84 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:19:18.280299 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426e53f9-8fd6-46ee-bacd-1a90aef87b84 service cinder] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:19:18.289226 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1308/2601] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:19:18 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 14:19:20.162814 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc28ccf2-545a-459a-9c4b-bb306a127ffe None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:19:20.165399 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-cc28ccf2-545a-459a-9c4b-bb306a127ffe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:19:20.235047 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc28ccf2-545a-459a-9c4b-bb306a127ffe None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:19:20.239753 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f800f319-0456-455e-9b3b-6e17cd6262e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:19:20.240663 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f800f319-0456-455e-9b3b-6e17cd6262e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:19:20.240945 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f800f319-0456-455e-9b3b-6e17cd6262e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:19:20.241221 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f800f319-0456-455e-9b3b-6e17cd6262e1 admin admin] PATH_INFO: `/v3/users/38de7546d3524382b4589def32732e6e` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:19:20.242567 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f800f319-0456-455e-9b3b-6e17cd6262e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=38de7546d3524382b4589def32732e6e)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:19:20.244515 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f800f319-0456-455e-9b3b-6e17cd6262e1 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:19:20.295986 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-f800f319-0456-455e-9b3b-6e17cd6262e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38de7546d3524382b4589def32732e6e'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:19:20.302960 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-f800f319-0456-455e-9b3b-6e17cd6262e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38de7546d3524382b4589def32732e6e'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:19:20.303655 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-f800f319-0456-455e-9b3b-6e17cd6262e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38de7546d3524382b4589def32732e6e'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:19:20.315197 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-f800f319-0456-455e-9b3b-6e17cd6262e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38de7546d3524382b4589def32732e6e'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:19:20.315832 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-f800f319-0456-455e-9b3b-6e17cd6262e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38de7546d3524382b4589def32732e6e'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:19:20.334661 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1294/2602] 10.222.0.36 () {58 vars in 1223 bytes} [Tue May 3 14:19:20 2022] DELETE /identity/v3/users/38de7546d3524382b4589def32732e6e => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 14:19:20.523933 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426e53f9-8fd6-46ee-bacd-1a90aef87b84 service cinder] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:19:20.537878 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426e53f9-8fd6-46ee-bacd-1a90aef87b84 service cinder] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:19:20.600103 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ee3329-2dbc-4776-90bb-bf310c72df89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:19:20.600981 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ee3329-2dbc-4776-90bb-bf310c72df89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:19:20.601259 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ee3329-2dbc-4776-90bb-bf310c72df89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:19:20.601566 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ee3329-2dbc-4776-90bb-bf310c72df89 admin admin] PATH_INFO: `/v3/projects/453906a2a829425aac1abdfad7b441d6` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:19:20.602774 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ee3329-2dbc-4776-90bb-bf310c72df89 admin admin] RBAC: Authorizing `identity:delete_project(project_id=453906a2a829425aac1abdfad7b441d6)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:19:20.604713 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ee3329-2dbc-4776-90bb-bf310c72df89 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:19:20.652871 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-e4ee3329-2dbc-4776-90bb-bf310c72df89 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '453906a2a829425aac1abdfad7b441d6', 'request_id': 'req-e4ee3329-2dbc-4776-90bb-bf310c72df89'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:19:20.658184 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-e4ee3329-2dbc-4776-90bb-bf310c72df89 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '453906a2a829425aac1abdfad7b441d6', 'request_id': 'req-e4ee3329-2dbc-4776-90bb-bf310c72df89'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:19:20.666485 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-e4ee3329-2dbc-4776-90bb-bf310c72df89 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '453906a2a829425aac1abdfad7b441d6', 'request_id': 'req-e4ee3329-2dbc-4776-90bb-bf310c72df89'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:19:20.678262 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-e4ee3329-2dbc-4776-90bb-bf310c72df89 admin admin] The token cache is being invalidate because project 453906a2a829425aac1abdfad7b441d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80013) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 14:19:20.678548 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-e4ee3329-2dbc-4776-90bb-bf310c72df89 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:19:20.679249 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-e4ee3329-2dbc-4776-90bb-bf310c72df89 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:19:20.680916 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1309/2603] 10.222.0.36 () {58 vars in 1232 bytes} [Tue May 3 14:19:20 2022] DELETE /identity/v3/projects/453906a2a829425aac1abdfad7b441d6 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:19:20.686065 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de6939d-2cfa-45b9-ad35-270a8871b298 None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:19:20.686693 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de6939d-2cfa-45b9-ad35-270a8871b298 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:19:20.687001 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de6939d-2cfa-45b9-ad35-270a8871b298 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:19:20.704461 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-8de6939d-2cfa-45b9-ad35-270a8871b298 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:19:20.705716 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-8de6939d-2cfa-45b9-ad35-270a8871b298 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:19:20.762599 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1295/2604] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:19:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 14:19:20.771769 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879c8c36-ce30-4290-afc4-fce62dfe5c26 None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:19:20.771960 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879c8c36-ce30-4290-afc4-fce62dfe5c26 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:19:20.772232 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879c8c36-ce30-4290-afc4-fce62dfe5c26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:19:20.795704 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-879c8c36-ce30-4290-afc4-fce62dfe5c26 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:19:20.797138 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-879c8c36-ce30-4290-afc4-fce62dfe5c26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:19:20.806327 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1310/2605] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:19:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:19:20.811167 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de6939d-2cfa-45b9-ad35-270a8871b298 None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:19:20.823460 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de6939d-2cfa-45b9-ad35-270a8871b298 None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:19:20.829228 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f8f8de-fee1-402f-9b6a-ae9946b3a450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:19:20.829916 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f8f8de-fee1-402f-9b6a-ae9946b3a450 admin admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:19:20.830202 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f8f8de-fee1-402f-9b6a-ae9946b3a450 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:19:20.830479 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f8f8de-fee1-402f-9b6a-ae9946b3a450 admin admin] PATH_INFO: `/v3/domains` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:19:20.831194 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f8f8de-fee1-402f-9b6a-ae9946b3a450 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80012) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:19:20.831504 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f8f8de-fee1-402f-9b6a-ae9946b3a450 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:19:20.833153 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f8f8de-fee1-402f-9b6a-ae9946b3a450 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:19:20.845223 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1296/2606] 10.222.0.36 () {58 vars in 1152 bytes} [Tue May 3 14:19:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:19:20.850560 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879c8c36-ce30-4290-afc4-fce62dfe5c26 None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:19:20.860329 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879c8c36-ce30-4290-afc4-fce62dfe5c26 None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:19:20.865902 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a723c36-ccd5-4af1-b176-7a2e1ecd8732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:19:20.866561 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a723c36-ccd5-4af1-b176-7a2e1ecd8732 admin admin] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:19:20.866840 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a723c36-ccd5-4af1-b176-7a2e1ecd8732 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:19:20.867120 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a723c36-ccd5-4af1-b176-7a2e1ecd8732 admin admin] PATH_INFO: `/v3/projects` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:19:20.867805 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a723c36-ccd5-4af1-b176-7a2e1ecd8732 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:19:20.869741 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a723c36-ccd5-4af1-b176-7a2e1ecd8732 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:19:20.875222 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f8f8de-fee1-402f-9b6a-ae9946b3a450 admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:19:20.877025 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-15f8f8de-fee1-402f-9b6a-ae9946b3a450 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:19:20.890273 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f8f8de-fee1-402f-9b6a-ae9946b3a450 admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:19:20.895739 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b14a05f-08e2-412e-8f02-2f5abe0e156a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:19:20.896701 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b14a05f-08e2-412e-8f02-2f5abe0e156a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:19:20.896994 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b14a05f-08e2-412e-8f02-2f5abe0e156a admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:19:20.897256 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b14a05f-08e2-412e-8f02-2f5abe0e156a admin admin] PATH_INFO: `/v3/users/2fcab7f923af45de8c15754532eec221` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:19:20.898651 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b14a05f-08e2-412e-8f02-2f5abe0e156a admin admin] RBAC: Authorizing `identity:delete_user(user_id=2fcab7f923af45de8c15754532eec221)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:19:20.900641 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b14a05f-08e2-412e-8f02-2f5abe0e156a admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:19:20.909392 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1311/2607] 10.222.0.36 () {60 vars in 1152 bytes} [Tue May 3 14:19:20 2022] POST /identity/v3/projects => generated 373 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 14:19:20.910610 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a723c36-ccd5-4af1-b176-7a2e1ecd8732 admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:19:20.947302 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-8b14a05f-08e2-412e-8f02-2f5abe0e156a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2fcab7f923af45de8c15754532eec221'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:19:20.954537 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-8b14a05f-08e2-412e-8f02-2f5abe0e156a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2fcab7f923af45de8c15754532eec221'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:19:20.955332 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-8b14a05f-08e2-412e-8f02-2f5abe0e156a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2fcab7f923af45de8c15754532eec221'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:19:20.968316 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-8b14a05f-08e2-412e-8f02-2f5abe0e156a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2fcab7f923af45de8c15754532eec221'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:19:20.969095 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-8b14a05f-08e2-412e-8f02-2f5abe0e156a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2fcab7f923af45de8c15754532eec221'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:19:20.972821 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a723c36-ccd5-4af1-b176-7a2e1ecd8732 admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:19:20.978277 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcffaa78-78cd-4eb2-a5ff-9181fd91d3b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:19:20.979144 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcffaa78-78cd-4eb2-a5ff-9181fd91d3b0 admin admin] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:19:20.979427 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcffaa78-78cd-4eb2-a5ff-9181fd91d3b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:19:20.979707 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcffaa78-78cd-4eb2-a5ff-9181fd91d3b0 admin admin] PATH_INFO: `/v3/users` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:19:20.980420 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcffaa78-78cd-4eb2-a5ff-9181fd91d3b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:19:20.981916 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1297/2608] 10.222.0.36 () {58 vars in 1223 bytes} [Tue May 3 14:19:20 2022] DELETE /identity/v3/users/2fcab7f923af45de8c15754532eec221 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:19:20.982523 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcffaa78-78cd-4eb2-a5ff-9181fd91d3b0 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:19:20.986418 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85586e71-f74b-4db7-ab64-6e6cd1f25f22 None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:19:20.986703 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85586e71-f74b-4db7-ab64-6e6cd1f25f22 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:19:20.987004 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85586e71-f74b-4db7-ab64-6e6cd1f25f22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:19:21.007736 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-85586e71-f74b-4db7-ab64-6e6cd1f25f22 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:19:21.007975 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1312/2609] 10.222.0.36 () {60 vars in 1143 bytes} [Tue May 3 14:19:20 2022] POST /identity/v3/users => generated 287 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 14:19:21.008085 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-85586e71-f74b-4db7-ab64-6e6cd1f25f22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:19:21.008749 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcffaa78-78cd-4eb2-a5ff-9181fd91d3b0 admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:19:21.010364 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-dcffaa78-78cd-4eb2-a5ff-9181fd91d3b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:19:21.022491 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcffaa78-78cd-4eb2-a5ff-9181fd91d3b0 admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:19:21.065028 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1298/2610] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:19:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 14:19:21.078242 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85586e71-f74b-4db7-ab64-6e6cd1f25f22 None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:19:21.079861 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-85586e71-f74b-4db7-ab64-6e6cd1f25f22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:19:21.085985 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fce443-c7ae-446e-b3a5-2cb02d11d87e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:19:21.086743 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fce443-c7ae-446e-b3a5-2cb02d11d87e admin admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:19:21.087021 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fce443-c7ae-446e-b3a5-2cb02d11d87e admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:19:21.087296 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fce443-c7ae-446e-b3a5-2cb02d11d87e admin admin] PATH_INFO: `/v3/roles` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:19:21.088024 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fce443-c7ae-446e-b3a5-2cb02d11d87e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:19:21.089667 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fce443-c7ae-446e-b3a5-2cb02d11d87e admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:19:21.099612 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1313/2611] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 3 14:19:21 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 14:19:21.103695 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fce443-c7ae-446e-b3a5-2cb02d11d87e admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:19:21.113692 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fce443-c7ae-446e-b3a5-2cb02d11d87e admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:19:21.118840 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921fd9d8-e429-49b4-b24d-78539168db39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:19:21.119514 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921fd9d8-e429-49b4-b24d-78539168db39 admin admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:19:21.119759 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921fd9d8-e429-49b4-b24d-78539168db39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:19:21.120167 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921fd9d8-e429-49b4-b24d-78539168db39 admin admin] PATH_INFO: `/v3/roles` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:19:21.120902 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921fd9d8-e429-49b4-b24d-78539168db39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:19:21.122526 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921fd9d8-e429-49b4-b24d-78539168db39 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:19:21.133062 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1314/2612] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 3 14:19:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 14:19:21.137406 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921fd9d8-e429-49b4-b24d-78539168db39 admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:19:21.140060 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85586e71-f74b-4db7-ab64-6e6cd1f25f22 None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:19:21.143806 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c492af88-c6d4-4e3c-8b58-5d4a1e431acb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '937bea4f355144b4a7ee11baabc3a4cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:19:21.144483 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c492af88-c6d4-4e3c-8b58-5d4a1e431acb service neutron] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:19:21.144834 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c492af88-c6d4-4e3c-8b58-5d4a1e431acb service neutron] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:19:21.145030 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c492af88-c6d4-4e3c-8b58-5d4a1e431acb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:19:21.147482 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921fd9d8-e429-49b4-b24d-78539168db39 admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:19:21.152619 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e5233e-d112-4eaa-b4f5-8b833b610f8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:19:21.153576 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e5233e-d112-4eaa-b4f5-8b833b610f8b admin admin] REQUEST_METHOD: `PUT` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:19:21.153869 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e5233e-d112-4eaa-b4f5-8b833b610f8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:19:21.154101 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e5233e-d112-4eaa-b4f5-8b833b610f8b admin admin] PATH_INFO: `/v3/projects/202929ab00d54789b81764e6729d5a62/users/bb08d6ac9ba141d08cd3f6ffd5d760c2/roles/441fdc11e95b47f4813f72610e39018b` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:19:21.154479 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c492af88-c6d4-4e3c-8b58-5d4a1e431acb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:19:21.155913 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c492af88-c6d4-4e3c-8b58-5d4a1e431acb service neutron] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:19:21.165621 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1299/2613] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:19:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 03 14:19:21.169808 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e5233e-d112-4eaa-b4f5-8b833b610f8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=202929ab00d54789b81764e6729d5a62, user_id=bb08d6ac9ba141d08cd3f6ffd5d760c2, role_id=441fdc11e95b47f4813f72610e39018b)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:19:21.172722 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e5233e-d112-4eaa-b4f5-8b833b610f8b admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:19:21.188181 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1315/2614] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 3 14:19:21 2022] PUT /identity/v3/projects/202929ab00d54789b81764e6729d5a62/users/bb08d6ac9ba141d08cd3f6ffd5d760c2/roles/441fdc11e95b47f4813f72610e39018b => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:19:21.198977 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187eb713-1d9d-4955-8343-f9dc48fceb75 None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:19:21.199405 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187eb713-1d9d-4955-8343-f9dc48fceb75 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:19:21.199764 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187eb713-1d9d-4955-8343-f9dc48fceb75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:19:21.229693 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-187eb713-1d9d-4955-8343-f9dc48fceb75 None None] MFA Rules not processed for user `bb08d6ac9ba141d08cd3f6ffd5d760c2`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:19:21.230916 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-187eb713-1d9d-4955-8343-f9dc48fceb75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:19:21.299624 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1300/2615] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:19:21 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 14:19:21.300857 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e5233e-d112-4eaa-b4f5-8b833b610f8b admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:19:21.366372 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e5233e-d112-4eaa-b4f5-8b833b610f8b admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:19:21.372333 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae5eefa-3f97-41c1-8f7a-fa319424a7a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:19:21.373014 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae5eefa-3f97-41c1-8f7a-fa319424a7a2 admin admin] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:19:21.373326 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae5eefa-3f97-41c1-8f7a-fa319424a7a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:19:21.373599 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae5eefa-3f97-41c1-8f7a-fa319424a7a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:19:21.374309 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae5eefa-3f97-41c1-8f7a-fa319424a7a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:19:21.376237 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae5eefa-3f97-41c1-8f7a-fa319424a7a2 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:19:21.407344 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1316/2616] 10.222.0.36 () {60 vars in 1152 bytes} [Tue May 3 14:19:21 2022] POST /identity/v3/projects => generated 371 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 14:19:21.408644 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187eb713-1d9d-4955-8343-f9dc48fceb75 None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:19:21.421917 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187eb713-1d9d-4955-8343-f9dc48fceb75 None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:19:21.445361 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae5eefa-3f97-41c1-8f7a-fa319424a7a2 admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:19:21.447207 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-dae5eefa-3f97-41c1-8f7a-fa319424a7a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:19:21.486699 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde6c318-4997-4225-b6f9-79c63746b7e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:19:21.487425 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde6c318-4997-4225-b6f9-79c63746b7e6 admin admin] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:19:21.487708 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde6c318-4997-4225-b6f9-79c63746b7e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:19:21.487977 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde6c318-4997-4225-b6f9-79c63746b7e6 admin admin] PATH_INFO: `/v3/users` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:19:21.489034 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde6c318-4997-4225-b6f9-79c63746b7e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:19:21.491014 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde6c318-4997-4225-b6f9-79c63746b7e6 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:19:21.517889 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1301/2617] 10.222.0.36 () {60 vars in 1143 bytes} [Tue May 3 14:19:21 2022] POST /identity/v3/users => generated 292 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 14:19:21.518925 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde6c318-4997-4225-b6f9-79c63746b7e6 admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:19:21.519677 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae5eefa-3f97-41c1-8f7a-fa319424a7a2 admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:19:21.524565 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee98a3d-d439-4c2f-a19a-fdff0e3ba2b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:19:21.525465 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee98a3d-d439-4c2f-a19a-fdff0e3ba2b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:19:21.525740 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee98a3d-d439-4c2f-a19a-fdff0e3ba2b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:19:21.526011 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee98a3d-d439-4c2f-a19a-fdff0e3ba2b3 admin admin] PATH_INFO: `/v3/projects/cde3d9cdc9f14d2dab43eb60e403ec9f` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:19:21.527198 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee98a3d-d439-4c2f-a19a-fdff0e3ba2b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cde3d9cdc9f14d2dab43eb60e403ec9f)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:19:21.528276 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde6c318-4997-4225-b6f9-79c63746b7e6 admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:19:21.529130 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee98a3d-d439-4c2f-a19a-fdff0e3ba2b3 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:19:21.534502 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e230492-ae91-400f-9149-7032bfafde68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:19:21.535255 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e230492-ae91-400f-9149-7032bfafde68 admin admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:19:21.535970 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e230492-ae91-400f-9149-7032bfafde68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:19:21.536272 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e230492-ae91-400f-9149-7032bfafde68 admin admin] PATH_INFO: `/v3/roles` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:19:21.537150 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e230492-ae91-400f-9149-7032bfafde68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:19:21.538811 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e230492-ae91-400f-9149-7032bfafde68 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:19:21.549428 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1302/2618] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 3 14:19:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 14:19:21.553779 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e230492-ae91-400f-9149-7032bfafde68 admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:19:21.564178 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e230492-ae91-400f-9149-7032bfafde68 admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:19:21.569188 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddf37c4-6901-49ae-a3fc-d5ede0fcca7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:19:21.570117 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddf37c4-6901-49ae-a3fc-d5ede0fcca7b admin admin] REQUEST_METHOD: `PUT` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:19:21.570362 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddf37c4-6901-49ae-a3fc-d5ede0fcca7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:19:21.570631 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddf37c4-6901-49ae-a3fc-d5ede0fcca7b admin admin] PATH_INFO: `/v3/projects/707ae97b1b8d448f84b10041e691338d/users/cf2f138b9f384963b113485ccf88057b/roles/36abe9b50fd8479c86c4f8f70fd85aa3` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:19:21.578822 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-6ee98a3d-d439-4c2f-a19a-fdff0e3ba2b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cde3d9cdc9f14d2dab43eb60e403ec9f', 'request_id': 'req-6ee98a3d-d439-4c2f-a19a-fdff0e3ba2b3'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:19:21.584634 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-6ee98a3d-d439-4c2f-a19a-fdff0e3ba2b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cde3d9cdc9f14d2dab43eb60e403ec9f', 'request_id': 'req-6ee98a3d-d439-4c2f-a19a-fdff0e3ba2b3'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:19:21.586321 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddf37c4-6901-49ae-a3fc-d5ede0fcca7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=707ae97b1b8d448f84b10041e691338d, user_id=cf2f138b9f384963b113485ccf88057b, role_id=36abe9b50fd8479c86c4f8f70fd85aa3)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:19:21.589003 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddf37c4-6901-49ae-a3fc-d5ede0fcca7b admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:19:21.594135 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-6ee98a3d-d439-4c2f-a19a-fdff0e3ba2b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cde3d9cdc9f14d2dab43eb60e403ec9f', 'request_id': 'req-6ee98a3d-d439-4c2f-a19a-fdff0e3ba2b3'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:19:21.603359 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1303/2619] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 3 14:19:21 2022] PUT /identity/v3/projects/707ae97b1b8d448f84b10041e691338d/users/cf2f138b9f384963b113485ccf88057b/roles/36abe9b50fd8479c86c4f8f70fd85aa3 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 14:19:21.607249 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddf37c4-6901-49ae-a3fc-d5ede0fcca7b admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:19:21.607807 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-6ee98a3d-d439-4c2f-a19a-fdff0e3ba2b3 admin admin] The token cache is being invalidate because project cde3d9cdc9f14d2dab43eb60e403ec9f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80013) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 14:19:21.608094 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-6ee98a3d-d439-4c2f-a19a-fdff0e3ba2b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:19:21.608809 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-6ee98a3d-d439-4c2f-a19a-fdff0e3ba2b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:19:21.610586 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1317/2620] 10.222.0.36 () {58 vars in 1232 bytes} [Tue May 3 14:19:21 2022] DELETE /identity/v3/projects/cde3d9cdc9f14d2dab43eb60e403ec9f => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 14:19:21.614403 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee98a3d-d439-4c2f-a19a-fdff0e3ba2b3 admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:19:21.615861 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-6ee98a3d-d439-4c2f-a19a-fdff0e3ba2b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:19:21.668628 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddf37c4-6901-49ae-a3fc-d5ede0fcca7b admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:19:21.673248 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5262b60d-94c6-4adc-9ce2-94d9f74e2dea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:19:21.673978 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5262b60d-94c6-4adc-9ce2-94d9f74e2dea admin admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:19:21.674262 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5262b60d-94c6-4adc-9ce2-94d9f74e2dea admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:19:21.674542 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5262b60d-94c6-4adc-9ce2-94d9f74e2dea admin admin] PATH_INFO: `/v3/roles` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:19:21.675323 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5262b60d-94c6-4adc-9ce2-94d9f74e2dea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:19:21.677008 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5262b60d-94c6-4adc-9ce2-94d9f74e2dea admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:19:21.678633 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee98a3d-d439-4c2f-a19a-fdff0e3ba2b3 admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:19:21.683260 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab4899a-0ca2-4a8b-9a77-3434a791b106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:19:21.684151 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab4899a-0ca2-4a8b-9a77-3434a791b106 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:19:21.684432 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab4899a-0ca2-4a8b-9a77-3434a791b106 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:19:21.684708 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab4899a-0ca2-4a8b-9a77-3434a791b106 admin admin] PATH_INFO: `/v3/users/47d7b83d18fa49d787996676c5508176` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:19:21.685963 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab4899a-0ca2-4a8b-9a77-3434a791b106 admin admin] RBAC: Authorizing `identity:delete_user(user_id=47d7b83d18fa49d787996676c5508176)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:19:21.686815 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1304/2621] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 3 14:19:21 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 14:19:21.688095 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab4899a-0ca2-4a8b-9a77-3434a791b106 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:19:21.691056 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5262b60d-94c6-4adc-9ce2-94d9f74e2dea admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:19:21.692984 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-5262b60d-94c6-4adc-9ce2-94d9f74e2dea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:19:21.705331 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5262b60d-94c6-4adc-9ce2-94d9f74e2dea admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:19:21.711301 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa78a63-0f91-4c1f-9e3e-864fe123dbf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:19:21.712187 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa78a63-0f91-4c1f-9e3e-864fe123dbf6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:19:21.712436 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa78a63-0f91-4c1f-9e3e-864fe123dbf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:19:21.712765 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa78a63-0f91-4c1f-9e3e-864fe123dbf6 admin admin] PATH_INFO: `/v3/projects/707ae97b1b8d448f84b10041e691338d/users/cf2f138b9f384963b113485ccf88057b/roles/36abe9b50fd8479c86c4f8f70fd85aa3` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:19:21.715218 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa78a63-0f91-4c1f-9e3e-864fe123dbf6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=707ae97b1b8d448f84b10041e691338d, user_id=cf2f138b9f384963b113485ccf88057b, role_id=36abe9b50fd8479c86c4f8f70fd85aa3)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:19:21.718181 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa78a63-0f91-4c1f-9e3e-864fe123dbf6 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:19:21.730272 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1305/2622] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 3 14:19:21 2022] PUT /identity/v3/projects/707ae97b1b8d448f84b10041e691338d/users/cf2f138b9f384963b113485ccf88057b/roles/36abe9b50fd8479c86c4f8f70fd85aa3 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 14:19:21.740323 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-eab4899a-0ca2-4a8b-9a77-3434a791b106 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47d7b83d18fa49d787996676c5508176'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:19:21.740577 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e353b357-d0a2-4ca4-9fa1-ab657e11fd85 None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:19:21.740868 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e353b357-d0a2-4ca4-9fa1-ab657e11fd85 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:19:21.741148 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e353b357-d0a2-4ca4-9fa1-ab657e11fd85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:19:21.747448 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-eab4899a-0ca2-4a8b-9a77-3434a791b106 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47d7b83d18fa49d787996676c5508176'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:19:21.748226 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-eab4899a-0ca2-4a8b-9a77-3434a791b106 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47d7b83d18fa49d787996676c5508176'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:19:21.756898 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-eab4899a-0ca2-4a8b-9a77-3434a791b106 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47d7b83d18fa49d787996676c5508176'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:19:21.757567 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-eab4899a-0ca2-4a8b-9a77-3434a791b106 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47d7b83d18fa49d787996676c5508176'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:19:21.769885 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-e353b357-d0a2-4ca4-9fa1-ab657e11fd85 None None] MFA Rules not processed for user `cf2f138b9f384963b113485ccf88057b`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:19:21.771209 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-e353b357-d0a2-4ca4-9fa1-ab657e11fd85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:19:21.775756 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1318/2623] 10.222.0.36 () {58 vars in 1223 bytes} [Tue May 3 14:19:21 2022] DELETE /identity/v3/users/47d7b83d18fa49d787996676c5508176 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 14:19:21.842695 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1306/2624] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:19:21 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 14:19:21.856200 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab4899a-0ca2-4a8b-9a77-3434a791b106 admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:19:21.857668 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-eab4899a-0ca2-4a8b-9a77-3434a791b106 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:19:21.916567 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab4899a-0ca2-4a8b-9a77-3434a791b106 admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:19:21.920577 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513589cd-8c9b-4403-8bd9-4848402fc1ee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b014f4c7ba1414cb8a597f5bc4033f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:19:21.921329 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513589cd-8c9b-4403-8bd9-4848402fc1ee service cinder] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:19:21.921573 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513589cd-8c9b-4403-8bd9-4848402fc1ee service cinder] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:19:21.921877 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513589cd-8c9b-4403-8bd9-4848402fc1ee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:19:21.983697 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513589cd-8c9b-4403-8bd9-4848402fc1ee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:19:21.985153 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513589cd-8c9b-4403-8bd9-4848402fc1ee service cinder] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:19:21.995355 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1319/2625] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:19:21 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 03 14:19:22.049984 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e353b357-d0a2-4ca4-9fa1-ab657e11fd85 None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:19:22.052464 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-e353b357-d0a2-4ca4-9fa1-ab657e11fd85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:19:22.079410 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513589cd-8c9b-4403-8bd9-4848402fc1ee service cinder] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:19:22.089563 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513589cd-8c9b-4403-8bd9-4848402fc1ee service cinder] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:19:22.093310 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe901e5-c69a-495d-9b68-72eb80fde66e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b014f4c7ba1414cb8a597f5bc4033f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:19:22.093902 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe901e5-c69a-495d-9b68-72eb80fde66e service cinder] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:19:22.094178 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe901e5-c69a-495d-9b68-72eb80fde66e service cinder] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:19:22.094846 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe901e5-c69a-495d-9b68-72eb80fde66e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:19:22.096332 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-efe901e5-c69a-495d-9b68-72eb80fde66e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:19:22.118439 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e353b357-d0a2-4ca4-9fa1-ab657e11fd85 None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:19:22.155346 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe901e5-c69a-495d-9b68-72eb80fde66e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:19:22.156798 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe901e5-c69a-495d-9b68-72eb80fde66e service cinder] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:19:22.166126 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1320/2626] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:19:22 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 14:19:22.172451 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d25aab-a7de-4c90-8810-db44c05f6ce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:19:22.173501 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d25aab-a7de-4c90-8810-db44c05f6ce3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:19:22.173809 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d25aab-a7de-4c90-8810-db44c05f6ce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:19:22.174083 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d25aab-a7de-4c90-8810-db44c05f6ce3 admin admin] PATH_INFO: `/v3/projects/75716045cb07499c93ed8de5b171e84b` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:19:22.175267 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d25aab-a7de-4c90-8810-db44c05f6ce3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=75716045cb07499c93ed8de5b171e84b)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:19:22.177420 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d25aab-a7de-4c90-8810-db44c05f6ce3 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:19:22.228127 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-92d25aab-a7de-4c90-8810-db44c05f6ce3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75716045cb07499c93ed8de5b171e84b', 'request_id': 'req-92d25aab-a7de-4c90-8810-db44c05f6ce3'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:19:22.234273 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-92d25aab-a7de-4c90-8810-db44c05f6ce3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75716045cb07499c93ed8de5b171e84b', 'request_id': 'req-92d25aab-a7de-4c90-8810-db44c05f6ce3'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:19:22.239972 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-92d25aab-a7de-4c90-8810-db44c05f6ce3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75716045cb07499c93ed8de5b171e84b', 'request_id': 'req-92d25aab-a7de-4c90-8810-db44c05f6ce3'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:19:22.251844 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-92d25aab-a7de-4c90-8810-db44c05f6ce3 admin admin] The token cache is being invalidate because project 75716045cb07499c93ed8de5b171e84b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80012) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 14:19:22.252098 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-92d25aab-a7de-4c90-8810-db44c05f6ce3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:19:22.252744 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-92d25aab-a7de-4c90-8810-db44c05f6ce3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:19:22.254331 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1307/2627] 10.222.0.36 () {58 vars in 1232 bytes} [Tue May 3 14:19:22 2022] DELETE /identity/v3/projects/75716045cb07499c93ed8de5b171e84b => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:19:22.263232 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c29ec49-5a7a-4422-868b-971250eb16c8 None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:19:22.263232 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c29ec49-5a7a-4422-868b-971250eb16c8 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:19:22.263232 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c29ec49-5a7a-4422-868b-971250eb16c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:19:22.282443 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-2c29ec49-5a7a-4422-868b-971250eb16c8 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:19:22.283634 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-2c29ec49-5a7a-4422-868b-971250eb16c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:19:22.344524 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1321/2628] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:19:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:19:22.406400 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336e3023-6e86-4c83-838e-2cd644ee2cca None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:19:22.406640 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336e3023-6e86-4c83-838e-2cd644ee2cca None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:19:22.406983 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336e3023-6e86-4c83-838e-2cd644ee2cca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:19:22.427713 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-336e3023-6e86-4c83-838e-2cd644ee2cca None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:19:22.428911 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-336e3023-6e86-4c83-838e-2cd644ee2cca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:19:22.438190 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1308/2629] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:19:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:19:22.442822 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c29ec49-5a7a-4422-868b-971250eb16c8 None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:19:22.452746 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c29ec49-5a7a-4422-868b-971250eb16c8 None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:19:22.458792 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2becee9-6306-4447-815a-a3e618236182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:19:22.459788 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2becee9-6306-4447-815a-a3e618236182 admin admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:19:22.460059 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2becee9-6306-4447-815a-a3e618236182 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:19:22.460326 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2becee9-6306-4447-815a-a3e618236182 admin admin] PATH_INFO: `/v3/domains` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:19:22.461043 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2becee9-6306-4447-815a-a3e618236182 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:19:22.461412 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2becee9-6306-4447-815a-a3e618236182 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:19:22.463042 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2becee9-6306-4447-815a-a3e618236182 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:19:22.475036 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1322/2630] 10.222.0.36 () {58 vars in 1152 bytes} [Tue May 3 14:19:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:19:22.481708 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336e3023-6e86-4c83-838e-2cd644ee2cca None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:19:22.495148 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336e3023-6e86-4c83-838e-2cd644ee2cca None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:19:22.501506 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15db526-af38-46a1-b77e-e27ecd5ed499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:19:22.502191 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15db526-af38-46a1-b77e-e27ecd5ed499 admin admin] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:19:22.502494 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15db526-af38-46a1-b77e-e27ecd5ed499 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:19:22.502766 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15db526-af38-46a1-b77e-e27ecd5ed499 admin admin] PATH_INFO: `/v3/projects` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:19:22.503489 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15db526-af38-46a1-b77e-e27ecd5ed499 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:19:22.505553 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15db526-af38-46a1-b77e-e27ecd5ed499 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:19:22.533254 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1309/2631] 10.222.0.36 () {60 vars in 1152 bytes} [Tue May 3 14:19:22 2022] POST /identity/v3/projects => generated 365 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 14:19:22.537785 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2becee9-6306-4447-815a-a3e618236182 admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:19:22.548963 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2becee9-6306-4447-815a-a3e618236182 admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:19:22.605862 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eeee2bd-f5fb-41f8-a2de-684e0dde9ff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:19:22.606488 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeee2bd-f5fb-41f8-a2de-684e0dde9ff8 admin admin] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:19:22.606775 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeee2bd-f5fb-41f8-a2de-684e0dde9ff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:19:22.607180 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeee2bd-f5fb-41f8-a2de-684e0dde9ff8 admin admin] PATH_INFO: `/v3/users` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:19:22.607870 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eeee2bd-f5fb-41f8-a2de-684e0dde9ff8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:19:22.609829 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eeee2bd-f5fb-41f8-a2de-684e0dde9ff8 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:19:22.630605 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1323/2632] 10.222.0.36 () {60 vars in 1143 bytes} [Tue May 3 14:19:22 2022] POST /identity/v3/users => generated 283 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 14:19:22.634785 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15db526-af38-46a1-b77e-e27ecd5ed499 admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:19:22.644973 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15db526-af38-46a1-b77e-e27ecd5ed499 admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:19:22.649741 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5faf249-204a-4b15-afc9-7edfba801e36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:19:22.650394 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5faf249-204a-4b15-afc9-7edfba801e36 admin admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:19:22.650689 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5faf249-204a-4b15-afc9-7edfba801e36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:19:22.650943 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5faf249-204a-4b15-afc9-7edfba801e36 admin admin] PATH_INFO: `/v3/roles` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:19:22.651672 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5faf249-204a-4b15-afc9-7edfba801e36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:19:22.653248 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5faf249-204a-4b15-afc9-7edfba801e36 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:19:22.663952 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1310/2633] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 3 14:19:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 14:19:22.668485 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eeee2bd-f5fb-41f8-a2de-684e0dde9ff8 admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:19:22.683689 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eeee2bd-f5fb-41f8-a2de-684e0dde9ff8 admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:19:22.689010 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9bf9f8-102c-4d70-8e04-f135f611dad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:19:22.689697 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9bf9f8-102c-4d70-8e04-f135f611dad8 admin admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:19:22.689998 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9bf9f8-102c-4d70-8e04-f135f611dad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:19:22.690244 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9bf9f8-102c-4d70-8e04-f135f611dad8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:19:22.690967 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9bf9f8-102c-4d70-8e04-f135f611dad8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:19:22.693537 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9bf9f8-102c-4d70-8e04-f135f611dad8 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:19:22.705770 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1324/2634] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 3 14:19:22 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 14:19:22.710689 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5faf249-204a-4b15-afc9-7edfba801e36 admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:19:22.720533 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5faf249-204a-4b15-afc9-7edfba801e36 admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:19:22.725451 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00566a4-ade2-447d-abfa-f3f2f4f36a3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:19:22.726455 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00566a4-ade2-447d-abfa-f3f2f4f36a3b admin admin] REQUEST_METHOD: `PUT` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:19:22.727024 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00566a4-ade2-447d-abfa-f3f2f4f36a3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:19:22.727135 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00566a4-ade2-447d-abfa-f3f2f4f36a3b admin admin] PATH_INFO: `/v3/projects/d094ea5a5aa24f42b2f292acf5ce0fa2/users/7de49b4778c24aa28a98a2e1d79e3744/roles/441fdc11e95b47f4813f72610e39018b` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:19:22.741799 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00566a4-ade2-447d-abfa-f3f2f4f36a3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d094ea5a5aa24f42b2f292acf5ce0fa2, user_id=7de49b4778c24aa28a98a2e1d79e3744, role_id=441fdc11e95b47f4813f72610e39018b)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:19:22.744458 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00566a4-ade2-447d-abfa-f3f2f4f36a3b admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:19:22.759674 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1311/2635] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 3 14:19:22 2022] PUT /identity/v3/projects/d094ea5a5aa24f42b2f292acf5ce0fa2/users/7de49b4778c24aa28a98a2e1d79e3744/roles/441fdc11e95b47f4813f72610e39018b => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:19:22.771419 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b734aadb-ddad-4820-aee3-bc37bd89c01c None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:19:22.771845 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b734aadb-ddad-4820-aee3-bc37bd89c01c None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:19:22.772294 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b734aadb-ddad-4820-aee3-bc37bd89c01c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:19:22.801496 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-b734aadb-ddad-4820-aee3-bc37bd89c01c None None] MFA Rules not processed for user `7de49b4778c24aa28a98a2e1d79e3744`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:19:22.802702 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-b734aadb-ddad-4820-aee3-bc37bd89c01c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:19:22.869047 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1325/2636] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:19:22 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:19:22.880884 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00566a4-ade2-447d-abfa-f3f2f4f36a3b admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:19:22.883911 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-b00566a4-ade2-447d-abfa-f3f2f4f36a3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:19:22.954791 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00566a4-ade2-447d-abfa-f3f2f4f36a3b admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:19:22.959024 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40979a79-8d8a-4dc0-a54f-60c2841b68ec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b014f4c7ba1414cb8a597f5bc4033f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:19:22.959998 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40979a79-8d8a-4dc0-a54f-60c2841b68ec service cinder] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:19:22.960274 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40979a79-8d8a-4dc0-a54f-60c2841b68ec service cinder] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:19:22.960636 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40979a79-8d8a-4dc0-a54f-60c2841b68ec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:19:22.969562 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40979a79-8d8a-4dc0-a54f-60c2841b68ec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:19:22.970775 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40979a79-8d8a-4dc0-a54f-60c2841b68ec service cinder] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:19:22.980528 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1312/2637] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:19:22 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 14:19:57.154441 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b734aadb-ddad-4820-aee3-bc37bd89c01c None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:19:57.155965 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-b734aadb-ddad-4820-aee3-bc37bd89c01c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:19:57.222811 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b734aadb-ddad-4820-aee3-bc37bd89c01c None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:19:57.227099 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34d673f-bafe-4ca1-b5a4-2ba5d9eeac08 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '937bea4f355144b4a7ee11baabc3a4cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:19:57.227750 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34d673f-bafe-4ca1-b5a4-2ba5d9eeac08 service neutron] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:19:57.228029 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34d673f-bafe-4ca1-b5a4-2ba5d9eeac08 service neutron] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:19:57.228298 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34d673f-bafe-4ca1-b5a4-2ba5d9eeac08 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:19:57.230289 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-a34d673f-bafe-4ca1-b5a4-2ba5d9eeac08 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:19:57.291575 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34d673f-bafe-4ca1-b5a4-2ba5d9eeac08 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:19:57.293008 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34d673f-bafe-4ca1-b5a4-2ba5d9eeac08 service neutron] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:19:57.302899 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1326/2638] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:19:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 14:20:00.580829 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40979a79-8d8a-4dc0-a54f-60c2841b68ec service cinder] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:20:00.582450 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-40979a79-8d8a-4dc0-a54f-60c2841b68ec service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:20:00.601609 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40979a79-8d8a-4dc0-a54f-60c2841b68ec service cinder] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:20:00.606531 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7eb8e8b-a105-4fed-a6fc-89a1cc64d5e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:20:00.607933 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eb8e8b-a105-4fed-a6fc-89a1cc64d5e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:20:00.608219 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eb8e8b-a105-4fed-a6fc-89a1cc64d5e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:20:00.608497 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eb8e8b-a105-4fed-a6fc-89a1cc64d5e4 admin admin] PATH_INFO: `/v3/users/93f81a3015ce4e70a69b5d91c279b37b` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:20:00.609912 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7eb8e8b-a105-4fed-a6fc-89a1cc64d5e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=93f81a3015ce4e70a69b5d91c279b37b)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:20:00.611833 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7eb8e8b-a105-4fed-a6fc-89a1cc64d5e4 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:20:00.661017 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-a7eb8e8b-a105-4fed-a6fc-89a1cc64d5e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '93f81a3015ce4e70a69b5d91c279b37b'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:20:00.668105 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-a7eb8e8b-a105-4fed-a6fc-89a1cc64d5e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '93f81a3015ce4e70a69b5d91c279b37b'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:20:00.668915 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-a7eb8e8b-a105-4fed-a6fc-89a1cc64d5e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '93f81a3015ce4e70a69b5d91c279b37b'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:20:00.684906 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-a7eb8e8b-a105-4fed-a6fc-89a1cc64d5e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '93f81a3015ce4e70a69b5d91c279b37b'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:20:00.685742 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-a7eb8e8b-a105-4fed-a6fc-89a1cc64d5e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '93f81a3015ce4e70a69b5d91c279b37b'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:20:00.702072 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1313/2639] 10.222.0.36 () {58 vars in 1223 bytes} [Tue May 3 14:20:00 2022] DELETE /identity/v3/users/93f81a3015ce4e70a69b5d91c279b37b => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:20:00.885173 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34d673f-bafe-4ca1-b5a4-2ba5d9eeac08 service neutron] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:20:00.896458 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34d673f-bafe-4ca1-b5a4-2ba5d9eeac08 service neutron] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:20:00.962547 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1935b8-d571-42d4-af6e-07f8e3f5f9dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:20:00.963669 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1935b8-d571-42d4-af6e-07f8e3f5f9dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:20:00.963814 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1935b8-d571-42d4-af6e-07f8e3f5f9dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:20:00.964073 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1935b8-d571-42d4-af6e-07f8e3f5f9dd admin admin] PATH_INFO: `/v3/projects/8a5fa41c00a84a80ac2b2c0cc1ef74d8` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:20:00.965370 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1935b8-d571-42d4-af6e-07f8e3f5f9dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a5fa41c00a84a80ac2b2c0cc1ef74d8)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:20:00.967772 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1935b8-d571-42d4-af6e-07f8e3f5f9dd admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:20:01.018553 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-0a1935b8-d571-42d4-af6e-07f8e3f5f9dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a5fa41c00a84a80ac2b2c0cc1ef74d8', 'request_id': 'req-0a1935b8-d571-42d4-af6e-07f8e3f5f9dd'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:20:01.024802 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-0a1935b8-d571-42d4-af6e-07f8e3f5f9dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a5fa41c00a84a80ac2b2c0cc1ef74d8', 'request_id': 'req-0a1935b8-d571-42d4-af6e-07f8e3f5f9dd'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:20:01.032463 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-0a1935b8-d571-42d4-af6e-07f8e3f5f9dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a5fa41c00a84a80ac2b2c0cc1ef74d8', 'request_id': 'req-0a1935b8-d571-42d4-af6e-07f8e3f5f9dd'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:20:01.043579 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-0a1935b8-d571-42d4-af6e-07f8e3f5f9dd admin admin] The token cache is being invalidate because project 8a5fa41c00a84a80ac2b2c0cc1ef74d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80013) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 14:20:01.043870 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-0a1935b8-d571-42d4-af6e-07f8e3f5f9dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:20:01.044687 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-0a1935b8-d571-42d4-af6e-07f8e3f5f9dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:20:01.046536 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1327/2640] 10.222.0.36 () {58 vars in 1232 bytes} [Tue May 3 14:20:00 2022] DELETE /identity/v3/projects/8a5fa41c00a84a80ac2b2c0cc1ef74d8 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:20:01.051484 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6b5eec-b458-4eca-8056-f9f48bc904c3 None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:20:01.051772 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6b5eec-b458-4eca-8056-f9f48bc904c3 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:20:01.052046 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6b5eec-b458-4eca-8056-f9f48bc904c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:20:01.070283 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-ec6b5eec-b458-4eca-8056-f9f48bc904c3 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:20:01.071525 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-ec6b5eec-b458-4eca-8056-f9f48bc904c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:20:01.134352 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1314/2641] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:20:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:20:01.143715 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9172114c-e17a-4384-947b-a6c66bebd5ac None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:20:01.144001 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9172114c-e17a-4384-947b-a6c66bebd5ac None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:20:01.144302 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9172114c-e17a-4384-947b-a6c66bebd5ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:20:01.162724 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-9172114c-e17a-4384-947b-a6c66bebd5ac None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:20:01.163843 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-9172114c-e17a-4384-947b-a6c66bebd5ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:20:01.172247 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1328/2642] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:20:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:20:01.176476 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6b5eec-b458-4eca-8056-f9f48bc904c3 None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:20:01.186471 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6b5eec-b458-4eca-8056-f9f48bc904c3 None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:20:01.191568 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f9836a-ba2b-4f07-a284-f2611be0035e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:20:01.192233 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f9836a-ba2b-4f07-a284-f2611be0035e admin admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:20:01.192550 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f9836a-ba2b-4f07-a284-f2611be0035e admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:20:01.192857 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f9836a-ba2b-4f07-a284-f2611be0035e admin admin] PATH_INFO: `/v3/domains` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:20:01.193640 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f9836a-ba2b-4f07-a284-f2611be0035e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80012) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:20:01.193966 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f9836a-ba2b-4f07-a284-f2611be0035e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:20:01.195601 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f9836a-ba2b-4f07-a284-f2611be0035e admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:20:01.208394 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1315/2643] 10.222.0.36 () {58 vars in 1152 bytes} [Tue May 3 14:20:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:20:01.214187 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9172114c-e17a-4384-947b-a6c66bebd5ac None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:20:01.223643 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9172114c-e17a-4384-947b-a6c66bebd5ac None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:20:01.228420 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9649278e-254a-42a1-b7f7-eeaeb448bad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:20:01.229074 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9649278e-254a-42a1-b7f7-eeaeb448bad6 admin admin] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:20:01.229386 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9649278e-254a-42a1-b7f7-eeaeb448bad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:20:01.229663 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9649278e-254a-42a1-b7f7-eeaeb448bad6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:20:01.230604 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9649278e-254a-42a1-b7f7-eeaeb448bad6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:20:01.232833 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9649278e-254a-42a1-b7f7-eeaeb448bad6 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:20:01.260451 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1329/2644] 10.222.0.36 () {60 vars in 1152 bytes} [Tue May 3 14:20:01 2022] POST /identity/v3/projects => generated 377 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 14:20:01.264894 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f9836a-ba2b-4f07-a284-f2611be0035e admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:20:01.276450 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f9836a-ba2b-4f07-a284-f2611be0035e admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:20:01.338150 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594cddf9-cb6c-4abb-bc57-03974ee200e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:20:01.338879 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594cddf9-cb6c-4abb-bc57-03974ee200e3 admin admin] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:20:01.339192 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594cddf9-cb6c-4abb-bc57-03974ee200e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:20:01.339497 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594cddf9-cb6c-4abb-bc57-03974ee200e3 admin admin] PATH_INFO: `/v3/users` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:20:01.340226 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594cddf9-cb6c-4abb-bc57-03974ee200e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:20:01.342304 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594cddf9-cb6c-4abb-bc57-03974ee200e3 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:20:01.362569 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1316/2645] 10.222.0.36 () {60 vars in 1143 bytes} [Tue May 3 14:20:01 2022] POST /identity/v3/users => generated 289 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 14:20:01.366787 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9649278e-254a-42a1-b7f7-eeaeb448bad6 admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:20:01.380490 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9649278e-254a-42a1-b7f7-eeaeb448bad6 admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:20:01.385491 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d55928-7791-48aa-9bb6-a73b4216f87c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:20:01.386154 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d55928-7791-48aa-9bb6-a73b4216f87c admin admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:20:01.386430 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d55928-7791-48aa-9bb6-a73b4216f87c admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:20:01.386703 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d55928-7791-48aa-9bb6-a73b4216f87c admin admin] PATH_INFO: `/v3/roles` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:20:01.387428 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d55928-7791-48aa-9bb6-a73b4216f87c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:20:01.389273 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d55928-7791-48aa-9bb6-a73b4216f87c admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:20:01.400065 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1330/2646] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 3 14:20:01 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 14:20:01.404581 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594cddf9-cb6c-4abb-bc57-03974ee200e3 admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:20:01.415550 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594cddf9-cb6c-4abb-bc57-03974ee200e3 admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:20:01.420703 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364190cc-a9ed-4499-85ed-aef48bc3b215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:20:01.421544 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364190cc-a9ed-4499-85ed-aef48bc3b215 admin admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:20:01.421915 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364190cc-a9ed-4499-85ed-aef48bc3b215 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:20:01.422200 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364190cc-a9ed-4499-85ed-aef48bc3b215 admin admin] PATH_INFO: `/v3/roles` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:20:01.423056 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364190cc-a9ed-4499-85ed-aef48bc3b215 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:20:01.424919 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364190cc-a9ed-4499-85ed-aef48bc3b215 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:20:01.438837 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1317/2647] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 3 14:20:01 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 14:20:01.440043 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d55928-7791-48aa-9bb6-a73b4216f87c admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:20:01.450373 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d55928-7791-48aa-9bb6-a73b4216f87c admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:20:01.455937 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d0d76d-7e7b-4e08-a534-89f43bf5d577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:20:01.456885 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d0d76d-7e7b-4e08-a534-89f43bf5d577 admin admin] REQUEST_METHOD: `PUT` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:20:01.457163 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d0d76d-7e7b-4e08-a534-89f43bf5d577 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:20:01.457479 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d0d76d-7e7b-4e08-a534-89f43bf5d577 admin admin] PATH_INFO: `/v3/projects/b16b4b1b92fd4f6dbb0e0cde810949db/users/9318e1ed873345c983c0e9fcfd89f4ce/roles/441fdc11e95b47f4813f72610e39018b` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:20:01.473777 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d0d76d-7e7b-4e08-a534-89f43bf5d577 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b16b4b1b92fd4f6dbb0e0cde810949db, user_id=9318e1ed873345c983c0e9fcfd89f4ce, role_id=441fdc11e95b47f4813f72610e39018b)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:20:01.476649 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d0d76d-7e7b-4e08-a534-89f43bf5d577 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:20:01.489868 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1331/2648] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 3 14:20:01 2022] PUT /identity/v3/projects/b16b4b1b92fd4f6dbb0e0cde810949db/users/9318e1ed873345c983c0e9fcfd89f4ce/roles/441fdc11e95b47f4813f72610e39018b => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:20:01.495033 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf841eb4-5453-451b-91ba-34e1420bf433 None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:20:01.495324 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf841eb4-5453-451b-91ba-34e1420bf433 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:20:01.495636 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf841eb4-5453-451b-91ba-34e1420bf433 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:20:01.513836 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-bf841eb4-5453-451b-91ba-34e1420bf433 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:20:01.515031 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-bf841eb4-5453-451b-91ba-34e1420bf433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:20:01.572329 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1318/2649] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:20:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:20:01.583079 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d0d76d-7e7b-4e08-a534-89f43bf5d577 admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:20:01.585270 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-13d0d76d-7e7b-4e08-a534-89f43bf5d577 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:20:01.649920 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d0d76d-7e7b-4e08-a534-89f43bf5d577 admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:20:01.654560 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ce3951-e34a-4c9b-8d29-9349a01881a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '937bea4f355144b4a7ee11baabc3a4cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:20:01.655220 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ce3951-e34a-4c9b-8d29-9349a01881a2 service neutron] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:20:01.655495 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ce3951-e34a-4c9b-8d29-9349a01881a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:20:01.655765 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ce3951-e34a-4c9b-8d29-9349a01881a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:20:01.665896 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ce3951-e34a-4c9b-8d29-9349a01881a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:20:01.667277 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ce3951-e34a-4c9b-8d29-9349a01881a2 service neutron] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:20:01.679095 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1332/2650] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:20:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 14:20:02.370411 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf841eb4-5453-451b-91ba-34e1420bf433 None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:20:02.372193 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-bf841eb4-5453-451b-91ba-34e1420bf433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:20:02.386965 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf841eb4-5453-451b-91ba-34e1420bf433 None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:20:02.392652 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e302fccd-dd03-4688-b5a7-ac0560723bc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:20:02.393587 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e302fccd-dd03-4688-b5a7-ac0560723bc4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:20:02.393871 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e302fccd-dd03-4688-b5a7-ac0560723bc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:20:02.394144 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e302fccd-dd03-4688-b5a7-ac0560723bc4 admin admin] PATH_INFO: `/v3/users/7de49b4778c24aa28a98a2e1d79e3744` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:20:02.395410 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e302fccd-dd03-4688-b5a7-ac0560723bc4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7de49b4778c24aa28a98a2e1d79e3744)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:20:02.397596 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e302fccd-dd03-4688-b5a7-ac0560723bc4 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:20:02.466969 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-e302fccd-dd03-4688-b5a7-ac0560723bc4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7de49b4778c24aa28a98a2e1d79e3744'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:20:02.477034 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-e302fccd-dd03-4688-b5a7-ac0560723bc4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7de49b4778c24aa28a98a2e1d79e3744'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:20:02.477902 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-e302fccd-dd03-4688-b5a7-ac0560723bc4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7de49b4778c24aa28a98a2e1d79e3744'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:20:02.491523 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-e302fccd-dd03-4688-b5a7-ac0560723bc4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7de49b4778c24aa28a98a2e1d79e3744'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:20:02.492221 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-e302fccd-dd03-4688-b5a7-ac0560723bc4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7de49b4778c24aa28a98a2e1d79e3744'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:20:02.515121 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1319/2651] 10.222.0.36 () {58 vars in 1223 bytes} [Tue May 3 14:20:02 2022] DELETE /identity/v3/users/7de49b4778c24aa28a98a2e1d79e3744 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:20:02.516889 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a7bd8e-5a95-40b7-be41-31af31f3c579 None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:20:02.517385 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a7bd8e-5a95-40b7-be41-31af31f3c579 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:20:02.517516 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a7bd8e-5a95-40b7-be41-31af31f3c579 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:20:02.538575 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-40a7bd8e-5a95-40b7-be41-31af31f3c579 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:20:02.539983 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-40a7bd8e-5a95-40b7-be41-31af31f3c579 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:20:02.609355 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1333/2652] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:20:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 14:20:02.621790 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e302fccd-dd03-4688-b5a7-ac0560723bc4 admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:20:02.623733 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-e302fccd-dd03-4688-b5a7-ac0560723bc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:20:02.689326 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e302fccd-dd03-4688-b5a7-ac0560723bc4 admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:20:02.694112 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cb17d0-2f40-4cc7-bd03-9cf4de471a76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '937bea4f355144b4a7ee11baabc3a4cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:20:02.694879 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cb17d0-2f40-4cc7-bd03-9cf4de471a76 service neutron] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:20:02.695421 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cb17d0-2f40-4cc7-bd03-9cf4de471a76 service neutron] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:20:02.695800 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cb17d0-2f40-4cc7-bd03-9cf4de471a76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:20:02.709582 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cb17d0-2f40-4cc7-bd03-9cf4de471a76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:20:02.711168 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cb17d0-2f40-4cc7-bd03-9cf4de471a76 service neutron] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:20:02.722873 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1320/2653] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:20:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 14:20:03.027193 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a7bd8e-5a95-40b7-be41-31af31f3c579 None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:20:03.028746 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-40a7bd8e-5a95-40b7-be41-31af31f3c579 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:20:03.042012 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a7bd8e-5a95-40b7-be41-31af31f3c579 None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:20:03.049497 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818e806a-4ec5-451c-b49f-9d4590d5e4bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:20:03.050670 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818e806a-4ec5-451c-b49f-9d4590d5e4bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:20:03.051136 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818e806a-4ec5-451c-b49f-9d4590d5e4bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:20:03.051638 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818e806a-4ec5-451c-b49f-9d4590d5e4bf admin admin] PATH_INFO: `/v3/projects/d094ea5a5aa24f42b2f292acf5ce0fa2` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:20:03.053250 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818e806a-4ec5-451c-b49f-9d4590d5e4bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=d094ea5a5aa24f42b2f292acf5ce0fa2)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:20:03.055445 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818e806a-4ec5-451c-b49f-9d4590d5e4bf admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:20:03.111810 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-818e806a-4ec5-451c-b49f-9d4590d5e4bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd094ea5a5aa24f42b2f292acf5ce0fa2', 'request_id': 'req-818e806a-4ec5-451c-b49f-9d4590d5e4bf'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:20:03.117652 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-818e806a-4ec5-451c-b49f-9d4590d5e4bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd094ea5a5aa24f42b2f292acf5ce0fa2', 'request_id': 'req-818e806a-4ec5-451c-b49f-9d4590d5e4bf'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:20:03.126531 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-818e806a-4ec5-451c-b49f-9d4590d5e4bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd094ea5a5aa24f42b2f292acf5ce0fa2', 'request_id': 'req-818e806a-4ec5-451c-b49f-9d4590d5e4bf'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:20:03.142126 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-818e806a-4ec5-451c-b49f-9d4590d5e4bf admin admin] The token cache is being invalidate because project d094ea5a5aa24f42b2f292acf5ce0fa2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80013) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 14:20:03.142567 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-818e806a-4ec5-451c-b49f-9d4590d5e4bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:20:03.143358 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-818e806a-4ec5-451c-b49f-9d4590d5e4bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:20:03.145056 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1334/2654] 10.222.0.36 () {58 vars in 1232 bytes} [Tue May 3 14:20:03 2022] DELETE /identity/v3/projects/d094ea5a5aa24f42b2f292acf5ce0fa2 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:20:03.773619 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cb17d0-2f40-4cc7-bd03-9cf4de471a76 service neutron] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:20:03.775062 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-a4cb17d0-2f40-4cc7-bd03-9cf4de471a76 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:20:03.788501 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cb17d0-2f40-4cc7-bd03-9cf4de471a76 service neutron] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:20:03.846181 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205b74f2-cee5-4494-8f82-50a4b2107c51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:20:03.847377 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205b74f2-cee5-4494-8f82-50a4b2107c51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:20:03.847838 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205b74f2-cee5-4494-8f82-50a4b2107c51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:20:03.848116 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205b74f2-cee5-4494-8f82-50a4b2107c51 admin admin] PATH_INFO: `/v3/users/bb08d6ac9ba141d08cd3f6ffd5d760c2` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:20:03.849360 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205b74f2-cee5-4494-8f82-50a4b2107c51 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb08d6ac9ba141d08cd3f6ffd5d760c2)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:20:03.851287 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205b74f2-cee5-4494-8f82-50a4b2107c51 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:20:03.904686 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-205b74f2-cee5-4494-8f82-50a4b2107c51 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb08d6ac9ba141d08cd3f6ffd5d760c2'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:20:03.912042 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-205b74f2-cee5-4494-8f82-50a4b2107c51 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb08d6ac9ba141d08cd3f6ffd5d760c2'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:20:03.912924 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-205b74f2-cee5-4494-8f82-50a4b2107c51 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb08d6ac9ba141d08cd3f6ffd5d760c2'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:20:03.926826 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-205b74f2-cee5-4494-8f82-50a4b2107c51 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb08d6ac9ba141d08cd3f6ffd5d760c2'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:20:03.927685 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-205b74f2-cee5-4494-8f82-50a4b2107c51 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb08d6ac9ba141d08cd3f6ffd5d760c2'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:20:03.945326 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1321/2655] 10.222.0.36 () {58 vars in 1223 bytes} [Tue May 3 14:20:03 2022] DELETE /identity/v3/users/bb08d6ac9ba141d08cd3f6ffd5d760c2 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:20:03.949816 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11c7218-969a-481c-bc5c-81d5b80d38da None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:20:03.950301 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11c7218-969a-481c-bc5c-81d5b80d38da None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:20:03.950301 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11c7218-969a-481c-bc5c-81d5b80d38da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:20:03.969055 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-d11c7218-969a-481c-bc5c-81d5b80d38da None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:20:03.970317 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-d11c7218-969a-481c-bc5c-81d5b80d38da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:20:04.033089 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1335/2656] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:20:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:20:04.047739 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205b74f2-cee5-4494-8f82-50a4b2107c51 admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:20:04.049168 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-205b74f2-cee5-4494-8f82-50a4b2107c51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:20:04.114770 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205b74f2-cee5-4494-8f82-50a4b2107c51 admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:20:04.119405 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa374321-7006-4cb9-aab4-4ac2a58e98dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '937bea4f355144b4a7ee11baabc3a4cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:20:04.120170 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa374321-7006-4cb9-aab4-4ac2a58e98dd service neutron] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:20:04.120452 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa374321-7006-4cb9-aab4-4ac2a58e98dd service neutron] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:20:04.120727 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa374321-7006-4cb9-aab4-4ac2a58e98dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:20:04.130790 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa374321-7006-4cb9-aab4-4ac2a58e98dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:20:04.132704 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa374321-7006-4cb9-aab4-4ac2a58e98dd service neutron] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:20:04.144846 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1322/2657] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:20:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 14:20:04.671414 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11c7218-969a-481c-bc5c-81d5b80d38da None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:20:04.672968 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-d11c7218-969a-481c-bc5c-81d5b80d38da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:20:04.695863 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11c7218-969a-481c-bc5c-81d5b80d38da None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:20:04.711063 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b824e07f-9b72-4c86-9ea2-47d3af943d4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:20:04.712329 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b824e07f-9b72-4c86-9ea2-47d3af943d4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:20:04.712937 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b824e07f-9b72-4c86-9ea2-47d3af943d4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:20:04.713225 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b824e07f-9b72-4c86-9ea2-47d3af943d4d admin admin] PATH_INFO: `/v3/projects/202929ab00d54789b81764e6729d5a62` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:20:04.715737 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b824e07f-9b72-4c86-9ea2-47d3af943d4d admin admin] RBAC: Authorizing `identity:delete_project(project_id=202929ab00d54789b81764e6729d5a62)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:20:04.719438 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b824e07f-9b72-4c86-9ea2-47d3af943d4d admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:20:04.800445 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-b824e07f-9b72-4c86-9ea2-47d3af943d4d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '202929ab00d54789b81764e6729d5a62', 'request_id': 'req-b824e07f-9b72-4c86-9ea2-47d3af943d4d'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:20:04.809199 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-b824e07f-9b72-4c86-9ea2-47d3af943d4d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '202929ab00d54789b81764e6729d5a62', 'request_id': 'req-b824e07f-9b72-4c86-9ea2-47d3af943d4d'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:20:04.820451 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-b824e07f-9b72-4c86-9ea2-47d3af943d4d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '202929ab00d54789b81764e6729d5a62', 'request_id': 'req-b824e07f-9b72-4c86-9ea2-47d3af943d4d'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:20:04.838666 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-b824e07f-9b72-4c86-9ea2-47d3af943d4d admin admin] The token cache is being invalidate because project 202929ab00d54789b81764e6729d5a62 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80013) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 14:20:04.838942 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-b824e07f-9b72-4c86-9ea2-47d3af943d4d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:20:04.841085 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-b824e07f-9b72-4c86-9ea2-47d3af943d4d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:20:04.844791 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1336/2658] 10.222.0.36 () {58 vars in 1232 bytes} [Tue May 3 14:20:04 2022] DELETE /identity/v3/projects/202929ab00d54789b81764e6729d5a62 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:20:04.848565 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa374321-7006-4cb9-aab4-4ac2a58e98dd service neutron] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:20:04.862342 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa374321-7006-4cb9-aab4-4ac2a58e98dd service neutron] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:20:04.943656 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae0135c-db3e-4b9d-99e2-02ddd33597e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:20:04.945307 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae0135c-db3e-4b9d-99e2-02ddd33597e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:20:04.945739 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae0135c-db3e-4b9d-99e2-02ddd33597e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:20:04.946216 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae0135c-db3e-4b9d-99e2-02ddd33597e3 admin admin] PATH_INFO: `/v3/users/cf2f138b9f384963b113485ccf88057b` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:20:04.947756 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae0135c-db3e-4b9d-99e2-02ddd33597e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf2f138b9f384963b113485ccf88057b)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:20:04.950548 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae0135c-db3e-4b9d-99e2-02ddd33597e3 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:20:05.015977 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-0ae0135c-db3e-4b9d-99e2-02ddd33597e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf2f138b9f384963b113485ccf88057b'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:20:05.026782 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-0ae0135c-db3e-4b9d-99e2-02ddd33597e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf2f138b9f384963b113485ccf88057b'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:20:05.027529 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-0ae0135c-db3e-4b9d-99e2-02ddd33597e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf2f138b9f384963b113485ccf88057b'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:20:05.055103 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-0ae0135c-db3e-4b9d-99e2-02ddd33597e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf2f138b9f384963b113485ccf88057b'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:20:05.056200 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-0ae0135c-db3e-4b9d-99e2-02ddd33597e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf2f138b9f384963b113485ccf88057b'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:20:05.080414 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1323/2659] 10.222.0.36 () {58 vars in 1223 bytes} [Tue May 3 14:20:04 2022] DELETE /identity/v3/users/cf2f138b9f384963b113485ccf88057b => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:20:05.493133 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b824e07f-9b72-4c86-9ea2-47d3af943d4d admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:20:05.495338 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-b824e07f-9b72-4c86-9ea2-47d3af943d4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:20:05.519305 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b824e07f-9b72-4c86-9ea2-47d3af943d4d admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:20:05.589310 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f320dbe-215e-427b-a7d5-da58a11cc0a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:20:05.590410 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f320dbe-215e-427b-a7d5-da58a11cc0a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:20:05.590979 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f320dbe-215e-427b-a7d5-da58a11cc0a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:20:05.591492 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f320dbe-215e-427b-a7d5-da58a11cc0a2 admin admin] PATH_INFO: `/v3/projects/707ae97b1b8d448f84b10041e691338d` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:20:05.593281 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f320dbe-215e-427b-a7d5-da58a11cc0a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=707ae97b1b8d448f84b10041e691338d)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:20:05.595606 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f320dbe-215e-427b-a7d5-da58a11cc0a2 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:20:05.656782 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-7f320dbe-215e-427b-a7d5-da58a11cc0a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '707ae97b1b8d448f84b10041e691338d', 'request_id': 'req-7f320dbe-215e-427b-a7d5-da58a11cc0a2'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:20:05.663844 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-7f320dbe-215e-427b-a7d5-da58a11cc0a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '707ae97b1b8d448f84b10041e691338d', 'request_id': 'req-7f320dbe-215e-427b-a7d5-da58a11cc0a2'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:20:05.677249 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-7f320dbe-215e-427b-a7d5-da58a11cc0a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '707ae97b1b8d448f84b10041e691338d', 'request_id': 'req-7f320dbe-215e-427b-a7d5-da58a11cc0a2'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:20:05.693631 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-7f320dbe-215e-427b-a7d5-da58a11cc0a2 admin admin] The token cache is being invalidate because project 707ae97b1b8d448f84b10041e691338d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80013) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 14:20:05.694334 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-7f320dbe-215e-427b-a7d5-da58a11cc0a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:20:05.695302 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-7f320dbe-215e-427b-a7d5-da58a11cc0a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:20:05.697615 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1337/2660] 10.222.0.36 () {58 vars in 1232 bytes} [Tue May 3 14:20:05 2022] DELETE /identity/v3/projects/707ae97b1b8d448f84b10041e691338d => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:20:05.703041 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29608aea-d80f-46c2-a2a1-0d8782993320 None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:20:05.703793 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29608aea-d80f-46c2-a2a1-0d8782993320 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:20:05.704282 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29608aea-d80f-46c2-a2a1-0d8782993320 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:20:05.730560 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-29608aea-d80f-46c2-a2a1-0d8782993320 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:20:05.732627 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-29608aea-d80f-46c2-a2a1-0d8782993320 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:20:05.802867 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1324/2661] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:20:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:20:05.811229 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2471bd10-1fd8-421f-89d9-3569875fd105 None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:20:05.811671 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2471bd10-1fd8-421f-89d9-3569875fd105 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:20:05.812221 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2471bd10-1fd8-421f-89d9-3569875fd105 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:20:05.844573 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-2471bd10-1fd8-421f-89d9-3569875fd105 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:20:05.846611 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-2471bd10-1fd8-421f-89d9-3569875fd105 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:20:05.860229 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1338/2662] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:20:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 14:20:05.861776 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29608aea-d80f-46c2-a2a1-0d8782993320 None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:20:05.873276 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29608aea-d80f-46c2-a2a1-0d8782993320 None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:20:05.879222 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff33570d-26e2-472f-9ab3-0d629b165056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:20:05.879907 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff33570d-26e2-472f-9ab3-0d629b165056 admin admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:20:05.880192 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff33570d-26e2-472f-9ab3-0d629b165056 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:20:05.880478 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff33570d-26e2-472f-9ab3-0d629b165056 admin admin] PATH_INFO: `/v3/domains` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:20:05.881553 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff33570d-26e2-472f-9ab3-0d629b165056 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80012) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:20:05.882141 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff33570d-26e2-472f-9ab3-0d629b165056 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:20:05.884088 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff33570d-26e2-472f-9ab3-0d629b165056 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:20:05.899474 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1325/2663] 10.222.0.36 () {58 vars in 1152 bytes} [Tue May 3 14:20:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:20:05.903513 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2471bd10-1fd8-421f-89d9-3569875fd105 None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:20:05.913544 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2471bd10-1fd8-421f-89d9-3569875fd105 None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:20:05.922568 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6407636f-c685-4821-94ae-facf8fc27386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:20:05.923328 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6407636f-c685-4821-94ae-facf8fc27386 admin admin] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:20:05.923679 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6407636f-c685-4821-94ae-facf8fc27386 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:20:05.924021 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6407636f-c685-4821-94ae-facf8fc27386 admin admin] PATH_INFO: `/v3/projects` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:20:05.924811 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6407636f-c685-4821-94ae-facf8fc27386 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:20:05.927190 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6407636f-c685-4821-94ae-facf8fc27386 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:20:05.959580 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1339/2664] 10.222.0.36 () {60 vars in 1152 bytes} [Tue May 3 14:20:05 2022] POST /identity/v3/projects => generated 367 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 14:20:05.960918 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff33570d-26e2-472f-9ab3-0d629b165056 admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:20:05.975281 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff33570d-26e2-472f-9ab3-0d629b165056 admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:20:06.033520 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a628bfd4-b3b7-4cc8-a7c2-ed1d3073fe82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:20:06.034213 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a628bfd4-b3b7-4cc8-a7c2-ed1d3073fe82 admin admin] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:20:06.034491 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a628bfd4-b3b7-4cc8-a7c2-ed1d3073fe82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:20:06.034772 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a628bfd4-b3b7-4cc8-a7c2-ed1d3073fe82 admin admin] PATH_INFO: `/v3/users` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:20:06.035464 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a628bfd4-b3b7-4cc8-a7c2-ed1d3073fe82 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:20:06.037404 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a628bfd4-b3b7-4cc8-a7c2-ed1d3073fe82 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:20:06.071942 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1326/2665] 10.222.0.36 () {60 vars in 1143 bytes} [Tue May 3 14:20:05 2022] POST /identity/v3/users => generated 284 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 14:20:06.073486 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6407636f-c685-4821-94ae-facf8fc27386 admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:20:06.093422 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6407636f-c685-4821-94ae-facf8fc27386 admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:20:06.102853 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c94d1f1-31d7-4b74-b387-a1d4d7a327a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:20:06.103697 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c94d1f1-31d7-4b74-b387-a1d4d7a327a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:20:06.104081 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c94d1f1-31d7-4b74-b387-a1d4d7a327a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:20:06.104486 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c94d1f1-31d7-4b74-b387-a1d4d7a327a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:20:06.105398 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c94d1f1-31d7-4b74-b387-a1d4d7a327a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:20:06.108271 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c94d1f1-31d7-4b74-b387-a1d4d7a327a4 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:20:06.120050 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1340/2666] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 3 14:20:06 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 14:20:06.124286 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a628bfd4-b3b7-4cc8-a7c2-ed1d3073fe82 admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:20:06.147003 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a628bfd4-b3b7-4cc8-a7c2-ed1d3073fe82 admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:20:06.156988 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db30af25-a8d7-4027-90d6-fa16069d8742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:20:06.157732 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db30af25-a8d7-4027-90d6-fa16069d8742 admin admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:20:06.158015 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db30af25-a8d7-4027-90d6-fa16069d8742 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:20:06.158296 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db30af25-a8d7-4027-90d6-fa16069d8742 admin admin] PATH_INFO: `/v3/roles` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:20:06.159037 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db30af25-a8d7-4027-90d6-fa16069d8742 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:20:06.161552 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db30af25-a8d7-4027-90d6-fa16069d8742 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:20:06.178158 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1327/2667] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 3 14:20:06 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 14:20:06.182430 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c94d1f1-31d7-4b74-b387-a1d4d7a327a4 admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:20:06.194416 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c94d1f1-31d7-4b74-b387-a1d4d7a327a4 admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:20:06.199681 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d054ac05-4f7f-4055-b0bf-428b828e40de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:20:06.200659 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d054ac05-4f7f-4055-b0bf-428b828e40de admin admin] REQUEST_METHOD: `PUT` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:20:06.201021 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d054ac05-4f7f-4055-b0bf-428b828e40de admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:20:06.201318 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d054ac05-4f7f-4055-b0bf-428b828e40de admin admin] PATH_INFO: `/v3/projects/4cfe9a4a888d4794ad97f21648dd1b6e/users/b85e69b8b7fb40dd972f1fa9705083f7/roles/441fdc11e95b47f4813f72610e39018b` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:20:06.219691 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d054ac05-4f7f-4055-b0bf-428b828e40de admin admin] RBAC: Authorizing `identity:create_grant(project_id=4cfe9a4a888d4794ad97f21648dd1b6e, user_id=b85e69b8b7fb40dd972f1fa9705083f7, role_id=441fdc11e95b47f4813f72610e39018b)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:20:06.222977 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d054ac05-4f7f-4055-b0bf-428b828e40de admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:20:06.249696 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1341/2668] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 3 14:20:06 2022] PUT /identity/v3/projects/4cfe9a4a888d4794ad97f21648dd1b6e/users/b85e69b8b7fb40dd972f1fa9705083f7/roles/441fdc11e95b47f4813f72610e39018b => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:20:06.257030 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa928da5-a16f-438e-af87-ee931f894d22 None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:20:06.257173 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa928da5-a16f-438e-af87-ee931f894d22 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:20:06.257675 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa928da5-a16f-438e-af87-ee931f894d22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:20:06.297832 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-fa928da5-a16f-438e-af87-ee931f894d22 None None] MFA Rules not processed for user `b85e69b8b7fb40dd972f1fa9705083f7`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:20:06.299114 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-fa928da5-a16f-438e-af87-ee931f894d22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:20:06.382484 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1328/2669] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:20:06 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:20:06.386927 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d054ac05-4f7f-4055-b0bf-428b828e40de admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:20:06.398344 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d02129-7c72-4778-ade1-336cd6e2b35e None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:20:06.398732 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d02129-7c72-4778-ade1-336cd6e2b35e None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:20:06.399139 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d02129-7c72-4778-ade1-336cd6e2b35e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:20:06.427732 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-a0d02129-7c72-4778-ade1-336cd6e2b35e None None] MFA Rules not processed for user `9318e1ed873345c983c0e9fcfd89f4ce`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:20:06.428952 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-a0d02129-7c72-4778-ade1-336cd6e2b35e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:20:06.468031 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d054ac05-4f7f-4055-b0bf-428b828e40de admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:20:06.474016 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de192fd1-4d69-4036-9be2-626f24d3080d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:20:06.474679 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de192fd1-4d69-4036-9be2-626f24d3080d admin admin] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:20:06.474955 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de192fd1-4d69-4036-9be2-626f24d3080d admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:20:06.475228 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de192fd1-4d69-4036-9be2-626f24d3080d admin admin] PATH_INFO: `/v3/projects` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:20:06.475942 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de192fd1-4d69-4036-9be2-626f24d3080d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:20:06.478813 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de192fd1-4d69-4036-9be2-626f24d3080d admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:20:06.508124 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1329/2670] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:20:06 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 14:20:06.513594 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1342/2671] 10.222.0.36 () {60 vars in 1152 bytes} [Tue May 3 14:20:06 2022] POST /identity/v3/projects => generated 365 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 14:20:06.519646 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d02129-7c72-4778-ade1-336cd6e2b35e None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:20:06.520386 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de192fd1-4d69-4036-9be2-626f24d3080d admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:20:06.522239 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-de192fd1-4d69-4036-9be2-626f24d3080d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:20:06.531490 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d02129-7c72-4778-ade1-336cd6e2b35e None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:20:06.615933 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2f87ca-8fd0-4131-aeee-d1a9f0999c6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:20:06.616784 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2f87ca-8fd0-4131-aeee-d1a9f0999c6f admin admin] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:20:06.617070 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2f87ca-8fd0-4131-aeee-d1a9f0999c6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:20:06.617512 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2f87ca-8fd0-4131-aeee-d1a9f0999c6f admin admin] PATH_INFO: `/v3/users` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:20:06.618553 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de192fd1-4d69-4036-9be2-626f24d3080d admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:20:06.620678 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2f87ca-8fd0-4131-aeee-d1a9f0999c6f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:20:06.622889 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2f87ca-8fd0-4131-aeee-d1a9f0999c6f admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:20:06.633322 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933db864-4e27-4a0d-86ac-c0bfdf355a9d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63489e658c094a2598a2ac62159d2fda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:20:06.633322 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933db864-4e27-4a0d-86ac-c0bfdf355a9d service nova] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:20:06.633322 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933db864-4e27-4a0d-86ac-c0bfdf355a9d service nova] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:20:06.633322 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933db864-4e27-4a0d-86ac-c0bfdf355a9d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:20:06.665893 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1330/2672] 10.222.0.36 () {60 vars in 1143 bytes} [Tue May 3 14:20:06 2022] POST /identity/v3/users => generated 289 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 14:20:06.669424 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2f87ca-8fd0-4131-aeee-d1a9f0999c6f admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:20:06.682573 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2f87ca-8fd0-4131-aeee-d1a9f0999c6f admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:20:06.690936 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c883f5f-d579-4708-8308-45e0cf4f7c4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:20:06.692211 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c883f5f-d579-4708-8308-45e0cf4f7c4b admin admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:20:06.692614 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c883f5f-d579-4708-8308-45e0cf4f7c4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:20:06.692959 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c883f5f-d579-4708-8308-45e0cf4f7c4b admin admin] PATH_INFO: `/v3/roles` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:20:06.693820 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c883f5f-d579-4708-8308-45e0cf4f7c4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:20:06.695751 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c883f5f-d579-4708-8308-45e0cf4f7c4b admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:20:06.711540 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933db864-4e27-4a0d-86ac-c0bfdf355a9d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:20:06.712283 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1331/2673] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 3 14:20:06 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 14:20:06.713388 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933db864-4e27-4a0d-86ac-c0bfdf355a9d service nova] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:20:06.713655 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c883f5f-d579-4708-8308-45e0cf4f7c4b admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:20:06.724312 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c883f5f-d579-4708-8308-45e0cf4f7c4b admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:20:06.725954 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1343/2674] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:20:06 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 03 14:20:06.730505 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56df0040-79de-4afb-9133-92d46fb90fc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:20:06.731403 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56df0040-79de-4afb-9133-92d46fb90fc6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:20:06.731683 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56df0040-79de-4afb-9133-92d46fb90fc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:20:06.732016 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56df0040-79de-4afb-9133-92d46fb90fc6 admin admin] PATH_INFO: `/v3/projects/92786e396fae414897d97d1cb7774b72/users/bc6d6819babb4b4f92b36f3f2bdc3667/roles/36abe9b50fd8479c86c4f8f70fd85aa3` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:20:06.749772 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56df0040-79de-4afb-9133-92d46fb90fc6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=92786e396fae414897d97d1cb7774b72, user_id=bc6d6819babb4b4f92b36f3f2bdc3667, role_id=36abe9b50fd8479c86c4f8f70fd85aa3)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:20:06.752467 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56df0040-79de-4afb-9133-92d46fb90fc6 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:20:06.767130 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1332/2675] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 3 14:20:06 2022] PUT /identity/v3/projects/92786e396fae414897d97d1cb7774b72/users/bc6d6819babb4b4f92b36f3f2bdc3667/roles/36abe9b50fd8479c86c4f8f70fd85aa3 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:20:06.771386 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933db864-4e27-4a0d-86ac-c0bfdf355a9d service nova] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:20:06.787316 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933db864-4e27-4a0d-86ac-c0bfdf355a9d service nova] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:20:06.855521 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdee37b-f4b5-4f00-ab9b-c4cce76ca400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:20:06.856672 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdee37b-f4b5-4f00-ab9b-c4cce76ca400 admin admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:20:06.856672 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdee37b-f4b5-4f00-ab9b-c4cce76ca400 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:20:06.857053 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdee37b-f4b5-4f00-ab9b-c4cce76ca400 admin admin] PATH_INFO: `/v3/roles` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:20:06.864133 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdee37b-f4b5-4f00-ab9b-c4cce76ca400 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:20:06.866279 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdee37b-f4b5-4f00-ab9b-c4cce76ca400 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:20:06.879336 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1344/2676] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 3 14:20:06 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 14:20:06.882619 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56df0040-79de-4afb-9133-92d46fb90fc6 admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:20:06.893540 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56df0040-79de-4afb-9133-92d46fb90fc6 admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:20:06.898373 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26386068-0f2f-46a6-a13a-c6e94cff83f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:20:06.899393 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26386068-0f2f-46a6-a13a-c6e94cff83f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:20:06.899737 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26386068-0f2f-46a6-a13a-c6e94cff83f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:20:06.900075 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26386068-0f2f-46a6-a13a-c6e94cff83f5 admin admin] PATH_INFO: `/v3/projects/92786e396fae414897d97d1cb7774b72/users/bc6d6819babb4b4f92b36f3f2bdc3667/roles/36abe9b50fd8479c86c4f8f70fd85aa3` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:20:06.902328 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26386068-0f2f-46a6-a13a-c6e94cff83f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=92786e396fae414897d97d1cb7774b72, user_id=bc6d6819babb4b4f92b36f3f2bdc3667, role_id=36abe9b50fd8479c86c4f8f70fd85aa3)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:20:06.905183 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26386068-0f2f-46a6-a13a-c6e94cff83f5 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:20:06.916528 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1333/2677] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 3 14:20:06 2022] PUT /identity/v3/projects/92786e396fae414897d97d1cb7774b72/users/bc6d6819babb4b4f92b36f3f2bdc3667/roles/36abe9b50fd8479c86c4f8f70fd85aa3 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:20:06.927515 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20993cc-a7b8-4242-a40b-a0c87b0b5c3c None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:20:06.927806 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20993cc-a7b8-4242-a40b-a0c87b0b5c3c None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:20:06.928082 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20993cc-a7b8-4242-a40b-a0c87b0b5c3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:20:06.954899 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-d20993cc-a7b8-4242-a40b-a0c87b0b5c3c None None] MFA Rules not processed for user `bc6d6819babb4b4f92b36f3f2bdc3667`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:20:06.956200 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-d20993cc-a7b8-4242-a40b-a0c87b0b5c3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:20:07.022569 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1345/2678] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:20:06 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:20:07.034502 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26386068-0f2f-46a6-a13a-c6e94cff83f5 admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:20:07.036424 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-26386068-0f2f-46a6-a13a-c6e94cff83f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:20:07.096657 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26386068-0f2f-46a6-a13a-c6e94cff83f5 admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:20:07.100482 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431c22c2-7e63-405e-9ad6-a22b49976c6a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b014f4c7ba1414cb8a597f5bc4033f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:20:07.101179 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431c22c2-7e63-405e-9ad6-a22b49976c6a service cinder] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:20:07.101511 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431c22c2-7e63-405e-9ad6-a22b49976c6a service cinder] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:20:07.101849 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431c22c2-7e63-405e-9ad6-a22b49976c6a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:20:07.111342 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431c22c2-7e63-405e-9ad6-a22b49976c6a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:20:07.112806 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431c22c2-7e63-405e-9ad6-a22b49976c6a service cinder] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:20:07.122777 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1334/2679] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:20:07 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 14:20:07.209971 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20993cc-a7b8-4242-a40b-a0c87b0b5c3c None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:20:07.226507 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20993cc-a7b8-4242-a40b-a0c87b0b5c3c None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:20:07.230573 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfa5286-7905-468a-b0cd-142f775494b9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b014f4c7ba1414cb8a597f5bc4033f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:20:07.231377 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfa5286-7905-468a-b0cd-142f775494b9 service cinder] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:20:07.231753 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfa5286-7905-468a-b0cd-142f775494b9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:20:07.232556 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfa5286-7905-468a-b0cd-142f775494b9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:20:07.291455 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfa5286-7905-468a-b0cd-142f775494b9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:20:07.292901 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfa5286-7905-468a-b0cd-142f775494b9 service cinder] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:20:07.302830 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1346/2680] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:20:07 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 14:20:08.471908 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6514fbe1-e92d-451c-932e-cf28a00a7853 None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:20:08.472439 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6514fbe1-e92d-451c-932e-cf28a00a7853 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:20:08.472439 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6514fbe1-e92d-451c-932e-cf28a00a7853 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:20:08.491993 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-6514fbe1-e92d-451c-932e-cf28a00a7853 None None] MFA Rules not processed for user `9318e1ed873345c983c0e9fcfd89f4ce`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:20:08.493209 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-6514fbe1-e92d-451c-932e-cf28a00a7853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:20:08.568128 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1335/2681] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:20:08 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 14:20:09.778199 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfa5286-7905-468a-b0cd-142f775494b9 service cinder] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:20:09.779961 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-9cfa5286-7905-468a-b0cd-142f775494b9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:20:09.795869 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfa5286-7905-468a-b0cd-142f775494b9 service cinder] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:20:09.802645 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8b9da2-3b05-4054-85eb-aca5e8a7cd07 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b014f4c7ba1414cb8a597f5bc4033f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:20:09.803707 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8b9da2-3b05-4054-85eb-aca5e8a7cd07 service cinder] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:20:09.804134 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8b9da2-3b05-4054-85eb-aca5e8a7cd07 service cinder] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:20:09.804698 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8b9da2-3b05-4054-85eb-aca5e8a7cd07 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:20:09.808319 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-9a8b9da2-3b05-4054-85eb-aca5e8a7cd07 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:20:09.886109 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8b9da2-3b05-4054-85eb-aca5e8a7cd07 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:20:09.887599 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8b9da2-3b05-4054-85eb-aca5e8a7cd07 service cinder] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:20:09.900369 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1347/2682] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:20:09 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 14:20:13.365525 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6514fbe1-e92d-451c-932e-cf28a00a7853 None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:20:13.452876 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6514fbe1-e92d-451c-932e-cf28a00a7853 None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:20:13.460382 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3690d68-2bfb-46db-92bc-fd7ccf0a1dc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:20:13.461441 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3690d68-2bfb-46db-92bc-fd7ccf0a1dc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:20:13.461734 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3690d68-2bfb-46db-92bc-fd7ccf0a1dc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:20:13.462098 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3690d68-2bfb-46db-92bc-fd7ccf0a1dc6 admin admin] PATH_INFO: `/v3/users/b85e69b8b7fb40dd972f1fa9705083f7` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:20:13.463578 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3690d68-2bfb-46db-92bc-fd7ccf0a1dc6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b85e69b8b7fb40dd972f1fa9705083f7)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:20:13.465884 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3690d68-2bfb-46db-92bc-fd7ccf0a1dc6 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:20:13.527645 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-f3690d68-2bfb-46db-92bc-fd7ccf0a1dc6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b85e69b8b7fb40dd972f1fa9705083f7'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:20:13.536466 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-f3690d68-2bfb-46db-92bc-fd7ccf0a1dc6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b85e69b8b7fb40dd972f1fa9705083f7'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:20:13.537184 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-f3690d68-2bfb-46db-92bc-fd7ccf0a1dc6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b85e69b8b7fb40dd972f1fa9705083f7'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:20:13.549423 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-f3690d68-2bfb-46db-92bc-fd7ccf0a1dc6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b85e69b8b7fb40dd972f1fa9705083f7'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:20:13.550329 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-f3690d68-2bfb-46db-92bc-fd7ccf0a1dc6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b85e69b8b7fb40dd972f1fa9705083f7'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:20:13.579583 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1336/2683] 10.222.0.36 () {58 vars in 1223 bytes} [Tue May 3 14:20:13 2022] DELETE /identity/v3/users/b85e69b8b7fb40dd972f1fa9705083f7 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:20:13.584284 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3221ac49-1ce5-4534-b292-930568f32789 None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:20:13.584787 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3221ac49-1ce5-4534-b292-930568f32789 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:20:13.584787 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3221ac49-1ce5-4534-b292-930568f32789 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:20:13.605503 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-3221ac49-1ce5-4534-b292-930568f32789 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:20:13.606764 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-3221ac49-1ce5-4534-b292-930568f32789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:20:13.672557 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1348/2684] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:20:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 14:20:13.682361 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3690d68-2bfb-46db-92bc-fd7ccf0a1dc6 admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:20:13.684270 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-f3690d68-2bfb-46db-92bc-fd7ccf0a1dc6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:20:13.771512 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3690d68-2bfb-46db-92bc-fd7ccf0a1dc6 admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:20:13.775542 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dc5028-c005-430f-a318-59d801a8fed5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '937bea4f355144b4a7ee11baabc3a4cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:20:13.776236 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dc5028-c005-430f-a318-59d801a8fed5 service neutron] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:20:13.776515 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dc5028-c005-430f-a318-59d801a8fed5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:20:13.776792 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dc5028-c005-430f-a318-59d801a8fed5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:20:13.789782 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dc5028-c005-430f-a318-59d801a8fed5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:20:13.791210 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dc5028-c005-430f-a318-59d801a8fed5 service neutron] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:20:13.803117 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1337/2685] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:20:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 14:20:14.269717 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3221ac49-1ce5-4534-b292-930568f32789 None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:20:14.272000 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-3221ac49-1ce5-4534-b292-930568f32789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:20:14.286259 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3221ac49-1ce5-4534-b292-930568f32789 None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:20:14.292212 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaca8a8d-9854-4545-b3e5-3227fa0084cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:20:14.303669 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaca8a8d-9854-4545-b3e5-3227fa0084cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:20:14.304051 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaca8a8d-9854-4545-b3e5-3227fa0084cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:20:14.304245 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaca8a8d-9854-4545-b3e5-3227fa0084cc admin admin] PATH_INFO: `/v3/projects/4cfe9a4a888d4794ad97f21648dd1b6e` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:20:14.306497 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaca8a8d-9854-4545-b3e5-3227fa0084cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=4cfe9a4a888d4794ad97f21648dd1b6e)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:20:14.308720 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaca8a8d-9854-4545-b3e5-3227fa0084cc admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:20:14.382488 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-aaca8a8d-9854-4545-b3e5-3227fa0084cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4cfe9a4a888d4794ad97f21648dd1b6e', 'request_id': 'req-aaca8a8d-9854-4545-b3e5-3227fa0084cc'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:20:14.393473 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-aaca8a8d-9854-4545-b3e5-3227fa0084cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4cfe9a4a888d4794ad97f21648dd1b6e', 'request_id': 'req-aaca8a8d-9854-4545-b3e5-3227fa0084cc'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:20:14.399350 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-aaca8a8d-9854-4545-b3e5-3227fa0084cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4cfe9a4a888d4794ad97f21648dd1b6e', 'request_id': 'req-aaca8a8d-9854-4545-b3e5-3227fa0084cc'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:20:14.412781 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-aaca8a8d-9854-4545-b3e5-3227fa0084cc admin admin] The token cache is being invalidate because project 4cfe9a4a888d4794ad97f21648dd1b6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80013) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 14:20:14.413160 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-aaca8a8d-9854-4545-b3e5-3227fa0084cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:20:14.414259 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-aaca8a8d-9854-4545-b3e5-3227fa0084cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:20:14.416240 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1349/2686] 10.222.0.36 () {58 vars in 1232 bytes} [Tue May 3 14:20:14 2022] DELETE /identity/v3/projects/4cfe9a4a888d4794ad97f21648dd1b6e => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:20:14.420398 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dc5028-c005-430f-a318-59d801a8fed5 service neutron] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:20:14.430871 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dc5028-c005-430f-a318-59d801a8fed5 service neutron] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:20:14.496704 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0154f888-90c3-4524-8bcb-07e961b50397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:20:14.497768 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0154f888-90c3-4524-8bcb-07e961b50397 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:20:14.498050 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0154f888-90c3-4524-8bcb-07e961b50397 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:20:14.498322 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0154f888-90c3-4524-8bcb-07e961b50397 admin admin] PATH_INFO: `/v3/users/bc6d6819babb4b4f92b36f3f2bdc3667` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:20:14.499740 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0154f888-90c3-4524-8bcb-07e961b50397 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc6d6819babb4b4f92b36f3f2bdc3667)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:20:14.501742 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0154f888-90c3-4524-8bcb-07e961b50397 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:20:14.554518 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-0154f888-90c3-4524-8bcb-07e961b50397 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc6d6819babb4b4f92b36f3f2bdc3667'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:20:14.561398 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-0154f888-90c3-4524-8bcb-07e961b50397 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc6d6819babb4b4f92b36f3f2bdc3667'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:20:14.562203 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-0154f888-90c3-4524-8bcb-07e961b50397 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc6d6819babb4b4f92b36f3f2bdc3667'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:20:14.584849 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-0154f888-90c3-4524-8bcb-07e961b50397 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc6d6819babb4b4f92b36f3f2bdc3667'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:20:14.586441 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-0154f888-90c3-4524-8bcb-07e961b50397 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc6d6819babb4b4f92b36f3f2bdc3667'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:20:14.616660 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1338/2687] 10.222.0.36 () {58 vars in 1223 bytes} [Tue May 3 14:20:14 2022] DELETE /identity/v3/users/bc6d6819babb4b4f92b36f3f2bdc3667 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:20:14.926123 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaca8a8d-9854-4545-b3e5-3227fa0084cc admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:20:14.927619 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-aaca8a8d-9854-4545-b3e5-3227fa0084cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:20:14.941891 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaca8a8d-9854-4545-b3e5-3227fa0084cc admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:20:15.000829 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6215e0-686b-4066-b02d-cd46cc47b544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:20:15.001742 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6215e0-686b-4066-b02d-cd46cc47b544 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:20:15.002023 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6215e0-686b-4066-b02d-cd46cc47b544 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:20:15.002297 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6215e0-686b-4066-b02d-cd46cc47b544 admin admin] PATH_INFO: `/v3/projects/92786e396fae414897d97d1cb7774b72` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:20:15.003544 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6215e0-686b-4066-b02d-cd46cc47b544 admin admin] RBAC: Authorizing `identity:delete_project(project_id=92786e396fae414897d97d1cb7774b72)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:20:15.005964 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6215e0-686b-4066-b02d-cd46cc47b544 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:20:15.054846 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-4b6215e0-686b-4066-b02d-cd46cc47b544 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92786e396fae414897d97d1cb7774b72', 'request_id': 'req-4b6215e0-686b-4066-b02d-cd46cc47b544'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:20:15.060222 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-4b6215e0-686b-4066-b02d-cd46cc47b544 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92786e396fae414897d97d1cb7774b72', 'request_id': 'req-4b6215e0-686b-4066-b02d-cd46cc47b544'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:20:15.070586 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-4b6215e0-686b-4066-b02d-cd46cc47b544 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92786e396fae414897d97d1cb7774b72', 'request_id': 'req-4b6215e0-686b-4066-b02d-cd46cc47b544'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:20:15.082372 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-4b6215e0-686b-4066-b02d-cd46cc47b544 admin admin] The token cache is being invalidate because project 92786e396fae414897d97d1cb7774b72 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80013) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 14:20:15.082819 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-4b6215e0-686b-4066-b02d-cd46cc47b544 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:20:15.083554 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-4b6215e0-686b-4066-b02d-cd46cc47b544 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:20:15.085713 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1350/2688] 10.222.0.36 () {58 vars in 1232 bytes} [Tue May 3 14:20:14 2022] DELETE /identity/v3/projects/92786e396fae414897d97d1cb7774b72 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:20:15.090645 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe04ce0-4c0b-463b-9d13-2abaa6a2c4cc None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:20:15.090999 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe04ce0-4c0b-463b-9d13-2abaa6a2c4cc None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:20:15.091285 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe04ce0-4c0b-463b-9d13-2abaa6a2c4cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:20:15.108398 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-2fe04ce0-4c0b-463b-9d13-2abaa6a2c4cc None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:20:15.109647 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-2fe04ce0-4c0b-463b-9d13-2abaa6a2c4cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:20:15.171139 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1339/2689] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:20:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:20:15.179647 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad717446-66b6-494c-91b8-afbf612f6cd5 None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:20:15.179948 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad717446-66b6-494c-91b8-afbf612f6cd5 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:20:15.180224 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad717446-66b6-494c-91b8-afbf612f6cd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:20:15.198606 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-ad717446-66b6-494c-91b8-afbf612f6cd5 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:20:15.199801 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-ad717446-66b6-494c-91b8-afbf612f6cd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:20:15.208230 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1351/2690] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:20:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:20:15.212785 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe04ce0-4c0b-463b-9d13-2abaa6a2c4cc None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:20:15.222673 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe04ce0-4c0b-463b-9d13-2abaa6a2c4cc None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:20:15.227677 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f4006f-02a5-407b-aba3-e25f5f6988f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:20:15.228370 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f4006f-02a5-407b-aba3-e25f5f6988f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:20:15.228651 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f4006f-02a5-407b-aba3-e25f5f6988f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:20:15.228922 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f4006f-02a5-407b-aba3-e25f5f6988f4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:20:15.229745 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f4006f-02a5-407b-aba3-e25f5f6988f4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80012) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:20:15.230047 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f4006f-02a5-407b-aba3-e25f5f6988f4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:20:15.231634 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f4006f-02a5-407b-aba3-e25f5f6988f4 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:20:15.242881 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1340/2691] 10.222.0.36 () {58 vars in 1152 bytes} [Tue May 3 14:20:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:20:15.247213 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad717446-66b6-494c-91b8-afbf612f6cd5 None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:20:15.256617 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad717446-66b6-494c-91b8-afbf612f6cd5 None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:20:15.262828 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf87703-7441-46d3-bde3-655a391c2c29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:20:15.263504 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf87703-7441-46d3-bde3-655a391c2c29 admin admin] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:20:15.263781 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf87703-7441-46d3-bde3-655a391c2c29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:20:15.264052 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf87703-7441-46d3-bde3-655a391c2c29 admin admin] PATH_INFO: `/v3/projects` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:20:15.264747 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf87703-7441-46d3-bde3-655a391c2c29 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:20:15.266877 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf87703-7441-46d3-bde3-655a391c2c29 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:20:15.296690 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1352/2692] 10.222.0.36 () {60 vars in 1152 bytes} [Tue May 3 14:20:15 2022] POST /identity/v3/projects => generated 371 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 14:20:15.301134 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f4006f-02a5-407b-aba3-e25f5f6988f4 admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:20:15.311530 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f4006f-02a5-407b-aba3-e25f5f6988f4 admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:20:15.369930 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482b1ad0-fe7e-42f8-8aac-4ff1c3257c64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:20:15.370591 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482b1ad0-fe7e-42f8-8aac-4ff1c3257c64 admin admin] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:20:15.370876 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482b1ad0-fe7e-42f8-8aac-4ff1c3257c64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:20:15.371148 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482b1ad0-fe7e-42f8-8aac-4ff1c3257c64 admin admin] PATH_INFO: `/v3/users` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:20:15.371848 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482b1ad0-fe7e-42f8-8aac-4ff1c3257c64 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:20:15.373788 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482b1ad0-fe7e-42f8-8aac-4ff1c3257c64 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:20:15.395922 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1341/2693] 10.222.0.36 () {60 vars in 1143 bytes} [Tue May 3 14:20:15 2022] POST /identity/v3/users => generated 286 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 14:20:15.400543 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf87703-7441-46d3-bde3-655a391c2c29 admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:20:15.411071 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf87703-7441-46d3-bde3-655a391c2c29 admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:20:15.417692 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78cbc07-417a-4e6a-8273-a9dc3aec85f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:20:15.418413 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78cbc07-417a-4e6a-8273-a9dc3aec85f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:20:15.418638 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78cbc07-417a-4e6a-8273-a9dc3aec85f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:20:15.418915 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78cbc07-417a-4e6a-8273-a9dc3aec85f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:20:15.419644 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78cbc07-417a-4e6a-8273-a9dc3aec85f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:20:15.421969 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78cbc07-417a-4e6a-8273-a9dc3aec85f5 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:20:15.432739 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1353/2694] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 3 14:20:15 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 14:20:15.437823 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482b1ad0-fe7e-42f8-8aac-4ff1c3257c64 admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:20:15.448040 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482b1ad0-fe7e-42f8-8aac-4ff1c3257c64 admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:20:15.453513 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9594fe54-ed65-4c12-879c-c47e9e52c43e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:20:15.454212 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9594fe54-ed65-4c12-879c-c47e9e52c43e admin admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:20:15.454519 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9594fe54-ed65-4c12-879c-c47e9e52c43e admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:20:15.454798 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9594fe54-ed65-4c12-879c-c47e9e52c43e admin admin] PATH_INFO: `/v3/roles` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:20:15.455525 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9594fe54-ed65-4c12-879c-c47e9e52c43e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:20:15.457168 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9594fe54-ed65-4c12-879c-c47e9e52c43e admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:20:15.469110 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1342/2695] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 3 14:20:15 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 14:20:15.473382 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78cbc07-417a-4e6a-8273-a9dc3aec85f5 admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:20:15.483529 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78cbc07-417a-4e6a-8273-a9dc3aec85f5 admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:20:15.488997 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce886d26-53d6-48f2-a7f2-7ce26a6d5960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:20:15.489946 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce886d26-53d6-48f2-a7f2-7ce26a6d5960 admin admin] REQUEST_METHOD: `PUT` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:20:15.490227 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce886d26-53d6-48f2-a7f2-7ce26a6d5960 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:20:15.490495 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce886d26-53d6-48f2-a7f2-7ce26a6d5960 admin admin] PATH_INFO: `/v3/projects/dbf0933f9a42479d8e1228b2c5ca7631/users/844b50c8ae454c5c8f3eb42d990c0a45/roles/441fdc11e95b47f4813f72610e39018b` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:20:15.506817 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce886d26-53d6-48f2-a7f2-7ce26a6d5960 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dbf0933f9a42479d8e1228b2c5ca7631, user_id=844b50c8ae454c5c8f3eb42d990c0a45, role_id=441fdc11e95b47f4813f72610e39018b)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:20:15.509630 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce886d26-53d6-48f2-a7f2-7ce26a6d5960 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:20:15.523447 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1354/2696] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 3 14:20:15 2022] PUT /identity/v3/projects/dbf0933f9a42479d8e1228b2c5ca7631/users/844b50c8ae454c5c8f3eb42d990c0a45/roles/441fdc11e95b47f4813f72610e39018b => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:20:15.528739 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911a4ff1-cba4-4e10-af83-df90f29d7c8f None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:20:15.529029 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911a4ff1-cba4-4e10-af83-df90f29d7c8f None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:20:15.529322 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911a4ff1-cba4-4e10-af83-df90f29d7c8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:20:15.549994 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-911a4ff1-cba4-4e10-af83-df90f29d7c8f None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:20:15.551407 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-911a4ff1-cba4-4e10-af83-df90f29d7c8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:20:15.616919 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1343/2697] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:20:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:20:15.627278 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce886d26-53d6-48f2-a7f2-7ce26a6d5960 admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:20:15.629253 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-ce886d26-53d6-48f2-a7f2-7ce26a6d5960 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:20:15.692444 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce886d26-53d6-48f2-a7f2-7ce26a6d5960 admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:20:15.696821 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65a275c-2311-4394-a332-722dfdd29e28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '937bea4f355144b4a7ee11baabc3a4cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:20:15.697515 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65a275c-2311-4394-a332-722dfdd29e28 service neutron] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:20:15.697805 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65a275c-2311-4394-a332-722dfdd29e28 service neutron] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:20:15.698066 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65a275c-2311-4394-a332-722dfdd29e28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:20:15.709851 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65a275c-2311-4394-a332-722dfdd29e28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:20:15.711324 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65a275c-2311-4394-a332-722dfdd29e28 service neutron] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:20:15.722146 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1355/2698] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:20:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 14:20:15.815542 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b418cba-f84b-4f6c-a943-60dd20c71f04 None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:20:15.815848 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b418cba-f84b-4f6c-a943-60dd20c71f04 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:20:15.816156 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b418cba-f84b-4f6c-a943-60dd20c71f04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:20:15.834462 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-4b418cba-f84b-4f6c-a943-60dd20c71f04 None None] MFA Rules not processed for user `7b05c6d36153485c9859ce7b749ab40c`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:20:15.835476 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-4b418cba-f84b-4f6c-a943-60dd20c71f04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:20:15.894721 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1344/2699] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:20:15 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 14:20:16.363721 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d73c598-9e8f-4268-938f-7263cb817481 None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:20:16.364269 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d73c598-9e8f-4268-938f-7263cb817481 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:20:16.364269 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d73c598-9e8f-4268-938f-7263cb817481 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:20:16.392423 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-9d73c598-9e8f-4268-938f-7263cb817481 None None] MFA Rules not processed for user `844b50c8ae454c5c8f3eb42d990c0a45`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:20:16.394036 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-9d73c598-9e8f-4268-938f-7263cb817481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:20:16.465760 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1356/2700] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:20:16 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 14:20:16.466941 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b418cba-f84b-4f6c-a943-60dd20c71f04 None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:20:16.478943 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b418cba-f84b-4f6c-a943-60dd20c71f04 None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:20:16.483286 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eafe018-ab75-43eb-978d-7c8e742bce0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:20:16.483988 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eafe018-ab75-43eb-978d-7c8e742bce0a admin admin] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:20:16.484522 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eafe018-ab75-43eb-978d-7c8e742bce0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:20:16.484821 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eafe018-ab75-43eb-978d-7c8e742bce0a admin admin] PATH_INFO: `/v3/projects` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:20:16.485845 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eafe018-ab75-43eb-978d-7c8e742bce0a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:20:16.487938 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eafe018-ab75-43eb-978d-7c8e742bce0a admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:20:16.518754 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1345/2701] 10.222.0.36 () {60 vars in 1152 bytes} [Tue May 3 14:20:16 2022] POST /identity/v3/projects => generated 373 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 14:20:16.520614 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d73c598-9e8f-4268-938f-7263cb817481 None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:20:16.534632 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d73c598-9e8f-4268-938f-7263cb817481 None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:20:16.598947 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b71b77a-23be-4cd6-9b01-96fa69a78c51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:20:16.599723 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b71b77a-23be-4cd6-9b01-96fa69a78c51 admin admin] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:20:16.600073 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b71b77a-23be-4cd6-9b01-96fa69a78c51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:20:16.600419 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b71b77a-23be-4cd6-9b01-96fa69a78c51 admin admin] PATH_INFO: `/v3/users` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:20:16.601211 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b71b77a-23be-4cd6-9b01-96fa69a78c51 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:20:16.603347 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b71b77a-23be-4cd6-9b01-96fa69a78c51 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:20:16.626591 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1357/2702] 10.222.0.36 () {60 vars in 1143 bytes} [Tue May 3 14:20:16 2022] POST /identity/v3/users => generated 293 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 14:20:16.630584 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eafe018-ab75-43eb-978d-7c8e742bce0a admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:20:16.642229 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eafe018-ab75-43eb-978d-7c8e742bce0a admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:20:16.647335 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd541a09-9ffd-4b1a-8f98-59c1a0054eb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:20:16.648233 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd541a09-9ffd-4b1a-8f98-59c1a0054eb2 admin admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:20:16.648588 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd541a09-9ffd-4b1a-8f98-59c1a0054eb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:20:16.648899 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd541a09-9ffd-4b1a-8f98-59c1a0054eb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:20:16.649807 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd541a09-9ffd-4b1a-8f98-59c1a0054eb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:20:16.651447 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd541a09-9ffd-4b1a-8f98-59c1a0054eb2 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:20:16.665023 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1346/2703] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 3 14:20:16 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 14:20:16.669194 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b71b77a-23be-4cd6-9b01-96fa69a78c51 admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:20:16.680665 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b71b77a-23be-4cd6-9b01-96fa69a78c51 admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:20:16.685868 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a71f1b4-6a1f-4e81-84d4-f0d11686c11b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:20:16.687415 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a71f1b4-6a1f-4e81-84d4-f0d11686c11b admin admin] REQUEST_METHOD: `PUT` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:20:16.687827 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a71f1b4-6a1f-4e81-84d4-f0d11686c11b admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:20:16.688203 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a71f1b4-6a1f-4e81-84d4-f0d11686c11b admin admin] PATH_INFO: `/v3/projects/a9f451e97cea4eb0ac113f4d9b52792b/users/7e38b15144c34da3a574c2f34d841645/roles/36abe9b50fd8479c86c4f8f70fd85aa3` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:20:16.705177 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a71f1b4-6a1f-4e81-84d4-f0d11686c11b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9f451e97cea4eb0ac113f4d9b52792b, user_id=7e38b15144c34da3a574c2f34d841645, role_id=36abe9b50fd8479c86c4f8f70fd85aa3)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:20:16.721236 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a71f1b4-6a1f-4e81-84d4-f0d11686c11b admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:20:16.760198 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd541a09-9ffd-4b1a-8f98-59c1a0054eb2 admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:20:16.762470 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1358/2704] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 3 14:20:16 2022] PUT /identity/v3/projects/a9f451e97cea4eb0ac113f4d9b52792b/users/7e38b15144c34da3a574c2f34d841645/roles/36abe9b50fd8479c86c4f8f70fd85aa3 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:20:16.773892 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd541a09-9ffd-4b1a-8f98-59c1a0054eb2 admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:20:16.843620 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81b9689-f785-44af-9d56-e5f6986dda58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:20:16.844305 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81b9689-f785-44af-9d56-e5f6986dda58 admin admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:20:16.844613 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81b9689-f785-44af-9d56-e5f6986dda58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:20:16.844886 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81b9689-f785-44af-9d56-e5f6986dda58 admin admin] PATH_INFO: `/v3/roles` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:20:16.845648 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81b9689-f785-44af-9d56-e5f6986dda58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:20:16.847231 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81b9689-f785-44af-9d56-e5f6986dda58 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:20:16.858166 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1347/2705] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 3 14:20:16 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 14:20:16.862429 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a71f1b4-6a1f-4e81-84d4-f0d11686c11b admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:20:16.873443 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a71f1b4-6a1f-4e81-84d4-f0d11686c11b admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:20:16.879131 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d97dbb-50f7-4d37-97ca-e40e9561836b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:20:16.880043 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d97dbb-50f7-4d37-97ca-e40e9561836b admin admin] REQUEST_METHOD: `PUT` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:20:16.880316 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d97dbb-50f7-4d37-97ca-e40e9561836b admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:20:16.880596 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d97dbb-50f7-4d37-97ca-e40e9561836b admin admin] PATH_INFO: `/v3/projects/a9f451e97cea4eb0ac113f4d9b52792b/users/7e38b15144c34da3a574c2f34d841645/roles/36abe9b50fd8479c86c4f8f70fd85aa3` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:20:16.882653 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d97dbb-50f7-4d37-97ca-e40e9561836b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9f451e97cea4eb0ac113f4d9b52792b, user_id=7e38b15144c34da3a574c2f34d841645, role_id=36abe9b50fd8479c86c4f8f70fd85aa3)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:20:16.885351 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d97dbb-50f7-4d37-97ca-e40e9561836b admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:20:16.896490 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1359/2706] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 3 14:20:16 2022] PUT /identity/v3/projects/a9f451e97cea4eb0ac113f4d9b52792b/users/7e38b15144c34da3a574c2f34d841645/roles/36abe9b50fd8479c86c4f8f70fd85aa3 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:20:17.579874 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d03dac3-f0d5-4cd3-a6ad-f0fdfbd1470d None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:20:17.580424 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d03dac3-f0d5-4cd3-a6ad-f0fdfbd1470d None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:20:17.580810 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d03dac3-f0d5-4cd3-a6ad-f0fdfbd1470d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:20:17.611059 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-6d03dac3-f0d5-4cd3-a6ad-f0fdfbd1470d None None] MFA Rules not processed for user `7e38b15144c34da3a574c2f34d841645`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:20:17.612363 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-6d03dac3-f0d5-4cd3-a6ad-f0fdfbd1470d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:20:17.685654 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1348/2707] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:20:17 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:20:17.698279 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d97dbb-50f7-4d37-97ca-e40e9561836b admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:20:17.699985 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-c2d97dbb-50f7-4d37-97ca-e40e9561836b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:20:17.757216 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d97dbb-50f7-4d37-97ca-e40e9561836b admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:20:17.761870 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f26259-0987-42d7-93fc-3cfc80da1cef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b014f4c7ba1414cb8a597f5bc4033f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:20:17.762651 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f26259-0987-42d7-93fc-3cfc80da1cef service cinder] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:20:17.762925 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f26259-0987-42d7-93fc-3cfc80da1cef service cinder] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:20:17.763212 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f26259-0987-42d7-93fc-3cfc80da1cef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:20:17.823135 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f26259-0987-42d7-93fc-3cfc80da1cef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:20:17.824638 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f26259-0987-42d7-93fc-3cfc80da1cef service cinder] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:20:17.835564 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1360/2708] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:20:17 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 14:20:19.230331 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d03dac3-f0d5-4cd3-a6ad-f0fdfbd1470d None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:20:19.241857 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d03dac3-f0d5-4cd3-a6ad-f0fdfbd1470d None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:20:19.246826 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19ac3a2-0716-4c4d-9885-623e0e7ac8f1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b014f4c7ba1414cb8a597f5bc4033f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:20:19.247521 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19ac3a2-0716-4c4d-9885-623e0e7ac8f1 service cinder] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:20:19.247803 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19ac3a2-0716-4c4d-9885-623e0e7ac8f1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:20:19.248084 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19ac3a2-0716-4c4d-9885-623e0e7ac8f1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:20:19.259661 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19ac3a2-0716-4c4d-9885-623e0e7ac8f1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:20:19.261147 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19ac3a2-0716-4c4d-9885-623e0e7ac8f1 service cinder] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:20:19.272027 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1349/2709] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:20:19 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 14:20:32.351698 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f26259-0987-42d7-93fc-3cfc80da1cef service cinder] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:20:32.420948 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f26259-0987-42d7-93fc-3cfc80da1cef service cinder] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:20:32.425872 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cf1b8d-c2ff-47c5-9ca3-db6cabe17f52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:20:32.427075 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cf1b8d-c2ff-47c5-9ca3-db6cabe17f52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:20:32.427364 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cf1b8d-c2ff-47c5-9ca3-db6cabe17f52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:20:32.427636 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cf1b8d-c2ff-47c5-9ca3-db6cabe17f52 admin admin] PATH_INFO: `/v3/users/844b50c8ae454c5c8f3eb42d990c0a45` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:20:32.428842 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cf1b8d-c2ff-47c5-9ca3-db6cabe17f52 admin admin] RBAC: Authorizing `identity:delete_user(user_id=844b50c8ae454c5c8f3eb42d990c0a45)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:20:32.430807 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cf1b8d-c2ff-47c5-9ca3-db6cabe17f52 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:20:32.480489 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-e2cf1b8d-c2ff-47c5-9ca3-db6cabe17f52 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '844b50c8ae454c5c8f3eb42d990c0a45'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:20:32.487416 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-e2cf1b8d-c2ff-47c5-9ca3-db6cabe17f52 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '844b50c8ae454c5c8f3eb42d990c0a45'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:20:32.488261 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-e2cf1b8d-c2ff-47c5-9ca3-db6cabe17f52 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '844b50c8ae454c5c8f3eb42d990c0a45'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:20:32.496262 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-e2cf1b8d-c2ff-47c5-9ca3-db6cabe17f52 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '844b50c8ae454c5c8f3eb42d990c0a45'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:20:32.496947 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-e2cf1b8d-c2ff-47c5-9ca3-db6cabe17f52 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '844b50c8ae454c5c8f3eb42d990c0a45'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:20:32.514748 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1361/2710] 10.222.0.36 () {58 vars in 1223 bytes} [Tue May 3 14:20:32 2022] DELETE /identity/v3/users/844b50c8ae454c5c8f3eb42d990c0a45 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:20:32.687566 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19ac3a2-0716-4c4d-9885-623e0e7ac8f1 service cinder] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:20:32.698279 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19ac3a2-0716-4c4d-9885-623e0e7ac8f1 service cinder] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:20:32.772510 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c814b9-a3c2-4313-aaf7-472e69e5fddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:20:32.773367 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c814b9-a3c2-4313-aaf7-472e69e5fddc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:20:32.773605 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c814b9-a3c2-4313-aaf7-472e69e5fddc admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:20:32.773878 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c814b9-a3c2-4313-aaf7-472e69e5fddc admin admin] PATH_INFO: `/v3/projects/dbf0933f9a42479d8e1228b2c5ca7631` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:20:32.775044 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c814b9-a3c2-4313-aaf7-472e69e5fddc admin admin] RBAC: Authorizing `identity:delete_project(project_id=dbf0933f9a42479d8e1228b2c5ca7631)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:20:32.776971 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c814b9-a3c2-4313-aaf7-472e69e5fddc admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:20:32.826135 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-31c814b9-a3c2-4313-aaf7-472e69e5fddc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dbf0933f9a42479d8e1228b2c5ca7631', 'request_id': 'req-31c814b9-a3c2-4313-aaf7-472e69e5fddc'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:20:32.832239 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-31c814b9-a3c2-4313-aaf7-472e69e5fddc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dbf0933f9a42479d8e1228b2c5ca7631', 'request_id': 'req-31c814b9-a3c2-4313-aaf7-472e69e5fddc'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:20:32.838029 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-31c814b9-a3c2-4313-aaf7-472e69e5fddc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dbf0933f9a42479d8e1228b2c5ca7631', 'request_id': 'req-31c814b9-a3c2-4313-aaf7-472e69e5fddc'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:20:32.852176 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-31c814b9-a3c2-4313-aaf7-472e69e5fddc admin admin] The token cache is being invalidate because project dbf0933f9a42479d8e1228b2c5ca7631 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80012) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 14:20:32.852466 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-31c814b9-a3c2-4313-aaf7-472e69e5fddc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:20:32.853182 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-31c814b9-a3c2-4313-aaf7-472e69e5fddc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:20:32.854942 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1350/2711] 10.222.0.36 () {58 vars in 1232 bytes} [Tue May 3 14:20:32 2022] DELETE /identity/v3/projects/dbf0933f9a42479d8e1228b2c5ca7631 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:20:32.859296 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cf1b8d-c2ff-47c5-9ca3-db6cabe17f52 admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:20:32.860793 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-e2cf1b8d-c2ff-47c5-9ca3-db6cabe17f52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:20:32.874389 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cf1b8d-c2ff-47c5-9ca3-db6cabe17f52 admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:20:32.941843 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65e78b4-85a9-4631-b645-862720c05112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:20:32.942723 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65e78b4-85a9-4631-b645-862720c05112 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:20:32.942972 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65e78b4-85a9-4631-b645-862720c05112 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:20:32.943240 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65e78b4-85a9-4631-b645-862720c05112 admin admin] PATH_INFO: `/v3/users/7e38b15144c34da3a574c2f34d841645` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:20:32.944639 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65e78b4-85a9-4631-b645-862720c05112 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e38b15144c34da3a574c2f34d841645)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:20:32.946606 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65e78b4-85a9-4631-b645-862720c05112 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:20:32.996780 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-d65e78b4-85a9-4631-b645-862720c05112 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e38b15144c34da3a574c2f34d841645'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:20:33.003431 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-d65e78b4-85a9-4631-b645-862720c05112 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e38b15144c34da3a574c2f34d841645'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:20:33.004087 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-d65e78b4-85a9-4631-b645-862720c05112 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e38b15144c34da3a574c2f34d841645'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:20:33.012883 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-d65e78b4-85a9-4631-b645-862720c05112 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e38b15144c34da3a574c2f34d841645'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:20:33.013512 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-d65e78b4-85a9-4631-b645-862720c05112 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e38b15144c34da3a574c2f34d841645'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:20:33.030980 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1362/2712] 10.222.0.36 () {58 vars in 1223 bytes} [Tue May 3 14:20:32 2022] DELETE /identity/v3/users/7e38b15144c34da3a574c2f34d841645 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:20:33.214551 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c814b9-a3c2-4313-aaf7-472e69e5fddc admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:20:33.216068 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-31c814b9-a3c2-4313-aaf7-472e69e5fddc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:20:33.229310 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c814b9-a3c2-4313-aaf7-472e69e5fddc admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:20:33.290919 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d4e236-cf7c-4100-b5ad-831a2f5acf1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:20:33.291714 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d4e236-cf7c-4100-b5ad-831a2f5acf1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:20:33.291995 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d4e236-cf7c-4100-b5ad-831a2f5acf1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:20:33.292271 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d4e236-cf7c-4100-b5ad-831a2f5acf1a admin admin] PATH_INFO: `/v3/projects/a9f451e97cea4eb0ac113f4d9b52792b` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:20:33.293544 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d4e236-cf7c-4100-b5ad-831a2f5acf1a admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9f451e97cea4eb0ac113f4d9b52792b)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:20:33.295532 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d4e236-cf7c-4100-b5ad-831a2f5acf1a admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:20:33.347108 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-81d4e236-cf7c-4100-b5ad-831a2f5acf1a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9f451e97cea4eb0ac113f4d9b52792b', 'request_id': 'req-81d4e236-cf7c-4100-b5ad-831a2f5acf1a'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:20:33.353071 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-81d4e236-cf7c-4100-b5ad-831a2f5acf1a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9f451e97cea4eb0ac113f4d9b52792b', 'request_id': 'req-81d4e236-cf7c-4100-b5ad-831a2f5acf1a'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:20:33.358974 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-81d4e236-cf7c-4100-b5ad-831a2f5acf1a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9f451e97cea4eb0ac113f4d9b52792b', 'request_id': 'req-81d4e236-cf7c-4100-b5ad-831a2f5acf1a'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:20:33.376811 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-81d4e236-cf7c-4100-b5ad-831a2f5acf1a admin admin] The token cache is being invalidate because project a9f451e97cea4eb0ac113f4d9b52792b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80012) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 14:20:33.377154 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-81d4e236-cf7c-4100-b5ad-831a2f5acf1a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:20:33.378136 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-81d4e236-cf7c-4100-b5ad-831a2f5acf1a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:20:33.380896 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1351/2713] 10.222.0.36 () {58 vars in 1232 bytes} [Tue May 3 14:20:33 2022] DELETE /identity/v3/projects/a9f451e97cea4eb0ac113f4d9b52792b => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:20:33.388782 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ca46a5-e0e4-4fe8-8f58-a507bf483f0a None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:20:33.389358 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ca46a5-e0e4-4fe8-8f58-a507bf483f0a None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:20:33.389358 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ca46a5-e0e4-4fe8-8f58-a507bf483f0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:20:33.410037 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-22ca46a5-e0e4-4fe8-8f58-a507bf483f0a None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:20:33.411212 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-22ca46a5-e0e4-4fe8-8f58-a507bf483f0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:20:33.481026 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1363/2714] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:20:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:20:33.490729 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f55eaa5-50f8-438e-bc42-eaed99d1e414 None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:20:33.491020 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f55eaa5-50f8-438e-bc42-eaed99d1e414 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:20:33.491285 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f55eaa5-50f8-438e-bc42-eaed99d1e414 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:20:33.512212 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-0f55eaa5-50f8-438e-bc42-eaed99d1e414 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:20:33.513454 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-0f55eaa5-50f8-438e-bc42-eaed99d1e414 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:20:33.523298 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1352/2715] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:20:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:20:33.529328 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ca46a5-e0e4-4fe8-8f58-a507bf483f0a None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:20:33.539674 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ca46a5-e0e4-4fe8-8f58-a507bf483f0a None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:20:33.545870 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea682e2a-4211-46ab-981a-1c9cb6851d26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:20:33.546457 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea682e2a-4211-46ab-981a-1c9cb6851d26 admin admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:20:33.546734 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea682e2a-4211-46ab-981a-1c9cb6851d26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:20:33.547002 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea682e2a-4211-46ab-981a-1c9cb6851d26 admin admin] PATH_INFO: `/v3/domains` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:20:33.547727 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea682e2a-4211-46ab-981a-1c9cb6851d26 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:20:33.548030 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea682e2a-4211-46ab-981a-1c9cb6851d26 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:20:33.549766 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea682e2a-4211-46ab-981a-1c9cb6851d26 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:20:33.562163 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1364/2716] 10.222.0.36 () {58 vars in 1152 bytes} [Tue May 3 14:20:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:20:33.567378 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f55eaa5-50f8-438e-bc42-eaed99d1e414 None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:20:33.579344 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f55eaa5-50f8-438e-bc42-eaed99d1e414 None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:20:33.585616 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492e09da-e7dd-47bd-af8b-6c336ce3eb90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:20:33.586285 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492e09da-e7dd-47bd-af8b-6c336ce3eb90 admin admin] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:20:33.586607 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492e09da-e7dd-47bd-af8b-6c336ce3eb90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:20:33.586835 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492e09da-e7dd-47bd-af8b-6c336ce3eb90 admin admin] PATH_INFO: `/v3/projects` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:20:33.587519 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492e09da-e7dd-47bd-af8b-6c336ce3eb90 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:20:33.589456 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492e09da-e7dd-47bd-af8b-6c336ce3eb90 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:20:33.618790 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1353/2717] 10.222.0.36 () {60 vars in 1152 bytes} [Tue May 3 14:20:33 2022] POST /identity/v3/projects => generated 373 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 14:20:33.623159 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea682e2a-4211-46ab-981a-1c9cb6851d26 admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:20:33.633618 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea682e2a-4211-46ab-981a-1c9cb6851d26 admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:20:33.689260 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c7d32b-2570-4646-9764-67b79abf97e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:20:33.689961 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c7d32b-2570-4646-9764-67b79abf97e9 admin admin] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:20:33.690235 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c7d32b-2570-4646-9764-67b79abf97e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:20:33.690505 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c7d32b-2570-4646-9764-67b79abf97e9 admin admin] PATH_INFO: `/v3/users` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:20:33.691181 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c7d32b-2570-4646-9764-67b79abf97e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:20:33.693118 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c7d32b-2570-4646-9764-67b79abf97e9 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:20:33.720440 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1365/2718] 10.222.0.36 () {60 vars in 1143 bytes} [Tue May 3 14:20:33 2022] POST /identity/v3/users => generated 287 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 14:20:33.724520 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492e09da-e7dd-47bd-af8b-6c336ce3eb90 admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:20:33.735109 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492e09da-e7dd-47bd-af8b-6c336ce3eb90 admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:20:33.740255 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a18c8f-8326-4dd4-a700-d12d1c96f3a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:20:33.740911 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a18c8f-8326-4dd4-a700-d12d1c96f3a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:20:33.741187 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a18c8f-8326-4dd4-a700-d12d1c96f3a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:20:33.741489 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a18c8f-8326-4dd4-a700-d12d1c96f3a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:20:33.742205 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a18c8f-8326-4dd4-a700-d12d1c96f3a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:20:33.743832 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a18c8f-8326-4dd4-a700-d12d1c96f3a3 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:20:33.754585 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1354/2719] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 3 14:20:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 14:20:33.758682 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c7d32b-2570-4646-9764-67b79abf97e9 admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:20:33.769865 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c7d32b-2570-4646-9764-67b79abf97e9 admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:20:33.775160 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1132c821-b09f-47ac-8ec7-6e5fa8ec4381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:20:33.775861 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1132c821-b09f-47ac-8ec7-6e5fa8ec4381 admin admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:20:33.776135 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1132c821-b09f-47ac-8ec7-6e5fa8ec4381 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:20:33.776404 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1132c821-b09f-47ac-8ec7-6e5fa8ec4381 admin admin] PATH_INFO: `/v3/roles` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:20:33.777132 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1132c821-b09f-47ac-8ec7-6e5fa8ec4381 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:20:33.778865 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1132c821-b09f-47ac-8ec7-6e5fa8ec4381 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:20:33.791623 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1366/2720] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 3 14:20:33 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 14:20:33.795618 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a18c8f-8326-4dd4-a700-d12d1c96f3a3 admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:20:33.807135 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a18c8f-8326-4dd4-a700-d12d1c96f3a3 admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:20:33.812141 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26061db-e618-483b-8903-0bb7712a075f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:20:33.812823 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26061db-e618-483b-8903-0bb7712a075f admin admin] REQUEST_METHOD: `PUT` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:20:33.813104 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26061db-e618-483b-8903-0bb7712a075f admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:20:33.813413 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26061db-e618-483b-8903-0bb7712a075f admin admin] PATH_INFO: `/v3/projects/a766bf9223bd434dbc6969fe1449b2c9/users/6e7b837ac1f843c9ab6370b1dd04d2ea/roles/441fdc11e95b47f4813f72610e39018b` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:20:33.830621 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26061db-e618-483b-8903-0bb7712a075f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a766bf9223bd434dbc6969fe1449b2c9, user_id=6e7b837ac1f843c9ab6370b1dd04d2ea, role_id=441fdc11e95b47f4813f72610e39018b)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:20:33.833365 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26061db-e618-483b-8903-0bb7712a075f admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:20:33.847235 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1355/2721] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 3 14:20:33 2022] PUT /identity/v3/projects/a766bf9223bd434dbc6969fe1449b2c9/users/6e7b837ac1f843c9ab6370b1dd04d2ea/roles/441fdc11e95b47f4813f72610e39018b => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:20:33.858224 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe24de5-27f9-4bce-9194-869ab7efec48 None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:20:33.858514 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe24de5-27f9-4bce-9194-869ab7efec48 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:20:33.858792 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe24de5-27f9-4bce-9194-869ab7efec48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:20:33.885404 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-dfe24de5-27f9-4bce-9194-869ab7efec48 None None] MFA Rules not processed for user `6e7b837ac1f843c9ab6370b1dd04d2ea`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:20:33.886643 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-dfe24de5-27f9-4bce-9194-869ab7efec48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:20:33.949991 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1367/2722] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:20:33 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:20:33.962103 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26061db-e618-483b-8903-0bb7712a075f admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:20:33.973044 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-a26061db-e618-483b-8903-0bb7712a075f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:20:34.033862 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26061db-e618-483b-8903-0bb7712a075f admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:20:34.038721 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8bbc26-fc9b-4fd2-a85a-8998aa55fcec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b014f4c7ba1414cb8a597f5bc4033f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:20:34.039381 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8bbc26-fc9b-4fd2-a85a-8998aa55fcec service cinder] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:20:34.039687 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8bbc26-fc9b-4fd2-a85a-8998aa55fcec service cinder] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:20:34.039958 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8bbc26-fc9b-4fd2-a85a-8998aa55fcec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:20:34.049654 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8bbc26-fc9b-4fd2-a85a-8998aa55fcec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:20:34.051105 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8bbc26-fc9b-4fd2-a85a-8998aa55fcec service cinder] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:20:34.061079 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1356/2723] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:20:33 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 14:20:34.081167 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe24de5-27f9-4bce-9194-869ab7efec48 None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:20:34.145632 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe24de5-27f9-4bce-9194-869ab7efec48 None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:20:34.150858 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03807ab3-3385-4265-a613-341a431100fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:20:34.151755 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03807ab3-3385-4265-a613-341a431100fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:20:34.152033 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03807ab3-3385-4265-a613-341a431100fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:20:34.152308 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03807ab3-3385-4265-a613-341a431100fb admin admin] PATH_INFO: `/v3/users/6e7b837ac1f843c9ab6370b1dd04d2ea` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:20:34.153634 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03807ab3-3385-4265-a613-341a431100fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e7b837ac1f843c9ab6370b1dd04d2ea)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:20:34.155612 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03807ab3-3385-4265-a613-341a431100fb admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:20:34.200901 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-03807ab3-3385-4265-a613-341a431100fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e7b837ac1f843c9ab6370b1dd04d2ea'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:20:34.208038 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-03807ab3-3385-4265-a613-341a431100fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e7b837ac1f843c9ab6370b1dd04d2ea'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:20:34.209188 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-03807ab3-3385-4265-a613-341a431100fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e7b837ac1f843c9ab6370b1dd04d2ea'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:20:34.218482 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-03807ab3-3385-4265-a613-341a431100fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e7b837ac1f843c9ab6370b1dd04d2ea'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:20:34.219097 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-03807ab3-3385-4265-a613-341a431100fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e7b837ac1f843c9ab6370b1dd04d2ea'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:20:34.235856 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1368/2724] 10.222.0.36 () {58 vars in 1223 bytes} [Tue May 3 14:20:34 2022] DELETE /identity/v3/users/6e7b837ac1f843c9ab6370b1dd04d2ea => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:20:34.240525 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7c4b1d-627c-4de4-bce4-3543b6fdf010 None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:20:34.240790 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7c4b1d-627c-4de4-bce4-3543b6fdf010 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:20:34.241097 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7c4b1d-627c-4de4-bce4-3543b6fdf010 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:20:34.258628 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-1b7c4b1d-627c-4de4-bce4-3543b6fdf010 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:20:34.259827 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-1b7c4b1d-627c-4de4-bce4-3543b6fdf010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:20:34.318204 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1357/2725] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:20:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:20:34.328221 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03807ab3-3385-4265-a613-341a431100fb admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:20:34.329810 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-03807ab3-3385-4265-a613-341a431100fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:20:34.386994 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03807ab3-3385-4265-a613-341a431100fb admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:20:34.390584 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8eb41b-a37b-4f33-b5a8-4a7b3ac970b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '937bea4f355144b4a7ee11baabc3a4cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:20:34.391238 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8eb41b-a37b-4f33-b5a8-4a7b3ac970b0 service neutron] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:20:34.391516 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8eb41b-a37b-4f33-b5a8-4a7b3ac970b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:20:34.391791 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8eb41b-a37b-4f33-b5a8-4a7b3ac970b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:20:34.401986 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8eb41b-a37b-4f33-b5a8-4a7b3ac970b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:20:34.403476 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8eb41b-a37b-4f33-b5a8-4a7b3ac970b0 service neutron] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:20:34.414059 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1369/2726] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:20:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 14:20:34.693318 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7c4b1d-627c-4de4-bce4-3543b6fdf010 None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:20:34.693318 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-1b7c4b1d-627c-4de4-bce4-3543b6fdf010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:20:34.705807 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7c4b1d-627c-4de4-bce4-3543b6fdf010 None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:20:34.712423 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e03e18-e2d3-4d7e-9e6f-28781ace33af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:20:34.713373 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e03e18-e2d3-4d7e-9e6f-28781ace33af admin admin] REQUEST_METHOD: `DELETE` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:20:34.713659 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e03e18-e2d3-4d7e-9e6f-28781ace33af admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:20:34.713938 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e03e18-e2d3-4d7e-9e6f-28781ace33af admin admin] PATH_INFO: `/v3/projects/a766bf9223bd434dbc6969fe1449b2c9` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:20:34.715254 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e03e18-e2d3-4d7e-9e6f-28781ace33af admin admin] RBAC: Authorizing `identity:delete_project(project_id=a766bf9223bd434dbc6969fe1449b2c9)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:20:34.717248 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e03e18-e2d3-4d7e-9e6f-28781ace33af admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:20:34.774186 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-89e03e18-e2d3-4d7e-9e6f-28781ace33af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a766bf9223bd434dbc6969fe1449b2c9', 'request_id': 'req-89e03e18-e2d3-4d7e-9e6f-28781ace33af'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:20:34.780153 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-89e03e18-e2d3-4d7e-9e6f-28781ace33af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a766bf9223bd434dbc6969fe1449b2c9', 'request_id': 'req-89e03e18-e2d3-4d7e-9e6f-28781ace33af'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:20:34.785490 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-89e03e18-e2d3-4d7e-9e6f-28781ace33af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a766bf9223bd434dbc6969fe1449b2c9', 'request_id': 'req-89e03e18-e2d3-4d7e-9e6f-28781ace33af'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:20:34.799199 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-89e03e18-e2d3-4d7e-9e6f-28781ace33af admin admin] The token cache is being invalidate because project a766bf9223bd434dbc6969fe1449b2c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80012) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 14:20:34.799486 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-89e03e18-e2d3-4d7e-9e6f-28781ace33af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:20:34.800253 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-89e03e18-e2d3-4d7e-9e6f-28781ace33af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:20:34.802211 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1358/2727] 10.222.0.36 () {58 vars in 1232 bytes} [Tue May 3 14:20:34 2022] DELETE /identity/v3/projects/a766bf9223bd434dbc6969fe1449b2c9 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:20:34.807060 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6874629-b94a-4199-9be1-3f891651d70f None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:20:34.807335 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6874629-b94a-4199-9be1-3f891651d70f None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:20:34.807605 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6874629-b94a-4199-9be1-3f891651d70f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:20:34.824750 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-a6874629-b94a-4199-9be1-3f891651d70f None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:20:34.825967 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-a6874629-b94a-4199-9be1-3f891651d70f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:20:34.886200 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1370/2728] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:20:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:20:34.894432 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f35f484-94dd-4b81-b033-5850566d0afb None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:20:34.894798 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f35f484-94dd-4b81-b033-5850566d0afb None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:20:34.895159 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f35f484-94dd-4b81-b033-5850566d0afb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:20:34.914473 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-6f35f484-94dd-4b81-b033-5850566d0afb None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:20:34.915729 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-6f35f484-94dd-4b81-b033-5850566d0afb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:20:34.924276 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1359/2729] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:20:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:20:34.928739 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6874629-b94a-4199-9be1-3f891651d70f None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:20:34.939083 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6874629-b94a-4199-9be1-3f891651d70f None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:20:34.944047 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bb3f7c-9153-4ad9-bf95-f1046ed0045c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:20:34.944712 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bb3f7c-9153-4ad9-bf95-f1046ed0045c admin admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:20:34.944989 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bb3f7c-9153-4ad9-bf95-f1046ed0045c admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:20:34.945268 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bb3f7c-9153-4ad9-bf95-f1046ed0045c admin admin] PATH_INFO: `/v3/domains` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:20:34.946028 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bb3f7c-9153-4ad9-bf95-f1046ed0045c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:20:34.946329 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bb3f7c-9153-4ad9-bf95-f1046ed0045c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:20:34.947997 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bb3f7c-9153-4ad9-bf95-f1046ed0045c admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:20:34.962326 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1371/2730] 10.222.0.36 () {58 vars in 1152 bytes} [Tue May 3 14:20:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:20:34.965451 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f35f484-94dd-4b81-b033-5850566d0afb None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:20:34.975047 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f35f484-94dd-4b81-b033-5850566d0afb None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:20:34.979878 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fb4e0c-d5b2-4ee8-8f6e-557a63d3c213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:20:34.980555 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fb4e0c-d5b2-4ee8-8f6e-557a63d3c213 admin admin] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:20:34.980865 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fb4e0c-d5b2-4ee8-8f6e-557a63d3c213 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:20:34.981143 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fb4e0c-d5b2-4ee8-8f6e-557a63d3c213 admin admin] PATH_INFO: `/v3/projects` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:20:34.981865 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fb4e0c-d5b2-4ee8-8f6e-557a63d3c213 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:20:34.983788 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fb4e0c-d5b2-4ee8-8f6e-557a63d3c213 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:20:35.014814 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1360/2731] 10.222.0.36 () {60 vars in 1152 bytes} [Tue May 3 14:20:34 2022] POST /identity/v3/projects => generated 359 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 14:20:35.016571 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bb3f7c-9153-4ad9-bf95-f1046ed0045c admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:20:35.027925 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bb3f7c-9153-4ad9-bf95-f1046ed0045c admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:20:35.089555 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fb94a7-25a0-4246-afe7-7a7e9bdfd6bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:20:35.090237 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fb94a7-25a0-4246-afe7-7a7e9bdfd6bc admin admin] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:20:35.090516 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fb94a7-25a0-4246-afe7-7a7e9bdfd6bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:20:35.090775 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fb94a7-25a0-4246-afe7-7a7e9bdfd6bc admin admin] PATH_INFO: `/v3/users` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:20:35.091456 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fb94a7-25a0-4246-afe7-7a7e9bdfd6bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:20:35.093403 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fb94a7-25a0-4246-afe7-7a7e9bdfd6bc admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:20:35.114780 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1372/2732] 10.222.0.36 () {60 vars in 1143 bytes} [Tue May 3 14:20:35 2022] POST /identity/v3/users => generated 280 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 14:20:35.118980 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fb4e0c-d5b2-4ee8-8f6e-557a63d3c213 admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:20:35.129910 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fb4e0c-d5b2-4ee8-8f6e-557a63d3c213 admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:20:35.134601 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9104a3d9-a334-4acd-80aa-3d54cbb91c13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:20:35.135256 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9104a3d9-a334-4acd-80aa-3d54cbb91c13 admin admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:20:35.135535 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9104a3d9-a334-4acd-80aa-3d54cbb91c13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:20:35.135809 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9104a3d9-a334-4acd-80aa-3d54cbb91c13 admin admin] PATH_INFO: `/v3/roles` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:20:35.136526 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9104a3d9-a334-4acd-80aa-3d54cbb91c13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:20:35.138172 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9104a3d9-a334-4acd-80aa-3d54cbb91c13 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:20:35.151531 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1361/2733] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 3 14:20:35 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 14:20:35.155846 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fb94a7-25a0-4246-afe7-7a7e9bdfd6bc admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:20:35.166025 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fb94a7-25a0-4246-afe7-7a7e9bdfd6bc admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:20:35.170599 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d622cd6-432f-4463-821a-121a8bba8bf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:20:35.171260 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d622cd6-432f-4463-821a-121a8bba8bf3 admin admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:20:35.171552 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d622cd6-432f-4463-821a-121a8bba8bf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:20:35.171809 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d622cd6-432f-4463-821a-121a8bba8bf3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:20:35.172556 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d622cd6-432f-4463-821a-121a8bba8bf3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:20:35.174225 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d622cd6-432f-4463-821a-121a8bba8bf3 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:20:35.184404 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1373/2734] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 3 14:20:35 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 14:20:35.188783 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9104a3d9-a334-4acd-80aa-3d54cbb91c13 admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:20:35.199544 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9104a3d9-a334-4acd-80aa-3d54cbb91c13 admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:20:35.204401 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a342a3-c07a-4fea-8069-c156e8823f9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:20:35.205508 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a342a3-c07a-4fea-8069-c156e8823f9a admin admin] REQUEST_METHOD: `PUT` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:20:35.205796 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a342a3-c07a-4fea-8069-c156e8823f9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:20:35.206066 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a342a3-c07a-4fea-8069-c156e8823f9a admin admin] PATH_INFO: `/v3/projects/0d806b4129b64242937febc3f97de39a/users/a1ab640e27e04188ab40e3efee86a8a3/roles/441fdc11e95b47f4813f72610e39018b` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:20:35.221762 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a342a3-c07a-4fea-8069-c156e8823f9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d806b4129b64242937febc3f97de39a, user_id=a1ab640e27e04188ab40e3efee86a8a3, role_id=441fdc11e95b47f4813f72610e39018b)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:20:35.224636 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a342a3-c07a-4fea-8069-c156e8823f9a admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:20:35.240304 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1362/2735] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 3 14:20:35 2022] PUT /identity/v3/projects/0d806b4129b64242937febc3f97de39a/users/a1ab640e27e04188ab40e3efee86a8a3/roles/441fdc11e95b47f4813f72610e39018b => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 14:20:35.251856 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5666c407-3af9-48ea-9917-ce06957044a3 None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:20:35.252252 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5666c407-3af9-48ea-9917-ce06957044a3 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:20:35.252636 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5666c407-3af9-48ea-9917-ce06957044a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:20:35.278798 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-5666c407-3af9-48ea-9917-ce06957044a3 None None] MFA Rules not processed for user `a1ab640e27e04188ab40e3efee86a8a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:20:35.280113 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-5666c407-3af9-48ea-9917-ce06957044a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:20:35.343701 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1374/2736] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:20:35 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:20:35.380530 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a342a3-c07a-4fea-8069-c156e8823f9a admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:20:35.383122 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-19a342a3-c07a-4fea-8069-c156e8823f9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:20:35.446149 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a342a3-c07a-4fea-8069-c156e8823f9a admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:20:35.449958 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831d795b-2d7c-4c0f-8ee3-aeca0363b252 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b014f4c7ba1414cb8a597f5bc4033f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:20:35.450612 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831d795b-2d7c-4c0f-8ee3-aeca0363b252 service cinder] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:20:35.451078 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831d795b-2d7c-4c0f-8ee3-aeca0363b252 service cinder] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:20:35.451355 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831d795b-2d7c-4c0f-8ee3-aeca0363b252 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:20:35.461100 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831d795b-2d7c-4c0f-8ee3-aeca0363b252 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:20:35.462580 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831d795b-2d7c-4c0f-8ee3-aeca0363b252 service cinder] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:20:35.472687 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1363/2737] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:20:35 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 14:20:35.486924 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5666c407-3af9-48ea-9917-ce06957044a3 None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:20:35.554977 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5666c407-3af9-48ea-9917-ce06957044a3 None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:20:35.560371 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9983e11-a16c-4929-bd71-28f73fa77105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:20:35.561402 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9983e11-a16c-4929-bd71-28f73fa77105 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:20:35.561782 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9983e11-a16c-4929-bd71-28f73fa77105 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:20:35.562278 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9983e11-a16c-4929-bd71-28f73fa77105 admin admin] PATH_INFO: `/v3/users/a1ab640e27e04188ab40e3efee86a8a3` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:20:35.563678 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9983e11-a16c-4929-bd71-28f73fa77105 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1ab640e27e04188ab40e3efee86a8a3)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:20:35.565864 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9983e11-a16c-4929-bd71-28f73fa77105 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:20:35.620013 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-d9983e11-a16c-4929-bd71-28f73fa77105 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1ab640e27e04188ab40e3efee86a8a3'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:20:35.627271 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-d9983e11-a16c-4929-bd71-28f73fa77105 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1ab640e27e04188ab40e3efee86a8a3'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:20:35.628158 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-d9983e11-a16c-4929-bd71-28f73fa77105 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1ab640e27e04188ab40e3efee86a8a3'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:20:35.636427 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-d9983e11-a16c-4929-bd71-28f73fa77105 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1ab640e27e04188ab40e3efee86a8a3'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:20:35.637092 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-d9983e11-a16c-4929-bd71-28f73fa77105 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1ab640e27e04188ab40e3efee86a8a3'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:20:35.655764 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1375/2738] 10.222.0.36 () {58 vars in 1223 bytes} [Tue May 3 14:20:35 2022] DELETE /identity/v3/users/a1ab640e27e04188ab40e3efee86a8a3 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:20:35.660698 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6094d665-0831-4bfe-b3a6-0c970481be04 None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:20:35.661012 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6094d665-0831-4bfe-b3a6-0c970481be04 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:20:35.661193 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6094d665-0831-4bfe-b3a6-0c970481be04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:20:35.678248 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-6094d665-0831-4bfe-b3a6-0c970481be04 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:20:35.679998 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-6094d665-0831-4bfe-b3a6-0c970481be04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:20:35.738065 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1364/2739] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:20:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:20:35.748112 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9983e11-a16c-4929-bd71-28f73fa77105 admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:20:35.749665 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-d9983e11-a16c-4929-bd71-28f73fa77105 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:20:35.808872 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9983e11-a16c-4929-bd71-28f73fa77105 admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:20:35.812955 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7264ae-1137-40ec-88e3-3ae32c6e4ffe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '937bea4f355144b4a7ee11baabc3a4cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:20:35.813647 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7264ae-1137-40ec-88e3-3ae32c6e4ffe service neutron] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:20:35.814268 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7264ae-1137-40ec-88e3-3ae32c6e4ffe service neutron] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:20:35.814546 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7264ae-1137-40ec-88e3-3ae32c6e4ffe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:20:35.824298 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7264ae-1137-40ec-88e3-3ae32c6e4ffe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:20:35.825776 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7264ae-1137-40ec-88e3-3ae32c6e4ffe service neutron] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:20:35.837147 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1376/2740] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:20:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 14:20:36.278908 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6094d665-0831-4bfe-b3a6-0c970481be04 None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:20:36.280555 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-6094d665-0831-4bfe-b3a6-0c970481be04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:20:36.294247 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6094d665-0831-4bfe-b3a6-0c970481be04 None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:20:36.300526 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e0084e-ffca-4ac0-b46c-3abd164fcd27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:20:36.301588 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e0084e-ffca-4ac0-b46c-3abd164fcd27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:20:36.301997 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e0084e-ffca-4ac0-b46c-3abd164fcd27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:20:36.302386 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e0084e-ffca-4ac0-b46c-3abd164fcd27 admin admin] PATH_INFO: `/v3/projects/0d806b4129b64242937febc3f97de39a` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:20:36.303867 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e0084e-ffca-4ac0-b46c-3abd164fcd27 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d806b4129b64242937febc3f97de39a)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:20:36.306099 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e0084e-ffca-4ac0-b46c-3abd164fcd27 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:20:36.364457 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-09e0084e-ffca-4ac0-b46c-3abd164fcd27 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d806b4129b64242937febc3f97de39a', 'request_id': 'req-09e0084e-ffca-4ac0-b46c-3abd164fcd27'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:20:36.372365 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-09e0084e-ffca-4ac0-b46c-3abd164fcd27 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d806b4129b64242937febc3f97de39a', 'request_id': 'req-09e0084e-ffca-4ac0-b46c-3abd164fcd27'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:20:36.377882 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-09e0084e-ffca-4ac0-b46c-3abd164fcd27 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d806b4129b64242937febc3f97de39a', 'request_id': 'req-09e0084e-ffca-4ac0-b46c-3abd164fcd27'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:20:36.393399 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-09e0084e-ffca-4ac0-b46c-3abd164fcd27 admin admin] The token cache is being invalidate because project 0d806b4129b64242937febc3f97de39a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80012) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 14:20:36.393399 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-09e0084e-ffca-4ac0-b46c-3abd164fcd27 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:20:36.394114 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-09e0084e-ffca-4ac0-b46c-3abd164fcd27 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:20:36.396062 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1365/2741] 10.222.0.36 () {58 vars in 1232 bytes} [Tue May 3 14:20:36 2022] DELETE /identity/v3/projects/0d806b4129b64242937febc3f97de39a => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:20:36.400708 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a70ce3-5fff-4708-be01-0b6dd523331d None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:20:36.401000 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a70ce3-5fff-4708-be01-0b6dd523331d None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:20:36.401469 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a70ce3-5fff-4708-be01-0b6dd523331d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:20:36.418913 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-c3a70ce3-5fff-4708-be01-0b6dd523331d None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:20:36.420004 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-c3a70ce3-5fff-4708-be01-0b6dd523331d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:20:36.480543 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1377/2742] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:20:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:20:36.488461 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b67ce8d-51c9-4a0c-baa3-a299112d904e None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:20:36.488934 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b67ce8d-51c9-4a0c-baa3-a299112d904e None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:20:36.489268 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b67ce8d-51c9-4a0c-baa3-a299112d904e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:20:36.508064 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-4b67ce8d-51c9-4a0c-baa3-a299112d904e None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:20:36.509295 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-4b67ce8d-51c9-4a0c-baa3-a299112d904e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:20:36.517274 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1366/2743] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:20:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:20:36.521796 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a70ce3-5fff-4708-be01-0b6dd523331d None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:20:36.531800 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a70ce3-5fff-4708-be01-0b6dd523331d None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:20:36.536786 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d770a01a-5af1-405b-8c44-380bbf2db0ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:20:36.537575 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d770a01a-5af1-405b-8c44-380bbf2db0ad admin admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:20:36.537916 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d770a01a-5af1-405b-8c44-380bbf2db0ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:20:36.538252 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d770a01a-5af1-405b-8c44-380bbf2db0ad admin admin] PATH_INFO: `/v3/domains` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:20:36.539048 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d770a01a-5af1-405b-8c44-380bbf2db0ad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:20:36.539428 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d770a01a-5af1-405b-8c44-380bbf2db0ad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:20:36.541029 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d770a01a-5af1-405b-8c44-380bbf2db0ad admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:20:36.554467 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1378/2744] 10.222.0.36 () {58 vars in 1152 bytes} [Tue May 3 14:20:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:20:36.558858 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b67ce8d-51c9-4a0c-baa3-a299112d904e None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:20:36.572968 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b67ce8d-51c9-4a0c-baa3-a299112d904e None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:20:36.580447 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d11be3-9b62-44f8-af1e-4b2203ca2a0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:20:36.581130 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d11be3-9b62-44f8-af1e-4b2203ca2a0a admin admin] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:20:36.581444 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d11be3-9b62-44f8-af1e-4b2203ca2a0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:20:36.581715 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d11be3-9b62-44f8-af1e-4b2203ca2a0a admin admin] PATH_INFO: `/v3/projects` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:20:36.582424 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d11be3-9b62-44f8-af1e-4b2203ca2a0a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:20:36.584667 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d11be3-9b62-44f8-af1e-4b2203ca2a0a admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:20:36.616466 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1367/2745] 10.222.0.36 () {60 vars in 1152 bytes} [Tue May 3 14:20:36 2022] POST /identity/v3/projects => generated 371 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 14:20:36.617859 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d770a01a-5af1-405b-8c44-380bbf2db0ad admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:20:36.628364 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d770a01a-5af1-405b-8c44-380bbf2db0ad admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:20:36.687759 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9deba3-5e43-4131-866f-a5a50b83ac74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:20:36.688434 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9deba3-5e43-4131-866f-a5a50b83ac74 admin admin] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:20:36.688816 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9deba3-5e43-4131-866f-a5a50b83ac74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:20:36.689110 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9deba3-5e43-4131-866f-a5a50b83ac74 admin admin] PATH_INFO: `/v3/users` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:20:36.689938 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9deba3-5e43-4131-866f-a5a50b83ac74 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:20:36.691875 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9deba3-5e43-4131-866f-a5a50b83ac74 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:20:36.716217 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1379/2746] 10.222.0.36 () {60 vars in 1143 bytes} [Tue May 3 14:20:36 2022] POST /identity/v3/users => generated 286 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 14:20:36.717193 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d11be3-9b62-44f8-af1e-4b2203ca2a0a admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:20:36.727653 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d11be3-9b62-44f8-af1e-4b2203ca2a0a admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:20:36.732408 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3ae8f2-9e34-40b4-b1ed-39d62d70b068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:20:36.733084 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3ae8f2-9e34-40b4-b1ed-39d62d70b068 admin admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:20:36.733420 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3ae8f2-9e34-40b4-b1ed-39d62d70b068 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:20:36.733751 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3ae8f2-9e34-40b4-b1ed-39d62d70b068 admin admin] PATH_INFO: `/v3/roles` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:20:36.734435 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3ae8f2-9e34-40b4-b1ed-39d62d70b068 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:20:36.736077 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3ae8f2-9e34-40b4-b1ed-39d62d70b068 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:20:36.747181 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1368/2747] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 3 14:20:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 14:20:36.751492 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9deba3-5e43-4131-866f-a5a50b83ac74 admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:20:36.762400 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9deba3-5e43-4131-866f-a5a50b83ac74 admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:20:36.767694 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8755cdd1-fe27-47f9-b418-3e6bbdcb03cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:20:36.768516 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8755cdd1-fe27-47f9-b418-3e6bbdcb03cd admin admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:20:36.768805 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8755cdd1-fe27-47f9-b418-3e6bbdcb03cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:20:36.769067 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8755cdd1-fe27-47f9-b418-3e6bbdcb03cd admin admin] PATH_INFO: `/v3/roles` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:20:36.769881 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8755cdd1-fe27-47f9-b418-3e6bbdcb03cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:20:36.771510 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8755cdd1-fe27-47f9-b418-3e6bbdcb03cd admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:20:36.782029 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1380/2748] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 3 14:20:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 14:20:36.786513 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3ae8f2-9e34-40b4-b1ed-39d62d70b068 admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:20:36.797068 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3ae8f2-9e34-40b4-b1ed-39d62d70b068 admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:20:36.803076 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e380f2-6072-48c6-86be-267182012014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:20:36.803965 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e380f2-6072-48c6-86be-267182012014 admin admin] REQUEST_METHOD: `PUT` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:20:36.804245 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e380f2-6072-48c6-86be-267182012014 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:20:36.804520 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e380f2-6072-48c6-86be-267182012014 admin admin] PATH_INFO: `/v3/projects/04d964a6673c41ee9c55c7d3e96ff09d/users/164b2fa23740483981db11a04d7b3f83/roles/441fdc11e95b47f4813f72610e39018b` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:20:36.820276 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e380f2-6072-48c6-86be-267182012014 admin admin] RBAC: Authorizing `identity:create_grant(project_id=04d964a6673c41ee9c55c7d3e96ff09d, user_id=164b2fa23740483981db11a04d7b3f83, role_id=441fdc11e95b47f4813f72610e39018b)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:20:36.823055 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e380f2-6072-48c6-86be-267182012014 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:20:36.839252 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1369/2749] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 3 14:20:36 2022] PUT /identity/v3/projects/04d964a6673c41ee9c55c7d3e96ff09d/users/164b2fa23740483981db11a04d7b3f83/roles/441fdc11e95b47f4813f72610e39018b => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:20:36.850195 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e046a3-245d-4f06-8dbc-02a607b4e13d None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:20:36.850505 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e046a3-245d-4f06-8dbc-02a607b4e13d None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:20:36.850778 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e046a3-245d-4f06-8dbc-02a607b4e13d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:20:36.879287 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-a2e046a3-245d-4f06-8dbc-02a607b4e13d None None] MFA Rules not processed for user `164b2fa23740483981db11a04d7b3f83`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:20:36.880504 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-a2e046a3-245d-4f06-8dbc-02a607b4e13d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:20:36.946224 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1381/2750] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:20:36 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:20:36.958238 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e380f2-6072-48c6-86be-267182012014 admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:20:36.960288 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-10e380f2-6072-48c6-86be-267182012014 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:20:37.016757 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e380f2-6072-48c6-86be-267182012014 admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:20:37.020524 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119c3a16-c92c-4d68-a8b1-447025472812 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '616de5e7daed46849efc75ad77ea054e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:20:37.021185 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119c3a16-c92c-4d68-a8b1-447025472812 service glance] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:20:37.021514 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119c3a16-c92c-4d68-a8b1-447025472812 service glance] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:20:37.021787 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119c3a16-c92c-4d68-a8b1-447025472812 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:20:37.030861 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119c3a16-c92c-4d68-a8b1-447025472812 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:20:37.032302 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119c3a16-c92c-4d68-a8b1-447025472812 service glance] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:20:37.042715 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1370/2751] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:20:36 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 14:21:03.830108 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e046a3-245d-4f06-8dbc-02a607b4e13d None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:21:03.909453 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e046a3-245d-4f06-8dbc-02a607b4e13d None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:21:03.916297 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2256589-8470-4b99-a9fe-2a7e4bfc3da6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:21:03.917318 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2256589-8470-4b99-a9fe-2a7e4bfc3da6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:21:03.917634 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2256589-8470-4b99-a9fe-2a7e4bfc3da6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:21:03.917909 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2256589-8470-4b99-a9fe-2a7e4bfc3da6 admin admin] PATH_INFO: `/v3/users/164b2fa23740483981db11a04d7b3f83` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:21:03.919262 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2256589-8470-4b99-a9fe-2a7e4bfc3da6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=164b2fa23740483981db11a04d7b3f83)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:21:03.921584 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2256589-8470-4b99-a9fe-2a7e4bfc3da6 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:21:03.977702 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-a2256589-8470-4b99-a9fe-2a7e4bfc3da6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '164b2fa23740483981db11a04d7b3f83'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:21:03.984898 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-a2256589-8470-4b99-a9fe-2a7e4bfc3da6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '164b2fa23740483981db11a04d7b3f83'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:21:03.985593 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-a2256589-8470-4b99-a9fe-2a7e4bfc3da6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '164b2fa23740483981db11a04d7b3f83'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:21:03.995014 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-a2256589-8470-4b99-a9fe-2a7e4bfc3da6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '164b2fa23740483981db11a04d7b3f83'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:21:03.995634 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-a2256589-8470-4b99-a9fe-2a7e4bfc3da6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '164b2fa23740483981db11a04d7b3f83'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:21:04.017416 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1382/2752] 10.222.0.36 () {58 vars in 1223 bytes} [Tue May 3 14:21:03 2022] DELETE /identity/v3/users/164b2fa23740483981db11a04d7b3f83 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:21:04.022154 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73ff4fa-acdd-4860-85df-d972926b97e9 None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:21:04.022694 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73ff4fa-acdd-4860-85df-d972926b97e9 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:21:04.022694 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73ff4fa-acdd-4860-85df-d972926b97e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:21:04.040034 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-e73ff4fa-acdd-4860-85df-d972926b97e9 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:21:04.041256 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-e73ff4fa-acdd-4860-85df-d972926b97e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:21:04.100989 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1371/2753] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:21:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 14:21:04.112000 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2256589-8470-4b99-a9fe-2a7e4bfc3da6 admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:21:04.114302 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-a2256589-8470-4b99-a9fe-2a7e4bfc3da6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:21:04.181853 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2256589-8470-4b99-a9fe-2a7e4bfc3da6 admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:21:04.186369 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e82300a-917b-4432-bf3a-e6f175d86214 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '937bea4f355144b4a7ee11baabc3a4cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:21:04.187045 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e82300a-917b-4432-bf3a-e6f175d86214 service neutron] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:21:04.187319 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e82300a-917b-4432-bf3a-e6f175d86214 service neutron] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:21:04.187591 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e82300a-917b-4432-bf3a-e6f175d86214 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:21:04.197095 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e82300a-917b-4432-bf3a-e6f175d86214 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:21:04.198573 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e82300a-917b-4432-bf3a-e6f175d86214 service neutron] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:21:04.208174 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1383/2754] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:21:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 14:21:04.483269 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73ff4fa-acdd-4860-85df-d972926b97e9 None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:21:04.484804 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-e73ff4fa-acdd-4860-85df-d972926b97e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:21:04.497088 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73ff4fa-acdd-4860-85df-d972926b97e9 None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:21:04.502342 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f45da9-c198-46bf-a483-298592cead6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:21:04.503213 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f45da9-c198-46bf-a483-298592cead6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:21:04.503487 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f45da9-c198-46bf-a483-298592cead6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:21:04.503771 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f45da9-c198-46bf-a483-298592cead6d admin admin] PATH_INFO: `/v3/projects/04d964a6673c41ee9c55c7d3e96ff09d` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:21:04.505073 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f45da9-c198-46bf-a483-298592cead6d admin admin] RBAC: Authorizing `identity:delete_project(project_id=04d964a6673c41ee9c55c7d3e96ff09d)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:21:04.506992 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f45da9-c198-46bf-a483-298592cead6d admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:21:04.559133 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-a7f45da9-c198-46bf-a483-298592cead6d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04d964a6673c41ee9c55c7d3e96ff09d', 'request_id': 'req-a7f45da9-c198-46bf-a483-298592cead6d'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:21:04.565854 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-a7f45da9-c198-46bf-a483-298592cead6d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04d964a6673c41ee9c55c7d3e96ff09d', 'request_id': 'req-a7f45da9-c198-46bf-a483-298592cead6d'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:21:04.571137 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-a7f45da9-c198-46bf-a483-298592cead6d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04d964a6673c41ee9c55c7d3e96ff09d', 'request_id': 'req-a7f45da9-c198-46bf-a483-298592cead6d'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:21:04.584437 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-a7f45da9-c198-46bf-a483-298592cead6d admin admin] The token cache is being invalidate because project 04d964a6673c41ee9c55c7d3e96ff09d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80012) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 14:21:04.584753 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-a7f45da9-c198-46bf-a483-298592cead6d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:21:04.585418 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-a7f45da9-c198-46bf-a483-298592cead6d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:21:04.587044 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1372/2755] 10.222.0.36 () {58 vars in 1232 bytes} [Tue May 3 14:21:04 2022] DELETE /identity/v3/projects/04d964a6673c41ee9c55c7d3e96ff09d => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:21:04.591953 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8d1dfd-7879-47e9-9944-e29a15404d2b None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:21:04.592234 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8d1dfd-7879-47e9-9944-e29a15404d2b None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:21:04.592473 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8d1dfd-7879-47e9-9944-e29a15404d2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:21:04.610516 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-ac8d1dfd-7879-47e9-9944-e29a15404d2b None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:21:04.611654 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-ac8d1dfd-7879-47e9-9944-e29a15404d2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:21:04.668630 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1384/2756] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:21:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 14:21:04.676531 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a844751-7a2e-433b-b975-35bdb2c8b391 None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:21:04.676814 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a844751-7a2e-433b-b975-35bdb2c8b391 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:21:04.677085 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a844751-7a2e-433b-b975-35bdb2c8b391 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:21:04.696409 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-7a844751-7a2e-433b-b975-35bdb2c8b391 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:21:04.697604 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-7a844751-7a2e-433b-b975-35bdb2c8b391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:21:04.706005 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1373/2757] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:21:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 14:21:04.711105 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8d1dfd-7879-47e9-9944-e29a15404d2b None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:21:04.726578 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8d1dfd-7879-47e9-9944-e29a15404d2b None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:21:04.734746 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e12bfb-9d99-40a9-a2fc-6edd832bad17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:21:04.735406 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e12bfb-9d99-40a9-a2fc-6edd832bad17 admin admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:21:04.735684 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e12bfb-9d99-40a9-a2fc-6edd832bad17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:21:04.735958 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e12bfb-9d99-40a9-a2fc-6edd832bad17 admin admin] PATH_INFO: `/v3/domains` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:21:04.736685 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e12bfb-9d99-40a9-a2fc-6edd832bad17 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:21:04.736986 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e12bfb-9d99-40a9-a2fc-6edd832bad17 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:21:04.738634 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e12bfb-9d99-40a9-a2fc-6edd832bad17 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:21:04.750259 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1385/2758] 10.222.0.36 () {58 vars in 1152 bytes} [Tue May 3 14:21:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:21:04.754579 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a844751-7a2e-433b-b975-35bdb2c8b391 None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:21:04.764149 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a844751-7a2e-433b-b975-35bdb2c8b391 None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:21:04.769694 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8933d5a-9c30-4975-ade2-acbf66d895a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:21:04.770334 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8933d5a-9c30-4975-ade2-acbf66d895a3 admin admin] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:21:04.770610 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8933d5a-9c30-4975-ade2-acbf66d895a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:21:04.770882 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8933d5a-9c30-4975-ade2-acbf66d895a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:21:04.771559 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8933d5a-9c30-4975-ade2-acbf66d895a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:21:04.773499 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8933d5a-9c30-4975-ade2-acbf66d895a3 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:21:04.800964 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1374/2759] 10.222.0.36 () {60 vars in 1152 bytes} [Tue May 3 14:21:04 2022] POST /identity/v3/projects => generated 383 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 14:21:04.805405 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e12bfb-9d99-40a9-a2fc-6edd832bad17 admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:21:04.815510 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e12bfb-9d99-40a9-a2fc-6edd832bad17 admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:21:04.875919 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62861911-8df8-4518-adc5-4fb23127a6e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:21:04.876608 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62861911-8df8-4518-adc5-4fb23127a6e6 admin admin] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:21:04.876793 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62861911-8df8-4518-adc5-4fb23127a6e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:21:04.877058 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62861911-8df8-4518-adc5-4fb23127a6e6 admin admin] PATH_INFO: `/v3/users` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:21:04.877798 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62861911-8df8-4518-adc5-4fb23127a6e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:21:04.879899 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62861911-8df8-4518-adc5-4fb23127a6e6 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:21:04.905843 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1386/2760] 10.222.0.36 () {60 vars in 1143 bytes} [Tue May 3 14:21:04 2022] POST /identity/v3/users => generated 292 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 14:21:04.910034 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8933d5a-9c30-4975-ade2-acbf66d895a3 admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:21:04.920762 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8933d5a-9c30-4975-ade2-acbf66d895a3 admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:21:04.926361 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8decb849-ad2d-4878-b154-606d56993744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:21:04.927059 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8decb849-ad2d-4878-b154-606d56993744 admin admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:21:04.927341 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8decb849-ad2d-4878-b154-606d56993744 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:21:04.927620 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8decb849-ad2d-4878-b154-606d56993744 admin admin] PATH_INFO: `/v3/roles` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:21:04.928357 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8decb849-ad2d-4878-b154-606d56993744 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:21:04.930076 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8decb849-ad2d-4878-b154-606d56993744 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:21:04.940744 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1375/2761] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 3 14:21:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 14:21:04.944775 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62861911-8df8-4518-adc5-4fb23127a6e6 admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:21:04.955770 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62861911-8df8-4518-adc5-4fb23127a6e6 admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:21:04.962294 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f61264d-c847-4df7-8862-d0de585baa2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:21:04.962975 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f61264d-c847-4df7-8862-d0de585baa2a admin admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:21:04.963251 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f61264d-c847-4df7-8862-d0de585baa2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:21:04.963518 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f61264d-c847-4df7-8862-d0de585baa2a admin admin] PATH_INFO: `/v3/roles` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:21:04.964241 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f61264d-c847-4df7-8862-d0de585baa2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:21:04.965894 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f61264d-c847-4df7-8862-d0de585baa2a admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:21:04.976781 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1387/2762] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 3 14:21:04 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 14:21:04.981038 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8decb849-ad2d-4878-b154-606d56993744 admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:21:04.992314 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8decb849-ad2d-4878-b154-606d56993744 admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:21:04.997946 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bc5428-25c0-49bd-8747-9975e2fefe24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:21:04.998815 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bc5428-25c0-49bd-8747-9975e2fefe24 admin admin] REQUEST_METHOD: `PUT` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:21:04.999092 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bc5428-25c0-49bd-8747-9975e2fefe24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:21:04.999494 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bc5428-25c0-49bd-8747-9975e2fefe24 admin admin] PATH_INFO: `/v3/projects/800464d9744445e29abb29373b137696/users/d714c945c77544d3907226762ffcdba0/roles/441fdc11e95b47f4813f72610e39018b` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:21:05.015483 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bc5428-25c0-49bd-8747-9975e2fefe24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=800464d9744445e29abb29373b137696, user_id=d714c945c77544d3907226762ffcdba0, role_id=441fdc11e95b47f4813f72610e39018b)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:21:05.018228 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bc5428-25c0-49bd-8747-9975e2fefe24 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:21:05.033574 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1376/2763] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 3 14:21:04 2022] PUT /identity/v3/projects/800464d9744445e29abb29373b137696/users/d714c945c77544d3907226762ffcdba0/roles/441fdc11e95b47f4813f72610e39018b => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:21:05.038913 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35b572b-f21d-487d-a15d-1421f25bfd9a None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:21:05.039198 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35b572b-f21d-487d-a15d-1421f25bfd9a None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:21:05.039473 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35b572b-f21d-487d-a15d-1421f25bfd9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:21:05.058916 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-d35b572b-f21d-487d-a15d-1421f25bfd9a None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:21:05.060117 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-d35b572b-f21d-487d-a15d-1421f25bfd9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:21:05.123226 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1388/2764] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:21:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:21:05.133581 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bc5428-25c0-49bd-8747-9975e2fefe24 admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:21:05.135517 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-e7bc5428-25c0-49bd-8747-9975e2fefe24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:21:05.191789 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bc5428-25c0-49bd-8747-9975e2fefe24 admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:21:05.195540 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e215277-5a29-4ebe-bac8-1908f5716fe5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '937bea4f355144b4a7ee11baabc3a4cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:21:05.196199 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e215277-5a29-4ebe-bac8-1908f5716fe5 service neutron] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:21:05.196491 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e215277-5a29-4ebe-bac8-1908f5716fe5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:21:05.196754 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e215277-5a29-4ebe-bac8-1908f5716fe5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:21:05.206925 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e215277-5a29-4ebe-bac8-1908f5716fe5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:21:05.209712 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e215277-5a29-4ebe-bac8-1908f5716fe5 service neutron] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:21:05.223200 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1377/2765] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:21:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 14:21:05.847819 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844f6d95-c5e1-4159-8f9e-f05e56ebac32 None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:21:05.848085 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844f6d95-c5e1-4159-8f9e-f05e56ebac32 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:21:05.848368 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844f6d95-c5e1-4159-8f9e-f05e56ebac32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:21:05.875149 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-844f6d95-c5e1-4159-8f9e-f05e56ebac32 None None] MFA Rules not processed for user `d714c945c77544d3907226762ffcdba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:21:05.876360 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-844f6d95-c5e1-4159-8f9e-f05e56ebac32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:21:05.940131 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1389/2766] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:21:05 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:21:05.950877 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e215277-5a29-4ebe-bac8-1908f5716fe5 service neutron] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:21:05.952528 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-2e215277-5a29-4ebe-bac8-1908f5716fe5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:21:06.008024 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e215277-5a29-4ebe-bac8-1908f5716fe5 service neutron] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:21:06.011686 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d613fb8d-3138-4e56-8ead-62fd7c4b80f5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b014f4c7ba1414cb8a597f5bc4033f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:21:06.012335 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d613fb8d-3138-4e56-8ead-62fd7c4b80f5 service cinder] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:21:06.012606 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d613fb8d-3138-4e56-8ead-62fd7c4b80f5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:21:06.012884 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d613fb8d-3138-4e56-8ead-62fd7c4b80f5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:21:06.021569 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d613fb8d-3138-4e56-8ead-62fd7c4b80f5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:21:06.022987 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d613fb8d-3138-4e56-8ead-62fd7c4b80f5 service cinder] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:21:06.031646 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1378/2767] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:21:05 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 14:21:07.441041 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d749575-2b71-424b-9479-54bce15a1c63 None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:21:07.441720 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d749575-2b71-424b-9479-54bce15a1c63 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:21:07.441720 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d749575-2b71-424b-9479-54bce15a1c63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:21:07.469143 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-7d749575-2b71-424b-9479-54bce15a1c63 None None] MFA Rules not processed for user `d714c945c77544d3907226762ffcdba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:21:07.470398 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-7d749575-2b71-424b-9479-54bce15a1c63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:21:07.477256 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1390/2768] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:21:07 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:21:07.712344 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d613fb8d-3138-4e56-8ead-62fd7c4b80f5 service cinder] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:21:07.728882 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d613fb8d-3138-4e56-8ead-62fd7c4b80f5 service cinder] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:21:07.735288 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c31c89-ca6c-4a0c-990d-be27c49755f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '937bea4f355144b4a7ee11baabc3a4cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:21:07.735932 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c31c89-ca6c-4a0c-990d-be27c49755f2 service neutron] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:21:07.736214 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c31c89-ca6c-4a0c-990d-be27c49755f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:21:07.736490 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c31c89-ca6c-4a0c-990d-be27c49755f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:21:07.738527 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-26c31c89-ca6c-4a0c-990d-be27c49755f2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:21:07.748800 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c31c89-ca6c-4a0c-990d-be27c49755f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:21:07.750566 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c31c89-ca6c-4a0c-990d-be27c49755f2 service neutron] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:21:07.758869 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1379/2769] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:21:07 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 14:21:59.552764 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d749575-2b71-424b-9479-54bce15a1c63 None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:21:59.554389 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-7d749575-2b71-424b-9479-54bce15a1c63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:21:59.626974 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d749575-2b71-424b-9479-54bce15a1c63 None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:21:59.631981 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0755a4-95b7-4560-a599-371fb04a80c8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '164c7f36acf644e9bf93f158e876e9e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:21:59.633267 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0755a4-95b7-4560-a599-371fb04a80c8 service placement] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:21:59.633582 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0755a4-95b7-4560-a599-371fb04a80c8 service placement] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:21:59.633830 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0755a4-95b7-4560-a599-371fb04a80c8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:21:59.635646 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-4a0755a4-95b7-4560-a599-371fb04a80c8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:21:59.648336 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0755a4-95b7-4560-a599-371fb04a80c8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:21:59.649963 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0755a4-95b7-4560-a599-371fb04a80c8 service placement] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:21:59.660436 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1391/2770] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:21:59 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 14:22:08.471442 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285f7b81-a9a3-4dee-920a-6fdb5736a152 None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:22:08.472402 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285f7b81-a9a3-4dee-920a-6fdb5736a152 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:22:08.472709 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285f7b81-a9a3-4dee-920a-6fdb5736a152 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:22:08.490309 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-285f7b81-a9a3-4dee-920a-6fdb5736a152 None None] MFA Rules not processed for user `d714c945c77544d3907226762ffcdba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:22:08.491562 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-285f7b81-a9a3-4dee-920a-6fdb5736a152 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:22:08.498944 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1380/2771] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:22:08 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:22:46.435694 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0755a4-95b7-4560-a599-371fb04a80c8 service placement] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:22:46.446245 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0755a4-95b7-4560-a599-371fb04a80c8 service placement] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:22:46.451556 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3504ae8b-9af9-48cd-bf94-3e846c1ae06b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '937bea4f355144b4a7ee11baabc3a4cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:22:46.452249 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3504ae8b-9af9-48cd-bf94-3e846c1ae06b service neutron] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:22:46.452547 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3504ae8b-9af9-48cd-bf94-3e846c1ae06b service neutron] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:22:46.453038 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3504ae8b-9af9-48cd-bf94-3e846c1ae06b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:22:46.455482 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-3504ae8b-9af9-48cd-bf94-3e846c1ae06b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:22:46.468911 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3504ae8b-9af9-48cd-bf94-3e846c1ae06b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:22:46.470386 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3504ae8b-9af9-48cd-bf94-3e846c1ae06b service neutron] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:22:46.480506 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1392/2772] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:22:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 14:22:52.873120 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285f7b81-a9a3-4dee-920a-6fdb5736a152 None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:22:52.874802 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-285f7b81-a9a3-4dee-920a-6fdb5736a152 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:22:52.893422 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285f7b81-a9a3-4dee-920a-6fdb5736a152 None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:22:52.898426 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c3f60a-9f6e-4b09-8473-824483e552af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:22:52.899320 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c3f60a-9f6e-4b09-8473-824483e552af admin admin] REQUEST_METHOD: `DELETE` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:22:52.899599 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c3f60a-9f6e-4b09-8473-824483e552af admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:22:52.899873 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c3f60a-9f6e-4b09-8473-824483e552af admin admin] PATH_INFO: `/v3/users/7b05c6d36153485c9859ce7b749ab40c` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:22:52.901108 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c3f60a-9f6e-4b09-8473-824483e552af admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b05c6d36153485c9859ce7b749ab40c)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:22:52.903070 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c3f60a-9f6e-4b09-8473-824483e552af admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:22:52.957707 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-e5c3f60a-9f6e-4b09-8473-824483e552af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b05c6d36153485c9859ce7b749ab40c'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:22:52.964550 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-e5c3f60a-9f6e-4b09-8473-824483e552af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b05c6d36153485c9859ce7b749ab40c'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:22:52.965221 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-e5c3f60a-9f6e-4b09-8473-824483e552af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b05c6d36153485c9859ce7b749ab40c'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:22:52.976055 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-e5c3f60a-9f6e-4b09-8473-824483e552af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b05c6d36153485c9859ce7b749ab40c'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:22:52.976663 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-e5c3f60a-9f6e-4b09-8473-824483e552af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b05c6d36153485c9859ce7b749ab40c'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:22:52.990543 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1381/2773] 10.222.0.36 () {58 vars in 1223 bytes} [Tue May 3 14:22:52 2022] DELETE /identity/v3/users/7b05c6d36153485c9859ce7b749ab40c => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 14:22:53.163408 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3504ae8b-9af9-48cd-bf94-3e846c1ae06b service neutron] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:22:53.175728 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3504ae8b-9af9-48cd-bf94-3e846c1ae06b service neutron] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:22:53.241453 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b9b2be-306a-4e34-bf6c-1566a7776c7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:22:53.242347 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b9b2be-306a-4e34-bf6c-1566a7776c7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:22:53.242591 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b9b2be-306a-4e34-bf6c-1566a7776c7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:22:53.242885 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b9b2be-306a-4e34-bf6c-1566a7776c7c admin admin] PATH_INFO: `/v3/projects/593f1ab9823f41ffa40d6155bebaca54` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:22:53.244076 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b9b2be-306a-4e34-bf6c-1566a7776c7c admin admin] RBAC: Authorizing `identity:delete_project(project_id=593f1ab9823f41ffa40d6155bebaca54)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:22:53.246165 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b9b2be-306a-4e34-bf6c-1566a7776c7c admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:22:53.294657 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-e2b9b2be-306a-4e34-bf6c-1566a7776c7c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '593f1ab9823f41ffa40d6155bebaca54', 'request_id': 'req-e2b9b2be-306a-4e34-bf6c-1566a7776c7c'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:22:53.300485 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-e2b9b2be-306a-4e34-bf6c-1566a7776c7c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '593f1ab9823f41ffa40d6155bebaca54', 'request_id': 'req-e2b9b2be-306a-4e34-bf6c-1566a7776c7c'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:22:53.309850 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-e2b9b2be-306a-4e34-bf6c-1566a7776c7c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '593f1ab9823f41ffa40d6155bebaca54', 'request_id': 'req-e2b9b2be-306a-4e34-bf6c-1566a7776c7c'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:22:53.320674 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-e2b9b2be-306a-4e34-bf6c-1566a7776c7c admin admin] The token cache is being invalidate because project 593f1ab9823f41ffa40d6155bebaca54 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80013) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 14:22:53.320957 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-e2b9b2be-306a-4e34-bf6c-1566a7776c7c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:22:53.321699 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-e2b9b2be-306a-4e34-bf6c-1566a7776c7c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:22:53.323369 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1393/2774] 10.222.0.36 () {58 vars in 1232 bytes} [Tue May 3 14:22:53 2022] DELETE /identity/v3/projects/593f1ab9823f41ffa40d6155bebaca54 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:22:53.327398 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c3f60a-9f6e-4b09-8473-824483e552af admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:22:53.329046 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-e5c3f60a-9f6e-4b09-8473-824483e552af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:22:53.342397 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c3f60a-9f6e-4b09-8473-824483e552af admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:22:53.398591 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943413fb-b33a-43ce-a848-06dc7e79f4fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:22:53.399415 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943413fb-b33a-43ce-a848-06dc7e79f4fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:22:53.399693 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943413fb-b33a-43ce-a848-06dc7e79f4fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:22:53.399966 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943413fb-b33a-43ce-a848-06dc7e79f4fd admin admin] PATH_INFO: `/v3/users/2c31897e0bc3457f8ef1586524540e30` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:22:53.401163 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943413fb-b33a-43ce-a848-06dc7e79f4fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c31897e0bc3457f8ef1586524540e30)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:22:53.403131 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943413fb-b33a-43ce-a848-06dc7e79f4fd admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:22:53.451148 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-943413fb-b33a-43ce-a848-06dc7e79f4fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c31897e0bc3457f8ef1586524540e30'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:22:53.458610 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-943413fb-b33a-43ce-a848-06dc7e79f4fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c31897e0bc3457f8ef1586524540e30'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:22:53.459693 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-943413fb-b33a-43ce-a848-06dc7e79f4fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c31897e0bc3457f8ef1586524540e30'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:22:53.472241 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-943413fb-b33a-43ce-a848-06dc7e79f4fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c31897e0bc3457f8ef1586524540e30'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:22:53.472910 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-943413fb-b33a-43ce-a848-06dc7e79f4fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c31897e0bc3457f8ef1586524540e30'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:22:53.487100 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1382/2775] 10.222.0.36 () {58 vars in 1223 bytes} [Tue May 3 14:22:53 2022] DELETE /identity/v3/users/2c31897e0bc3457f8ef1586524540e30 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:22:53.668657 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b9b2be-306a-4e34-bf6c-1566a7776c7c admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:22:53.670117 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-e2b9b2be-306a-4e34-bf6c-1566a7776c7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:22:53.683584 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b9b2be-306a-4e34-bf6c-1566a7776c7c admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:22:53.746297 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0627d3-e015-4ce1-bcda-5b9cd46e30c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:22:53.747184 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0627d3-e015-4ce1-bcda-5b9cd46e30c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:22:53.747466 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0627d3-e015-4ce1-bcda-5b9cd46e30c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:22:53.747753 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0627d3-e015-4ce1-bcda-5b9cd46e30c4 admin admin] PATH_INFO: `/v3/projects/d0b764ea593b465881fef7937cf6ac86` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:22:53.748985 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0627d3-e015-4ce1-bcda-5b9cd46e30c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0b764ea593b465881fef7937cf6ac86)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:22:53.751010 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0627d3-e015-4ce1-bcda-5b9cd46e30c4 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:22:53.807085 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-0b0627d3-e015-4ce1-bcda-5b9cd46e30c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0b764ea593b465881fef7937cf6ac86', 'request_id': 'req-0b0627d3-e015-4ce1-bcda-5b9cd46e30c4'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:22:53.814566 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-0b0627d3-e015-4ce1-bcda-5b9cd46e30c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0b764ea593b465881fef7937cf6ac86', 'request_id': 'req-0b0627d3-e015-4ce1-bcda-5b9cd46e30c4'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:22:53.824832 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-0b0627d3-e015-4ce1-bcda-5b9cd46e30c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0b764ea593b465881fef7937cf6ac86', 'request_id': 'req-0b0627d3-e015-4ce1-bcda-5b9cd46e30c4'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:22:53.836342 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-0b0627d3-e015-4ce1-bcda-5b9cd46e30c4 admin admin] The token cache is being invalidate because project d0b764ea593b465881fef7937cf6ac86 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80013) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 14:22:53.836621 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-0b0627d3-e015-4ce1-bcda-5b9cd46e30c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:22:53.837309 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-0b0627d3-e015-4ce1-bcda-5b9cd46e30c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:22:53.838898 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1394/2776] 10.222.0.36 () {58 vars in 1232 bytes} [Tue May 3 14:22:53 2022] DELETE /identity/v3/projects/d0b764ea593b465881fef7937cf6ac86 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:23:05.374634 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943413fb-b33a-43ce-a848-06dc7e79f4fd admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:23:05.376138 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-943413fb-b33a-43ce-a848-06dc7e79f4fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:23:05.389654 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943413fb-b33a-43ce-a848-06dc7e79f4fd admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:23:05.445723 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913dcbfc-150d-4fa9-9aed-031e04220227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:23:05.446617 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913dcbfc-150d-4fa9-9aed-031e04220227 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:23:05.446896 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913dcbfc-150d-4fa9-9aed-031e04220227 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:23:05.447171 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913dcbfc-150d-4fa9-9aed-031e04220227 admin admin] PATH_INFO: `/v3/users/d714c945c77544d3907226762ffcdba0` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:23:05.448394 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913dcbfc-150d-4fa9-9aed-031e04220227 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d714c945c77544d3907226762ffcdba0)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:23:05.450351 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913dcbfc-150d-4fa9-9aed-031e04220227 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:23:05.499356 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-913dcbfc-150d-4fa9-9aed-031e04220227 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd714c945c77544d3907226762ffcdba0'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:23:05.505951 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-913dcbfc-150d-4fa9-9aed-031e04220227 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd714c945c77544d3907226762ffcdba0'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:23:05.506625 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-913dcbfc-150d-4fa9-9aed-031e04220227 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd714c945c77544d3907226762ffcdba0'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:23:05.518589 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-913dcbfc-150d-4fa9-9aed-031e04220227 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd714c945c77544d3907226762ffcdba0'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:23:05.519274 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-913dcbfc-150d-4fa9-9aed-031e04220227 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd714c945c77544d3907226762ffcdba0'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:23:05.534604 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1383/2777] 10.222.0.36 () {58 vars in 1223 bytes} [Tue May 3 14:23:05 2022] DELETE /identity/v3/users/d714c945c77544d3907226762ffcdba0 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:23:05.707587 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0627d3-e015-4ce1-bcda-5b9cd46e30c4 admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:23:05.709481 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-0b0627d3-e015-4ce1-bcda-5b9cd46e30c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:23:05.722958 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0627d3-e015-4ce1-bcda-5b9cd46e30c4 admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:23:05.781476 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89e0721-e978-4a3e-8582-6d14ca2d2149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:23:05.782306 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89e0721-e978-4a3e-8582-6d14ca2d2149 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:23:05.782581 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89e0721-e978-4a3e-8582-6d14ca2d2149 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:23:05.782859 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89e0721-e978-4a3e-8582-6d14ca2d2149 admin admin] PATH_INFO: `/v3/projects/800464d9744445e29abb29373b137696` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:23:05.784396 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89e0721-e978-4a3e-8582-6d14ca2d2149 admin admin] RBAC: Authorizing `identity:delete_project(project_id=800464d9744445e29abb29373b137696)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:23:05.786293 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89e0721-e978-4a3e-8582-6d14ca2d2149 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:23:05.832341 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-f89e0721-e978-4a3e-8582-6d14ca2d2149 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '800464d9744445e29abb29373b137696', 'request_id': 'req-f89e0721-e978-4a3e-8582-6d14ca2d2149'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:23:05.838383 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-f89e0721-e978-4a3e-8582-6d14ca2d2149 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '800464d9744445e29abb29373b137696', 'request_id': 'req-f89e0721-e978-4a3e-8582-6d14ca2d2149'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:23:05.846730 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-f89e0721-e978-4a3e-8582-6d14ca2d2149 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '800464d9744445e29abb29373b137696', 'request_id': 'req-f89e0721-e978-4a3e-8582-6d14ca2d2149'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:23:05.858085 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-f89e0721-e978-4a3e-8582-6d14ca2d2149 admin admin] The token cache is being invalidate because project 800464d9744445e29abb29373b137696 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80013) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 14:23:05.858366 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-f89e0721-e978-4a3e-8582-6d14ca2d2149 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:23:05.859033 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-f89e0721-e978-4a3e-8582-6d14ca2d2149 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:23:05.860566 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1395/2778] 10.222.0.36 () {58 vars in 1232 bytes} [Tue May 3 14:23:05 2022] DELETE /identity/v3/projects/800464d9744445e29abb29373b137696 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:23:05.969557 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913dcbfc-150d-4fa9-9aed-031e04220227 admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:23:05.971079 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-913dcbfc-150d-4fa9-9aed-031e04220227 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:23:06.034685 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913dcbfc-150d-4fa9-9aed-031e04220227 admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:23:06.100548 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13818f1-9bd9-4b87-96d7-cea5d205b751 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '937bea4f355144b4a7ee11baabc3a4cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:23:06.101242 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13818f1-9bd9-4b87-96d7-cea5d205b751 service neutron] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:23:06.101678 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13818f1-9bd9-4b87-96d7-cea5d205b751 service neutron] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:23:06.101963 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13818f1-9bd9-4b87-96d7-cea5d205b751 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:23:06.105588 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-f13818f1-9bd9-4b87-96d7-cea5d205b751 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:23:06.174124 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13818f1-9bd9-4b87-96d7-cea5d205b751 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:23:06.175569 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13818f1-9bd9-4b87-96d7-cea5d205b751 service neutron] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:23:06.186884 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1384/2779] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:23:05 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 14:23:09.621846 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb57971-f3d9-4e49-bab0-48b6ae3f0feb None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:23:09.622420 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb57971-f3d9-4e49-bab0-48b6ae3f0feb None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:23:09.622420 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb57971-f3d9-4e49-bab0-48b6ae3f0feb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:23:09.640642 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-6bb57971-f3d9-4e49-bab0-48b6ae3f0feb None None] MFA Rules not processed for user `9318e1ed873345c983c0e9fcfd89f4ce`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:23:09.641898 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-6bb57971-f3d9-4e49-bab0-48b6ae3f0feb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:23:09.699647 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1396/2780] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:23:09 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:23:09.738976 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13818f1-9bd9-4b87-96d7-cea5d205b751 service neutron] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:23:09.740579 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-f13818f1-9bd9-4b87-96d7-cea5d205b751 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:23:09.798320 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13818f1-9bd9-4b87-96d7-cea5d205b751 service neutron] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:23:09.802400 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6c8bd1-de82-42a2-8f49-3ef4a88852a2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '616de5e7daed46849efc75ad77ea054e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:23:09.803049 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6c8bd1-de82-42a2-8f49-3ef4a88852a2 service glance] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:23:09.803323 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6c8bd1-de82-42a2-8f49-3ef4a88852a2 service glance] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:23:09.803594 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6c8bd1-de82-42a2-8f49-3ef4a88852a2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:23:09.805589 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-bb6c8bd1-de82-42a2-8f49-3ef4a88852a2 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:23:09.820365 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6c8bd1-de82-42a2-8f49-3ef4a88852a2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:23:09.821854 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6c8bd1-de82-42a2-8f49-3ef4a88852a2 service glance] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:23:09.833192 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1385/2781] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:23:09 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 14:23:10.431475 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb57971-f3d9-4e49-bab0-48b6ae3f0feb None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:23:10.433415 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-6bb57971-f3d9-4e49-bab0-48b6ae3f0feb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:23:10.522400 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb57971-f3d9-4e49-bab0-48b6ae3f0feb None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:23:10.528564 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f488677-fd12-49c6-999a-1f0a9a48d455 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '164c7f36acf644e9bf93f158e876e9e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:23:10.529214 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f488677-fd12-49c6-999a-1f0a9a48d455 service placement] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:23:10.529519 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f488677-fd12-49c6-999a-1f0a9a48d455 service placement] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:23:10.529790 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f488677-fd12-49c6-999a-1f0a9a48d455 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:23:10.531978 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-7f488677-fd12-49c6-999a-1f0a9a48d455 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:23:10.546647 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f488677-fd12-49c6-999a-1f0a9a48d455 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:23:10.548796 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f488677-fd12-49c6-999a-1f0a9a48d455 service placement] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:23:10.561610 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1397/2782] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:23:10 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 14:23:23.717174 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6c8bd1-de82-42a2-8f49-3ef4a88852a2 service glance] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:23:23.718865 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-bb6c8bd1-de82-42a2-8f49-3ef4a88852a2 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:23:23.731546 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6c8bd1-de82-42a2-8f49-3ef4a88852a2 service glance] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:23:23.735873 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfd242f-a9bc-4af9-b9c5-730eec82230a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '937bea4f355144b4a7ee11baabc3a4cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:23:23.736607 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfd242f-a9bc-4af9-b9c5-730eec82230a service neutron] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:23:23.736977 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfd242f-a9bc-4af9-b9c5-730eec82230a service neutron] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:23:23.737347 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfd242f-a9bc-4af9-b9c5-730eec82230a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:23:23.739352 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-9cfd242f-a9bc-4af9-b9c5-730eec82230a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:23:23.749736 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfd242f-a9bc-4af9-b9c5-730eec82230a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:23:23.751254 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfd242f-a9bc-4af9-b9c5-730eec82230a service neutron] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:23:23.759792 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1386/2783] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:23:23 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 14:24:20.119288 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f488677-fd12-49c6-999a-1f0a9a48d455 service placement] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:24:20.121360 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-7f488677-fd12-49c6-999a-1f0a9a48d455 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:24:20.146515 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f488677-fd12-49c6-999a-1f0a9a48d455 service placement] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:24:20.156700 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e191d59-bc4a-4669-9a3a-cd846ad5341a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63489e658c094a2598a2ac62159d2fda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:24:20.157661 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e191d59-bc4a-4669-9a3a-cd846ad5341a service nova] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:24:20.158065 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e191d59-bc4a-4669-9a3a-cd846ad5341a service nova] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:24:20.158251 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e191d59-bc4a-4669-9a3a-cd846ad5341a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:24:20.160181 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-3e191d59-bc4a-4669-9a3a-cd846ad5341a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:24:20.176193 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e191d59-bc4a-4669-9a3a-cd846ad5341a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:24:20.177966 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e191d59-bc4a-4669-9a3a-cd846ad5341a service nova] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:24:20.192359 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1398/2784] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:24:20 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 14:24:28.831026 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfd242f-a9bc-4af9-b9c5-730eec82230a service neutron] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:24:28.832700 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-9cfd242f-a9bc-4af9-b9c5-730eec82230a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:24:28.905546 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfd242f-a9bc-4af9-b9c5-730eec82230a service neutron] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:24:28.910334 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcf9d52-dc07-4751-87d2-25c204b7466a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:24:28.911223 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcf9d52-dc07-4751-87d2-25c204b7466a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:24:28.911505 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcf9d52-dc07-4751-87d2-25c204b7466a admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:24:28.911780 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcf9d52-dc07-4751-87d2-25c204b7466a admin admin] PATH_INFO: `/v3/users/9318e1ed873345c983c0e9fcfd89f4ce` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:24:28.912995 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcf9d52-dc07-4751-87d2-25c204b7466a admin admin] RBAC: Authorizing `identity:delete_user(user_id=9318e1ed873345c983c0e9fcfd89f4ce)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:24:28.914983 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcf9d52-dc07-4751-87d2-25c204b7466a admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:24:28.966392 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-6bcf9d52-dc07-4751-87d2-25c204b7466a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9318e1ed873345c983c0e9fcfd89f4ce'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:24:28.973460 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-6bcf9d52-dc07-4751-87d2-25c204b7466a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9318e1ed873345c983c0e9fcfd89f4ce'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:24:28.974114 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-6bcf9d52-dc07-4751-87d2-25c204b7466a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9318e1ed873345c983c0e9fcfd89f4ce'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:24:28.986083 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-6bcf9d52-dc07-4751-87d2-25c204b7466a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9318e1ed873345c983c0e9fcfd89f4ce'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:24:28.986761 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-6bcf9d52-dc07-4751-87d2-25c204b7466a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9318e1ed873345c983c0e9fcfd89f4ce'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:24:29.002560 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1387/2785] 10.222.0.36 () {58 vars in 1223 bytes} [Tue May 3 14:24:28 2022] DELETE /identity/v3/users/9318e1ed873345c983c0e9fcfd89f4ce => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:24:29.190119 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e191d59-bc4a-4669-9a3a-cd846ad5341a service nova] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:24:29.204219 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e191d59-bc4a-4669-9a3a-cd846ad5341a service nova] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:24:29.263482 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831a5141-d439-4b63-b314-97dd60c40552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:24:29.264268 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831a5141-d439-4b63-b314-97dd60c40552 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:24:29.264537 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831a5141-d439-4b63-b314-97dd60c40552 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:24:29.264806 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831a5141-d439-4b63-b314-97dd60c40552 admin admin] PATH_INFO: `/v3/projects/b16b4b1b92fd4f6dbb0e0cde810949db` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:24:29.266055 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831a5141-d439-4b63-b314-97dd60c40552 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b16b4b1b92fd4f6dbb0e0cde810949db)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:24:29.267962 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831a5141-d439-4b63-b314-97dd60c40552 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:24:29.314648 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-831a5141-d439-4b63-b314-97dd60c40552 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b16b4b1b92fd4f6dbb0e0cde810949db', 'request_id': 'req-831a5141-d439-4b63-b314-97dd60c40552'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:24:29.319811 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-831a5141-d439-4b63-b314-97dd60c40552 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b16b4b1b92fd4f6dbb0e0cde810949db', 'request_id': 'req-831a5141-d439-4b63-b314-97dd60c40552'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:24:29.329531 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-831a5141-d439-4b63-b314-97dd60c40552 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b16b4b1b92fd4f6dbb0e0cde810949db', 'request_id': 'req-831a5141-d439-4b63-b314-97dd60c40552'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:24:29.341280 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-831a5141-d439-4b63-b314-97dd60c40552 admin admin] The token cache is being invalidate because project b16b4b1b92fd4f6dbb0e0cde810949db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80013) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 14:24:29.341618 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-831a5141-d439-4b63-b314-97dd60c40552 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:24:29.342251 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-831a5141-d439-4b63-b314-97dd60c40552 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:24:29.343850 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1399/2786] 10.222.0.36 () {58 vars in 1232 bytes} [Tue May 3 14:24:29 2022] DELETE /identity/v3/projects/b16b4b1b92fd4f6dbb0e0cde810949db => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:24:29.349152 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013c48f7-cc49-496a-bbdb-b041698119c5 None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:24:29.349475 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013c48f7-cc49-496a-bbdb-b041698119c5 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:24:29.349754 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013c48f7-cc49-496a-bbdb-b041698119c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:24:29.367686 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-013c48f7-cc49-496a-bbdb-b041698119c5 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:24:29.368860 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-013c48f7-cc49-496a-bbdb-b041698119c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:24:29.430199 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1388/2787] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:24:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:24:29.439179 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d12528-f9ea-43d7-9d96-3b2ce90b8420 None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:24:29.439468 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d12528-f9ea-43d7-9d96-3b2ce90b8420 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:24:29.439740 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d12528-f9ea-43d7-9d96-3b2ce90b8420 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:24:29.459785 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-23d12528-f9ea-43d7-9d96-3b2ce90b8420 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:24:29.460983 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-23d12528-f9ea-43d7-9d96-3b2ce90b8420 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:24:29.470233 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1400/2788] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:24:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:24:29.474696 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013c48f7-cc49-496a-bbdb-b041698119c5 None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:24:29.484881 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013c48f7-cc49-496a-bbdb-b041698119c5 None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:24:29.490268 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de917cb-7b2a-4167-b88b-8fba38d2db93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:24:29.490942 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de917cb-7b2a-4167-b88b-8fba38d2db93 admin admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:24:29.491219 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de917cb-7b2a-4167-b88b-8fba38d2db93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:24:29.491494 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de917cb-7b2a-4167-b88b-8fba38d2db93 admin admin] PATH_INFO: `/v3/domains` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:24:29.492250 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de917cb-7b2a-4167-b88b-8fba38d2db93 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80012) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:24:29.492569 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de917cb-7b2a-4167-b88b-8fba38d2db93 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:24:29.494183 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de917cb-7b2a-4167-b88b-8fba38d2db93 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:24:29.506750 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1389/2789] 10.222.0.36 () {58 vars in 1152 bytes} [Tue May 3 14:24:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:24:29.512413 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d12528-f9ea-43d7-9d96-3b2ce90b8420 None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:24:29.527216 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d12528-f9ea-43d7-9d96-3b2ce90b8420 None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:24:29.535830 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd9ac65-03ef-44e2-a201-fdc5e38d91f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:24:29.536509 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd9ac65-03ef-44e2-a201-fdc5e38d91f7 admin admin] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:24:29.536780 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd9ac65-03ef-44e2-a201-fdc5e38d91f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:24:29.537045 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd9ac65-03ef-44e2-a201-fdc5e38d91f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:24:29.537765 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd9ac65-03ef-44e2-a201-fdc5e38d91f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:24:29.539698 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd9ac65-03ef-44e2-a201-fdc5e38d91f7 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:24:29.567633 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1401/2790] 10.222.0.36 () {60 vars in 1152 bytes} [Tue May 3 14:24:29 2022] POST /identity/v3/projects => generated 363 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 14:24:29.573942 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de917cb-7b2a-4167-b88b-8fba38d2db93 admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:24:29.589054 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de917cb-7b2a-4167-b88b-8fba38d2db93 admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:24:29.651459 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0fb6b7-bce7-49bb-a7c8-6a6e2f02daf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:24:29.652128 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0fb6b7-bce7-49bb-a7c8-6a6e2f02daf1 admin admin] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:24:29.652402 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0fb6b7-bce7-49bb-a7c8-6a6e2f02daf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:24:29.652675 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0fb6b7-bce7-49bb-a7c8-6a6e2f02daf1 admin admin] PATH_INFO: `/v3/users` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:24:29.653394 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0fb6b7-bce7-49bb-a7c8-6a6e2f02daf1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:24:29.655296 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0fb6b7-bce7-49bb-a7c8-6a6e2f02daf1 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:24:29.678840 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1390/2791] 10.222.0.36 () {60 vars in 1143 bytes} [Tue May 3 14:24:29 2022] POST /identity/v3/users => generated 282 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 14:24:29.683437 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd9ac65-03ef-44e2-a201-fdc5e38d91f7 admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:24:29.696845 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd9ac65-03ef-44e2-a201-fdc5e38d91f7 admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:24:29.701517 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78ce3fb-4034-412f-915b-8ef2320ee495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:24:29.702184 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78ce3fb-4034-412f-915b-8ef2320ee495 admin admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:24:29.702463 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78ce3fb-4034-412f-915b-8ef2320ee495 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:24:29.702737 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78ce3fb-4034-412f-915b-8ef2320ee495 admin admin] PATH_INFO: `/v3/roles` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:24:29.703516 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78ce3fb-4034-412f-915b-8ef2320ee495 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:24:29.705165 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78ce3fb-4034-412f-915b-8ef2320ee495 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:24:29.717557 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1402/2792] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 3 14:24:29 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 14:24:29.721845 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0fb6b7-bce7-49bb-a7c8-6a6e2f02daf1 admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:24:29.732916 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0fb6b7-bce7-49bb-a7c8-6a6e2f02daf1 admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:24:29.739801 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75dac1b-eff1-4fe9-9c93-a14c76e795c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:24:29.740468 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75dac1b-eff1-4fe9-9c93-a14c76e795c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:24:29.740744 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75dac1b-eff1-4fe9-9c93-a14c76e795c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:24:29.741013 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75dac1b-eff1-4fe9-9c93-a14c76e795c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:24:29.741773 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75dac1b-eff1-4fe9-9c93-a14c76e795c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:24:29.743368 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75dac1b-eff1-4fe9-9c93-a14c76e795c3 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:24:29.756097 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1391/2793] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 3 14:24:29 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 14:24:29.760575 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78ce3fb-4034-412f-915b-8ef2320ee495 admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:24:29.771659 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78ce3fb-4034-412f-915b-8ef2320ee495 admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:24:29.778292 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a97237f-29dd-4279-8f99-a6671a092113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:24:29.779120 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a97237f-29dd-4279-8f99-a6671a092113 admin admin] REQUEST_METHOD: `PUT` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:24:29.779394 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a97237f-29dd-4279-8f99-a6671a092113 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:24:29.779661 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a97237f-29dd-4279-8f99-a6671a092113 admin admin] PATH_INFO: `/v3/projects/fc3fa0b78a9b4d72bb8ac7302c4a4b2f/users/2a4e42421a084ea39d4e690ac0463d0c/roles/441fdc11e95b47f4813f72610e39018b` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:24:29.796009 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a97237f-29dd-4279-8f99-a6671a092113 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc3fa0b78a9b4d72bb8ac7302c4a4b2f, user_id=2a4e42421a084ea39d4e690ac0463d0c, role_id=441fdc11e95b47f4813f72610e39018b)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:24:29.798756 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a97237f-29dd-4279-8f99-a6671a092113 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:24:29.816166 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1403/2794] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 3 14:24:29 2022] PUT /identity/v3/projects/fc3fa0b78a9b4d72bb8ac7302c4a4b2f/users/2a4e42421a084ea39d4e690ac0463d0c/roles/441fdc11e95b47f4813f72610e39018b => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:24:29.827655 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab3c231-5332-4e39-a30c-875de65d3f53 None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:24:29.828128 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab3c231-5332-4e39-a30c-875de65d3f53 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:24:29.828538 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab3c231-5332-4e39-a30c-875de65d3f53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:24:29.862453 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-2ab3c231-5332-4e39-a30c-875de65d3f53 None None] MFA Rules not processed for user `2a4e42421a084ea39d4e690ac0463d0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:24:29.863702 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-2ab3c231-5332-4e39-a30c-875de65d3f53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:24:29.931762 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1392/2795] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:24:29 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:24:29.936528 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a97237f-29dd-4279-8f99-a6671a092113 admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:24:30.000807 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a97237f-29dd-4279-8f99-a6671a092113 admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:24:30.005792 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352611f8-ca31-4bbc-a49e-29db4eb84804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:24:30.006442 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352611f8-ca31-4bbc-a49e-29db4eb84804 admin admin] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:24:30.006725 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352611f8-ca31-4bbc-a49e-29db4eb84804 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:24:30.006998 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352611f8-ca31-4bbc-a49e-29db4eb84804 admin admin] PATH_INFO: `/v3/projects` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:24:30.007701 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352611f8-ca31-4bbc-a49e-29db4eb84804 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:24:30.009637 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352611f8-ca31-4bbc-a49e-29db4eb84804 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:24:30.040531 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1404/2796] 10.222.0.36 () {60 vars in 1152 bytes} [Tue May 3 14:24:29 2022] POST /identity/v3/projects => generated 363 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 14:24:30.044738 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab3c231-5332-4e39-a30c-875de65d3f53 None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:24:30.057061 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab3c231-5332-4e39-a30c-875de65d3f53 None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:24:30.114849 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a15651-f16f-4410-af84-d50ff51c631b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:24:30.115532 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a15651-f16f-4410-af84-d50ff51c631b admin admin] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:24:30.115815 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a15651-f16f-4410-af84-d50ff51c631b admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:24:30.116089 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a15651-f16f-4410-af84-d50ff51c631b admin admin] PATH_INFO: `/v3/users` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:24:30.116787 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a15651-f16f-4410-af84-d50ff51c631b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:24:30.118872 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a15651-f16f-4410-af84-d50ff51c631b admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:24:30.144833 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1393/2797] 10.222.0.36 () {60 vars in 1143 bytes} [Tue May 3 14:24:30 2022] POST /identity/v3/users => generated 288 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 14:24:30.149706 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352611f8-ca31-4bbc-a49e-29db4eb84804 admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:24:30.160879 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352611f8-ca31-4bbc-a49e-29db4eb84804 admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:24:30.166235 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dbcd09-64f1-42f3-b220-6ce6e699b23c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:24:30.166914 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dbcd09-64f1-42f3-b220-6ce6e699b23c admin admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:24:30.167188 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dbcd09-64f1-42f3-b220-6ce6e699b23c admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:24:30.167469 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dbcd09-64f1-42f3-b220-6ce6e699b23c admin admin] PATH_INFO: `/v3/roles` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:24:30.168198 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dbcd09-64f1-42f3-b220-6ce6e699b23c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:24:30.169870 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dbcd09-64f1-42f3-b220-6ce6e699b23c admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:24:30.180867 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1405/2798] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 3 14:24:30 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 14:24:30.185139 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a15651-f16f-4410-af84-d50ff51c631b admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:24:30.195516 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a15651-f16f-4410-af84-d50ff51c631b admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:24:30.201378 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e38edf4-a79a-40bc-824f-6c5434eb2952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:24:30.202291 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e38edf4-a79a-40bc-824f-6c5434eb2952 admin admin] REQUEST_METHOD: `PUT` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:24:30.202568 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e38edf4-a79a-40bc-824f-6c5434eb2952 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:24:30.202839 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e38edf4-a79a-40bc-824f-6c5434eb2952 admin admin] PATH_INFO: `/v3/projects/3f1a72923f7046d298c18a6636b56f76/users/b5bfa95093ec461b8c85a6e1402cf996/roles/36abe9b50fd8479c86c4f8f70fd85aa3` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:24:30.218754 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e38edf4-a79a-40bc-824f-6c5434eb2952 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f1a72923f7046d298c18a6636b56f76, user_id=b5bfa95093ec461b8c85a6e1402cf996, role_id=36abe9b50fd8479c86c4f8f70fd85aa3)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:24:30.221605 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e38edf4-a79a-40bc-824f-6c5434eb2952 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:24:30.236823 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1394/2799] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 3 14:24:30 2022] PUT /identity/v3/projects/3f1a72923f7046d298c18a6636b56f76/users/b5bfa95093ec461b8c85a6e1402cf996/roles/36abe9b50fd8479c86c4f8f70fd85aa3 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:24:30.241132 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dbcd09-64f1-42f3-b220-6ce6e699b23c admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:24:30.251314 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dbcd09-64f1-42f3-b220-6ce6e699b23c admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:24:30.309597 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5e1dfc-1390-4f00-a992-bdc9bd58c348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:24:30.310290 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5e1dfc-1390-4f00-a992-bdc9bd58c348 admin admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:24:30.310566 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5e1dfc-1390-4f00-a992-bdc9bd58c348 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:24:30.310835 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5e1dfc-1390-4f00-a992-bdc9bd58c348 admin admin] PATH_INFO: `/v3/roles` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:24:30.311682 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5e1dfc-1390-4f00-a992-bdc9bd58c348 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:24:30.313277 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5e1dfc-1390-4f00-a992-bdc9bd58c348 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:24:30.324821 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1406/2800] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 3 14:24:30 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 14:24:30.329877 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e38edf4-a79a-40bc-824f-6c5434eb2952 admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:24:30.346323 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e38edf4-a79a-40bc-824f-6c5434eb2952 admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:24:30.352393 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f335c5c8-3c2f-49d0-bc33-cd63a7d6379e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:24:30.353299 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f335c5c8-3c2f-49d0-bc33-cd63a7d6379e admin admin] REQUEST_METHOD: `PUT` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:24:30.353592 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f335c5c8-3c2f-49d0-bc33-cd63a7d6379e admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:24:30.353867 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f335c5c8-3c2f-49d0-bc33-cd63a7d6379e admin admin] PATH_INFO: `/v3/projects/3f1a72923f7046d298c18a6636b56f76/users/b5bfa95093ec461b8c85a6e1402cf996/roles/36abe9b50fd8479c86c4f8f70fd85aa3` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:24:30.355959 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f335c5c8-3c2f-49d0-bc33-cd63a7d6379e admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f1a72923f7046d298c18a6636b56f76, user_id=b5bfa95093ec461b8c85a6e1402cf996, role_id=36abe9b50fd8479c86c4f8f70fd85aa3)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:24:30.358933 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f335c5c8-3c2f-49d0-bc33-cd63a7d6379e admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:24:30.369219 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1395/2801] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 3 14:24:30 2022] PUT /identity/v3/projects/3f1a72923f7046d298c18a6636b56f76/users/b5bfa95093ec461b8c85a6e1402cf996/roles/36abe9b50fd8479c86c4f8f70fd85aa3 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:24:30.379593 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a142ec-9203-4b95-9166-fd052a682179 None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:24:30.379881 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a142ec-9203-4b95-9166-fd052a682179 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:24:30.380153 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a142ec-9203-4b95-9166-fd052a682179 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:24:30.407475 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-c1a142ec-9203-4b95-9166-fd052a682179 None None] MFA Rules not processed for user `b5bfa95093ec461b8c85a6e1402cf996`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:24:30.408666 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-c1a142ec-9203-4b95-9166-fd052a682179 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:24:30.513688 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1407/2802] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:24:30 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:24:30.526465 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f335c5c8-3c2f-49d0-bc33-cd63a7d6379e admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:24:30.528458 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-f335c5c8-3c2f-49d0-bc33-cd63a7d6379e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:24:30.588189 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f335c5c8-3c2f-49d0-bc33-cd63a7d6379e admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:24:30.592207 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97346338-2bfa-4eda-b948-a3c38bb144f6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b014f4c7ba1414cb8a597f5bc4033f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:24:30.592875 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97346338-2bfa-4eda-b948-a3c38bb144f6 service cinder] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:24:30.593149 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97346338-2bfa-4eda-b948-a3c38bb144f6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:24:30.593450 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97346338-2bfa-4eda-b948-a3c38bb144f6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:24:30.603043 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97346338-2bfa-4eda-b948-a3c38bb144f6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:24:30.604482 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97346338-2bfa-4eda-b948-a3c38bb144f6 service cinder] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:24:30.614233 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1396/2803] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:24:30 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 14:24:30.691804 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a142ec-9203-4b95-9166-fd052a682179 None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:24:30.702645 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a142ec-9203-4b95-9166-fd052a682179 None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:24:30.707850 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52205ff4-0e33-4ca7-a6d2-70cf49451dcb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b014f4c7ba1414cb8a597f5bc4033f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:24:30.708497 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52205ff4-0e33-4ca7-a6d2-70cf49451dcb service cinder] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:24:30.708778 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52205ff4-0e33-4ca7-a6d2-70cf49451dcb service cinder] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:24:30.709432 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52205ff4-0e33-4ca7-a6d2-70cf49451dcb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:24:30.768013 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52205ff4-0e33-4ca7-a6d2-70cf49451dcb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:24:30.769552 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52205ff4-0e33-4ca7-a6d2-70cf49451dcb service cinder] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:24:30.781464 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1408/2804] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:24:30 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 14:24:40.036708 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97346338-2bfa-4eda-b948-a3c38bb144f6 service cinder] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:24:40.100476 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97346338-2bfa-4eda-b948-a3c38bb144f6 service cinder] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:24:40.105461 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f266e1-1828-4a2e-8cac-02e97cefded5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:24:40.106341 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f266e1-1828-4a2e-8cac-02e97cefded5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:24:40.106621 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f266e1-1828-4a2e-8cac-02e97cefded5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:24:40.106872 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f266e1-1828-4a2e-8cac-02e97cefded5 admin admin] PATH_INFO: `/v3/users/2a4e42421a084ea39d4e690ac0463d0c` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:24:40.108158 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f266e1-1828-4a2e-8cac-02e97cefded5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a4e42421a084ea39d4e690ac0463d0c)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:24:40.110037 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f266e1-1828-4a2e-8cac-02e97cefded5 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:24:40.163043 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-49f266e1-1828-4a2e-8cac-02e97cefded5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a4e42421a084ea39d4e690ac0463d0c'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:24:40.169754 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-49f266e1-1828-4a2e-8cac-02e97cefded5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a4e42421a084ea39d4e690ac0463d0c'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:24:40.170433 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-49f266e1-1828-4a2e-8cac-02e97cefded5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a4e42421a084ea39d4e690ac0463d0c'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:24:40.181889 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-49f266e1-1828-4a2e-8cac-02e97cefded5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a4e42421a084ea39d4e690ac0463d0c'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:24:40.182590 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-49f266e1-1828-4a2e-8cac-02e97cefded5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a4e42421a084ea39d4e690ac0463d0c'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:24:40.197380 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1397/2805] 10.222.0.36 () {58 vars in 1223 bytes} [Tue May 3 14:24:40 2022] DELETE /identity/v3/users/2a4e42421a084ea39d4e690ac0463d0c => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:24:40.202105 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f4ae2a-61bb-4b88-8a10-e63745cf79e6 None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:24:40.202602 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f4ae2a-61bb-4b88-8a10-e63745cf79e6 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:24:40.202708 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f4ae2a-61bb-4b88-8a10-e63745cf79e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:24:40.220847 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-02f4ae2a-61bb-4b88-8a10-e63745cf79e6 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:24:40.222125 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-02f4ae2a-61bb-4b88-8a10-e63745cf79e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:24:40.285689 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1409/2806] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:24:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:24:40.299893 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f266e1-1828-4a2e-8cac-02e97cefded5 admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:24:40.302234 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-49f266e1-1828-4a2e-8cac-02e97cefded5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:24:40.369273 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f266e1-1828-4a2e-8cac-02e97cefded5 admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:24:40.373340 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cb4308-3d3b-4ea8-b537-333178bf1155 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '937bea4f355144b4a7ee11baabc3a4cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:24:40.374009 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cb4308-3d3b-4ea8-b537-333178bf1155 service neutron] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:24:40.374289 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cb4308-3d3b-4ea8-b537-333178bf1155 service neutron] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:24:40.374561 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cb4308-3d3b-4ea8-b537-333178bf1155 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:24:40.383637 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cb4308-3d3b-4ea8-b537-333178bf1155 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:24:40.385050 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cb4308-3d3b-4ea8-b537-333178bf1155 service neutron] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:24:40.394542 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1398/2807] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:24:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 14:24:40.670737 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f4ae2a-61bb-4b88-8a10-e63745cf79e6 None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:24:40.672378 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-02f4ae2a-61bb-4b88-8a10-e63745cf79e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:24:40.685674 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f4ae2a-61bb-4b88-8a10-e63745cf79e6 None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:24:40.690334 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574d09d9-61e8-4a49-8a76-e386867dc79a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:24:40.691257 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574d09d9-61e8-4a49-8a76-e386867dc79a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:24:40.691536 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574d09d9-61e8-4a49-8a76-e386867dc79a admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:24:40.691813 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574d09d9-61e8-4a49-8a76-e386867dc79a admin admin] PATH_INFO: `/v3/projects/fc3fa0b78a9b4d72bb8ac7302c4a4b2f` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:24:40.693104 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574d09d9-61e8-4a49-8a76-e386867dc79a admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc3fa0b78a9b4d72bb8ac7302c4a4b2f)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:24:40.695137 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574d09d9-61e8-4a49-8a76-e386867dc79a admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:24:40.743660 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-574d09d9-61e8-4a49-8a76-e386867dc79a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc3fa0b78a9b4d72bb8ac7302c4a4b2f', 'request_id': 'req-574d09d9-61e8-4a49-8a76-e386867dc79a'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:24:40.749057 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-574d09d9-61e8-4a49-8a76-e386867dc79a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc3fa0b78a9b4d72bb8ac7302c4a4b2f', 'request_id': 'req-574d09d9-61e8-4a49-8a76-e386867dc79a'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:24:40.757671 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-574d09d9-61e8-4a49-8a76-e386867dc79a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc3fa0b78a9b4d72bb8ac7302c4a4b2f', 'request_id': 'req-574d09d9-61e8-4a49-8a76-e386867dc79a'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:24:40.769405 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-574d09d9-61e8-4a49-8a76-e386867dc79a admin admin] The token cache is being invalidate because project fc3fa0b78a9b4d72bb8ac7302c4a4b2f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80013) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 14:24:40.769664 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-574d09d9-61e8-4a49-8a76-e386867dc79a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:24:40.770369 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-574d09d9-61e8-4a49-8a76-e386867dc79a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:24:40.772102 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1410/2808] 10.222.0.36 () {58 vars in 1232 bytes} [Tue May 3 14:24:40 2022] DELETE /identity/v3/projects/fc3fa0b78a9b4d72bb8ac7302c4a4b2f => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:24:40.776938 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cb4308-3d3b-4ea8-b537-333178bf1155 service neutron] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:24:40.786782 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cb4308-3d3b-4ea8-b537-333178bf1155 service neutron] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:24:40.848427 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca72969c-1ff3-4ec3-96ac-a3b7896bc30c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:24:40.849319 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca72969c-1ff3-4ec3-96ac-a3b7896bc30c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:24:40.849606 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca72969c-1ff3-4ec3-96ac-a3b7896bc30c admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:24:40.849877 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca72969c-1ff3-4ec3-96ac-a3b7896bc30c admin admin] PATH_INFO: `/v3/users/b5bfa95093ec461b8c85a6e1402cf996` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:24:40.851088 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca72969c-1ff3-4ec3-96ac-a3b7896bc30c admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5bfa95093ec461b8c85a6e1402cf996)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:24:40.853061 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca72969c-1ff3-4ec3-96ac-a3b7896bc30c admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:24:40.902383 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-ca72969c-1ff3-4ec3-96ac-a3b7896bc30c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5bfa95093ec461b8c85a6e1402cf996'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:24:40.909006 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-ca72969c-1ff3-4ec3-96ac-a3b7896bc30c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5bfa95093ec461b8c85a6e1402cf996'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:24:40.909790 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-ca72969c-1ff3-4ec3-96ac-a3b7896bc30c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5bfa95093ec461b8c85a6e1402cf996'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:24:40.922209 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-ca72969c-1ff3-4ec3-96ac-a3b7896bc30c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5bfa95093ec461b8c85a6e1402cf996'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:24:40.922811 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-ca72969c-1ff3-4ec3-96ac-a3b7896bc30c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5bfa95093ec461b8c85a6e1402cf996'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:24:40.937449 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1399/2809] 10.222.0.36 () {58 vars in 1223 bytes} [Tue May 3 14:24:40 2022] DELETE /identity/v3/users/b5bfa95093ec461b8c85a6e1402cf996 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 14:24:41.232658 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574d09d9-61e8-4a49-8a76-e386867dc79a admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:24:41.234238 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-574d09d9-61e8-4a49-8a76-e386867dc79a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:24:41.251541 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574d09d9-61e8-4a49-8a76-e386867dc79a admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:24:41.308925 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea74a5ad-0c88-444d-94b6-19b4f6d6d158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:24:41.309824 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea74a5ad-0c88-444d-94b6-19b4f6d6d158 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:24:41.310102 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea74a5ad-0c88-444d-94b6-19b4f6d6d158 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:24:41.310377 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea74a5ad-0c88-444d-94b6-19b4f6d6d158 admin admin] PATH_INFO: `/v3/projects/3f1a72923f7046d298c18a6636b56f76` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:24:41.311561 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea74a5ad-0c88-444d-94b6-19b4f6d6d158 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f1a72923f7046d298c18a6636b56f76)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:24:41.313533 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea74a5ad-0c88-444d-94b6-19b4f6d6d158 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:24:41.362501 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-ea74a5ad-0c88-444d-94b6-19b4f6d6d158 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f1a72923f7046d298c18a6636b56f76', 'request_id': 'req-ea74a5ad-0c88-444d-94b6-19b4f6d6d158'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:24:41.367684 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-ea74a5ad-0c88-444d-94b6-19b4f6d6d158 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f1a72923f7046d298c18a6636b56f76', 'request_id': 'req-ea74a5ad-0c88-444d-94b6-19b4f6d6d158'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:24:41.376828 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-ea74a5ad-0c88-444d-94b6-19b4f6d6d158 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f1a72923f7046d298c18a6636b56f76', 'request_id': 'req-ea74a5ad-0c88-444d-94b6-19b4f6d6d158'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:24:41.388238 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-ea74a5ad-0c88-444d-94b6-19b4f6d6d158 admin admin] The token cache is being invalidate because project 3f1a72923f7046d298c18a6636b56f76 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80013) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 14:24:41.388535 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-ea74a5ad-0c88-444d-94b6-19b4f6d6d158 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:24:41.389156 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-ea74a5ad-0c88-444d-94b6-19b4f6d6d158 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:24:41.390831 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1411/2810] 10.222.0.36 () {58 vars in 1232 bytes} [Tue May 3 14:24:41 2022] DELETE /identity/v3/projects/3f1a72923f7046d298c18a6636b56f76 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:24:41.397561 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e96923-688d-443a-8120-a74cb34aa472 None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:24:41.398063 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e96923-688d-443a-8120-a74cb34aa472 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:24:41.398192 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e96923-688d-443a-8120-a74cb34aa472 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:24:41.416009 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-54e96923-688d-443a-8120-a74cb34aa472 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:24:41.417196 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-54e96923-688d-443a-8120-a74cb34aa472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:24:41.480655 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1400/2811] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:24:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:24:41.489920 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a351d5a-2c8b-4172-9b41-7b4f2cfe4e82 None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:24:41.490213 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a351d5a-2c8b-4172-9b41-7b4f2cfe4e82 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:24:41.490490 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a351d5a-2c8b-4172-9b41-7b4f2cfe4e82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:24:41.515555 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-3a351d5a-2c8b-4172-9b41-7b4f2cfe4e82 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:24:41.516775 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-3a351d5a-2c8b-4172-9b41-7b4f2cfe4e82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:24:41.526680 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1412/2812] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:24:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:24:41.531534 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e96923-688d-443a-8120-a74cb34aa472 None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:24:41.542075 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e96923-688d-443a-8120-a74cb34aa472 None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:24:41.547951 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8ec03d-dbd7-49b5-95f4-7d419ce8a90e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:24:41.548466 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8ec03d-dbd7-49b5-95f4-7d419ce8a90e admin admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:24:41.548744 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8ec03d-dbd7-49b5-95f4-7d419ce8a90e admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:24:41.549017 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8ec03d-dbd7-49b5-95f4-7d419ce8a90e admin admin] PATH_INFO: `/v3/domains` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:24:41.549784 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8ec03d-dbd7-49b5-95f4-7d419ce8a90e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80012) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:24:41.550075 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8ec03d-dbd7-49b5-95f4-7d419ce8a90e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:24:41.551716 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8ec03d-dbd7-49b5-95f4-7d419ce8a90e admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:24:41.563651 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1401/2813] 10.222.0.36 () {58 vars in 1152 bytes} [Tue May 3 14:24:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:24:41.568361 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a351d5a-2c8b-4172-9b41-7b4f2cfe4e82 None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:24:41.578035 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a351d5a-2c8b-4172-9b41-7b4f2cfe4e82 None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:24:41.583947 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d229882-530c-4578-95c2-1a4cd590fcb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:24:41.584946 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d229882-530c-4578-95c2-1a4cd590fcb0 admin admin] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:24:41.585237 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d229882-530c-4578-95c2-1a4cd590fcb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:24:41.585511 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d229882-530c-4578-95c2-1a4cd590fcb0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:24:41.586192 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d229882-530c-4578-95c2-1a4cd590fcb0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:24:41.588110 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d229882-530c-4578-95c2-1a4cd590fcb0 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:24:41.617036 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1413/2814] 10.222.0.36 () {60 vars in 1152 bytes} [Tue May 3 14:24:41 2022] POST /identity/v3/projects => generated 389 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 14:24:41.621436 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8ec03d-dbd7-49b5-95f4-7d419ce8a90e admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:24:41.632015 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8ec03d-dbd7-49b5-95f4-7d419ce8a90e admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:24:41.691925 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fec3cc-e2ac-43b7-afa4-795d320f9179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:24:41.692609 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fec3cc-e2ac-43b7-afa4-795d320f9179 admin admin] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:24:41.692888 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fec3cc-e2ac-43b7-afa4-795d320f9179 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:24:41.693164 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fec3cc-e2ac-43b7-afa4-795d320f9179 admin admin] PATH_INFO: `/v3/users` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:24:41.693935 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fec3cc-e2ac-43b7-afa4-795d320f9179 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:24:41.696287 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fec3cc-e2ac-43b7-afa4-795d320f9179 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:24:41.721321 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1402/2815] 10.222.0.36 () {60 vars in 1143 bytes} [Tue May 3 14:24:41 2022] POST /identity/v3/users => generated 295 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 14:24:41.725600 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d229882-530c-4578-95c2-1a4cd590fcb0 admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:24:41.737060 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d229882-530c-4578-95c2-1a4cd590fcb0 admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:24:41.742179 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e62175-aecf-4435-b7cf-f8497c16e430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:24:41.742918 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e62175-aecf-4435-b7cf-f8497c16e430 admin admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:24:41.743196 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e62175-aecf-4435-b7cf-f8497c16e430 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:24:41.743498 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e62175-aecf-4435-b7cf-f8497c16e430 admin admin] PATH_INFO: `/v3/roles` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:24:41.744284 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e62175-aecf-4435-b7cf-f8497c16e430 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:24:41.745963 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e62175-aecf-4435-b7cf-f8497c16e430 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:24:41.759551 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1414/2816] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 3 14:24:41 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 14:24:41.764884 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fec3cc-e2ac-43b7-afa4-795d320f9179 admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:24:41.776225 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fec3cc-e2ac-43b7-afa4-795d320f9179 admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:24:41.782190 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fec688-2826-40a2-9e90-e90e85e9205a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:24:41.782885 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fec688-2826-40a2-9e90-e90e85e9205a admin admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:24:41.783257 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fec688-2826-40a2-9e90-e90e85e9205a admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:24:41.783519 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fec688-2826-40a2-9e90-e90e85e9205a admin admin] PATH_INFO: `/v3/roles` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:24:41.784285 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fec688-2826-40a2-9e90-e90e85e9205a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:24:41.785957 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fec688-2826-40a2-9e90-e90e85e9205a admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:24:41.797632 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1403/2817] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 3 14:24:41 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 14:24:41.801889 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e62175-aecf-4435-b7cf-f8497c16e430 admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:24:41.812728 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e62175-aecf-4435-b7cf-f8497c16e430 admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:24:41.818609 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6b201a-a783-4e28-bd27-74f99995b9ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:24:41.819515 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6b201a-a783-4e28-bd27-74f99995b9ba admin admin] REQUEST_METHOD: `PUT` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:24:41.819805 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6b201a-a783-4e28-bd27-74f99995b9ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:24:41.820054 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6b201a-a783-4e28-bd27-74f99995b9ba admin admin] PATH_INFO: `/v3/projects/ec1e356ea2804cb2b10cd1a5f987dbb5/users/6eac6a14d7b8444f8204b36a5207380a/roles/441fdc11e95b47f4813f72610e39018b` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:24:41.836634 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6b201a-a783-4e28-bd27-74f99995b9ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec1e356ea2804cb2b10cd1a5f987dbb5, user_id=6eac6a14d7b8444f8204b36a5207380a, role_id=441fdc11e95b47f4813f72610e39018b)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:24:41.839504 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6b201a-a783-4e28-bd27-74f99995b9ba admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:24:41.856188 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1415/2818] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 3 14:24:41 2022] PUT /identity/v3/projects/ec1e356ea2804cb2b10cd1a5f987dbb5/users/6eac6a14d7b8444f8204b36a5207380a/roles/441fdc11e95b47f4813f72610e39018b => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:24:41.867477 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28d13a6-5c7a-4f8f-aaad-26412dc60bf6 None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:24:41.867968 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28d13a6-5c7a-4f8f-aaad-26412dc60bf6 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:24:41.868249 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28d13a6-5c7a-4f8f-aaad-26412dc60bf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:24:41.896632 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-e28d13a6-5c7a-4f8f-aaad-26412dc60bf6 None None] MFA Rules not processed for user `6eac6a14d7b8444f8204b36a5207380a`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:24:41.897882 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-e28d13a6-5c7a-4f8f-aaad-26412dc60bf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:24:41.973978 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1404/2819] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:24:41 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:24:41.978641 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6b201a-a783-4e28-bd27-74f99995b9ba admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:24:42.043750 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6b201a-a783-4e28-bd27-74f99995b9ba admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:24:42.048895 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5f700f-7d3d-4968-80b8-e319633db7ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:24:42.049619 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5f700f-7d3d-4968-80b8-e319633db7ce admin admin] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:24:42.049870 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5f700f-7d3d-4968-80b8-e319633db7ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:24:42.050148 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5f700f-7d3d-4968-80b8-e319633db7ce admin admin] PATH_INFO: `/v3/projects` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:24:42.050839 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5f700f-7d3d-4968-80b8-e319633db7ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:24:42.052752 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5f700f-7d3d-4968-80b8-e319633db7ce admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:24:42.081303 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1416/2820] 10.222.0.36 () {60 vars in 1152 bytes} [Tue May 3 14:24:41 2022] POST /identity/v3/projects => generated 387 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 14:24:42.085892 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28d13a6-5c7a-4f8f-aaad-26412dc60bf6 None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:24:42.097410 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28d13a6-5c7a-4f8f-aaad-26412dc60bf6 None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:24:42.157688 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99eaf541-bd7b-4e21-a44c-f1793e0a9f09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:24:42.158355 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eaf541-bd7b-4e21-a44c-f1793e0a9f09 admin admin] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:24:42.158634 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eaf541-bd7b-4e21-a44c-f1793e0a9f09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:24:42.158907 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eaf541-bd7b-4e21-a44c-f1793e0a9f09 admin admin] PATH_INFO: `/v3/users` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:24:42.159584 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99eaf541-bd7b-4e21-a44c-f1793e0a9f09 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:24:42.161519 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99eaf541-bd7b-4e21-a44c-f1793e0a9f09 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:24:42.182670 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1405/2821] 10.222.0.36 () {60 vars in 1143 bytes} [Tue May 3 14:24:42 2022] POST /identity/v3/users => generated 300 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 14:24:42.186801 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5f700f-7d3d-4968-80b8-e319633db7ce admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:24:42.197623 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5f700f-7d3d-4968-80b8-e319633db7ce admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:24:42.202692 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88c1495-9c69-4fd5-87c0-fc433ec4eabe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:24:42.203333 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88c1495-9c69-4fd5-87c0-fc433ec4eabe admin admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:24:42.203610 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88c1495-9c69-4fd5-87c0-fc433ec4eabe admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:24:42.203880 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88c1495-9c69-4fd5-87c0-fc433ec4eabe admin admin] PATH_INFO: `/v3/roles` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:24:42.204598 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88c1495-9c69-4fd5-87c0-fc433ec4eabe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:24:42.206231 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88c1495-9c69-4fd5-87c0-fc433ec4eabe admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:24:42.217170 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1417/2822] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 3 14:24:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 14:24:42.221605 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99eaf541-bd7b-4e21-a44c-f1793e0a9f09 admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:24:42.232347 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99eaf541-bd7b-4e21-a44c-f1793e0a9f09 admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:24:42.237960 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82189d4c-a9ae-47bd-809c-10fbb115f9cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:24:42.238887 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82189d4c-a9ae-47bd-809c-10fbb115f9cf admin admin] REQUEST_METHOD: `PUT` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:24:42.239171 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82189d4c-a9ae-47bd-809c-10fbb115f9cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:24:42.239446 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82189d4c-a9ae-47bd-809c-10fbb115f9cf admin admin] PATH_INFO: `/v3/projects/0b027e1790214b41a17765106420b0d1/users/d954846f8fdf4cb6b127457d09c2dded/roles/36abe9b50fd8479c86c4f8f70fd85aa3` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:24:42.253888 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82189d4c-a9ae-47bd-809c-10fbb115f9cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b027e1790214b41a17765106420b0d1, user_id=d954846f8fdf4cb6b127457d09c2dded, role_id=36abe9b50fd8479c86c4f8f70fd85aa3)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:24:42.256554 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82189d4c-a9ae-47bd-809c-10fbb115f9cf admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:24:42.271202 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1406/2823] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 3 14:24:42 2022] PUT /identity/v3/projects/0b027e1790214b41a17765106420b0d1/users/d954846f8fdf4cb6b127457d09c2dded/roles/36abe9b50fd8479c86c4f8f70fd85aa3 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:24:42.275256 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88c1495-9c69-4fd5-87c0-fc433ec4eabe admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:24:42.285062 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88c1495-9c69-4fd5-87c0-fc433ec4eabe admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:24:42.346465 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb245c3a-177e-422c-a6b1-8dc10b01a6c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:24:42.347139 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb245c3a-177e-422c-a6b1-8dc10b01a6c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:24:42.347449 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb245c3a-177e-422c-a6b1-8dc10b01a6c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:24:42.347749 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb245c3a-177e-422c-a6b1-8dc10b01a6c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:24:42.348532 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb245c3a-177e-422c-a6b1-8dc10b01a6c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:24:42.350328 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb245c3a-177e-422c-a6b1-8dc10b01a6c8 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:24:42.360440 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1418/2824] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 3 14:24:42 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 14:24:42.366548 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82189d4c-a9ae-47bd-809c-10fbb115f9cf admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:24:42.381964 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82189d4c-a9ae-47bd-809c-10fbb115f9cf admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:24:42.387128 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9176075d-d380-484b-b455-3c7a5fd751b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:24:42.388006 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9176075d-d380-484b-b455-3c7a5fd751b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:24:42.388288 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9176075d-d380-484b-b455-3c7a5fd751b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:24:42.388564 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9176075d-d380-484b-b455-3c7a5fd751b5 admin admin] PATH_INFO: `/v3/projects/0b027e1790214b41a17765106420b0d1/users/d954846f8fdf4cb6b127457d09c2dded/roles/36abe9b50fd8479c86c4f8f70fd85aa3` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:24:42.390564 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9176075d-d380-484b-b455-3c7a5fd751b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b027e1790214b41a17765106420b0d1, user_id=d954846f8fdf4cb6b127457d09c2dded, role_id=36abe9b50fd8479c86c4f8f70fd85aa3)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:24:42.393202 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9176075d-d380-484b-b455-3c7a5fd751b5 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:24:42.403129 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1407/2825] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 3 14:24:42 2022] PUT /identity/v3/projects/0b027e1790214b41a17765106420b0d1/users/d954846f8fdf4cb6b127457d09c2dded/roles/36abe9b50fd8479c86c4f8f70fd85aa3 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:24:42.414817 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7fb5d4-a6c2-475c-aef1-9c15a0eb6a07 None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:24:42.415118 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7fb5d4-a6c2-475c-aef1-9c15a0eb6a07 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:24:42.415424 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7fb5d4-a6c2-475c-aef1-9c15a0eb6a07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:24:42.441670 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-ee7fb5d4-a6c2-475c-aef1-9c15a0eb6a07 None None] MFA Rules not processed for user `d954846f8fdf4cb6b127457d09c2dded`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:24:42.442868 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-ee7fb5d4-a6c2-475c-aef1-9c15a0eb6a07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:24:42.514418 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1419/2826] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:24:42 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:24:42.526811 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9176075d-d380-484b-b455-3c7a5fd751b5 admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:24:42.529920 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-9176075d-d380-484b-b455-3c7a5fd751b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:24:42.599458 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9176075d-d380-484b-b455-3c7a5fd751b5 admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:24:42.603493 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10a3c42-7f48-41d9-81d8-f8166af59dcd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b014f4c7ba1414cb8a597f5bc4033f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:24:42.604130 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10a3c42-7f48-41d9-81d8-f8166af59dcd service cinder] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:24:42.604409 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10a3c42-7f48-41d9-81d8-f8166af59dcd service cinder] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:24:42.604677 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10a3c42-7f48-41d9-81d8-f8166af59dcd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:24:42.613924 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10a3c42-7f48-41d9-81d8-f8166af59dcd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:24:42.615347 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10a3c42-7f48-41d9-81d8-f8166af59dcd service cinder] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:24:42.624680 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1408/2827] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:24:42 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 14:24:42.771011 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7fb5d4-a6c2-475c-aef1-9c15a0eb6a07 None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:24:42.835835 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7fb5d4-a6c2-475c-aef1-9c15a0eb6a07 None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:24:42.840852 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4af391-3d51-4cef-8fb7-bbae08c54867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:24:42.841761 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4af391-3d51-4cef-8fb7-bbae08c54867 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:24:42.842019 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4af391-3d51-4cef-8fb7-bbae08c54867 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:24:42.842305 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4af391-3d51-4cef-8fb7-bbae08c54867 admin admin] PATH_INFO: `/v3/users/6eac6a14d7b8444f8204b36a5207380a` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:24:42.843520 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4af391-3d51-4cef-8fb7-bbae08c54867 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6eac6a14d7b8444f8204b36a5207380a)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:24:42.845460 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4af391-3d51-4cef-8fb7-bbae08c54867 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:24:42.898800 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-2a4af391-3d51-4cef-8fb7-bbae08c54867 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6eac6a14d7b8444f8204b36a5207380a'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:24:42.905782 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-2a4af391-3d51-4cef-8fb7-bbae08c54867 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6eac6a14d7b8444f8204b36a5207380a'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:24:42.906455 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-2a4af391-3d51-4cef-8fb7-bbae08c54867 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6eac6a14d7b8444f8204b36a5207380a'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:24:42.915512 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-2a4af391-3d51-4cef-8fb7-bbae08c54867 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6eac6a14d7b8444f8204b36a5207380a'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:24:42.916090 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-2a4af391-3d51-4cef-8fb7-bbae08c54867 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6eac6a14d7b8444f8204b36a5207380a'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:24:42.932999 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1420/2828] 10.222.0.36 () {58 vars in 1223 bytes} [Tue May 3 14:24:42 2022] DELETE /identity/v3/users/6eac6a14d7b8444f8204b36a5207380a => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:24:42.937745 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e411859-9b26-4c3b-a7a2-7e3004f5c1e9 None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:24:42.938034 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e411859-9b26-4c3b-a7a2-7e3004f5c1e9 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:24:42.938314 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e411859-9b26-4c3b-a7a2-7e3004f5c1e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:24:42.955822 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-7e411859-9b26-4c3b-a7a2-7e3004f5c1e9 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:24:42.957059 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-7e411859-9b26-4c3b-a7a2-7e3004f5c1e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:24:43.034925 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1409/2829] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:24:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:24:43.048384 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4af391-3d51-4cef-8fb7-bbae08c54867 admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:24:43.050707 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-2a4af391-3d51-4cef-8fb7-bbae08c54867 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:24:43.119115 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4af391-3d51-4cef-8fb7-bbae08c54867 admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:24:43.124322 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41e1287-30fc-4551-8dff-a97c8df45d66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '937bea4f355144b4a7ee11baabc3a4cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:24:43.124972 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41e1287-30fc-4551-8dff-a97c8df45d66 service neutron] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:24:43.125248 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41e1287-30fc-4551-8dff-a97c8df45d66 service neutron] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:24:43.125554 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41e1287-30fc-4551-8dff-a97c8df45d66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:24:43.136894 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41e1287-30fc-4551-8dff-a97c8df45d66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:24:43.139547 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41e1287-30fc-4551-8dff-a97c8df45d66 service neutron] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:24:43.151203 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1421/2830] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:24:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 14:24:43.465779 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e411859-9b26-4c3b-a7a2-7e3004f5c1e9 None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:24:43.467929 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-7e411859-9b26-4c3b-a7a2-7e3004f5c1e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:24:43.483037 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e411859-9b26-4c3b-a7a2-7e3004f5c1e9 None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:24:43.489410 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350bfb27-1ed0-418e-a464-556a83dc4e14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:24:43.490594 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350bfb27-1ed0-418e-a464-556a83dc4e14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:24:43.490854 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350bfb27-1ed0-418e-a464-556a83dc4e14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:24:43.491261 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350bfb27-1ed0-418e-a464-556a83dc4e14 admin admin] PATH_INFO: `/v3/projects/ec1e356ea2804cb2b10cd1a5f987dbb5` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:24:43.492473 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350bfb27-1ed0-418e-a464-556a83dc4e14 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec1e356ea2804cb2b10cd1a5f987dbb5)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:24:43.494960 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350bfb27-1ed0-418e-a464-556a83dc4e14 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:24:43.556516 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-350bfb27-1ed0-418e-a464-556a83dc4e14 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec1e356ea2804cb2b10cd1a5f987dbb5', 'request_id': 'req-350bfb27-1ed0-418e-a464-556a83dc4e14'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:24:43.563171 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-350bfb27-1ed0-418e-a464-556a83dc4e14 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec1e356ea2804cb2b10cd1a5f987dbb5', 'request_id': 'req-350bfb27-1ed0-418e-a464-556a83dc4e14'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:24:43.576682 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-350bfb27-1ed0-418e-a464-556a83dc4e14 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec1e356ea2804cb2b10cd1a5f987dbb5', 'request_id': 'req-350bfb27-1ed0-418e-a464-556a83dc4e14'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:24:43.594064 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-350bfb27-1ed0-418e-a464-556a83dc4e14 admin admin] The token cache is being invalidate because project ec1e356ea2804cb2b10cd1a5f987dbb5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80012) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 14:24:43.594410 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-350bfb27-1ed0-418e-a464-556a83dc4e14 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:24:43.595377 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-350bfb27-1ed0-418e-a464-556a83dc4e14 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:24:43.597949 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1410/2831] 10.222.0.36 () {58 vars in 1232 bytes} [Tue May 3 14:24:43 2022] DELETE /identity/v3/projects/ec1e356ea2804cb2b10cd1a5f987dbb5 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 14:24:43.603535 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41e1287-30fc-4551-8dff-a97c8df45d66 service neutron] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:24:43.613971 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41e1287-30fc-4551-8dff-a97c8df45d66 service neutron] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:24:43.680852 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c9ca95-94f6-48c8-aa61-73408b231657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:24:43.681875 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c9ca95-94f6-48c8-aa61-73408b231657 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:24:43.682143 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c9ca95-94f6-48c8-aa61-73408b231657 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:24:43.682512 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c9ca95-94f6-48c8-aa61-73408b231657 admin admin] PATH_INFO: `/v3/users/d954846f8fdf4cb6b127457d09c2dded` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:24:43.684227 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c9ca95-94f6-48c8-aa61-73408b231657 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d954846f8fdf4cb6b127457d09c2dded)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:24:43.687164 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c9ca95-94f6-48c8-aa61-73408b231657 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:24:43.748234 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-34c9ca95-94f6-48c8-aa61-73408b231657 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd954846f8fdf4cb6b127457d09c2dded'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:24:43.755306 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-34c9ca95-94f6-48c8-aa61-73408b231657 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd954846f8fdf4cb6b127457d09c2dded'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:24:43.756016 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-34c9ca95-94f6-48c8-aa61-73408b231657 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd954846f8fdf4cb6b127457d09c2dded'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:24:43.766386 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-34c9ca95-94f6-48c8-aa61-73408b231657 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd954846f8fdf4cb6b127457d09c2dded'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:24:43.767083 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-34c9ca95-94f6-48c8-aa61-73408b231657 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd954846f8fdf4cb6b127457d09c2dded'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:24:43.787760 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1422/2832] 10.222.0.36 () {58 vars in 1223 bytes} [Tue May 3 14:24:43 2022] DELETE /identity/v3/users/d954846f8fdf4cb6b127457d09c2dded => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 14:24:44.095119 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350bfb27-1ed0-418e-a464-556a83dc4e14 admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:24:44.096609 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-350bfb27-1ed0-418e-a464-556a83dc4e14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:24:44.110434 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350bfb27-1ed0-418e-a464-556a83dc4e14 admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:24:44.167129 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aad9ac6-d2fc-453a-8be9-1417f678f552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:24:44.168062 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aad9ac6-d2fc-453a-8be9-1417f678f552 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:24:44.168342 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aad9ac6-d2fc-453a-8be9-1417f678f552 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:24:44.168614 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aad9ac6-d2fc-453a-8be9-1417f678f552 admin admin] PATH_INFO: `/v3/projects/0b027e1790214b41a17765106420b0d1` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:24:44.169861 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aad9ac6-d2fc-453a-8be9-1417f678f552 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b027e1790214b41a17765106420b0d1)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:24:44.171771 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aad9ac6-d2fc-453a-8be9-1417f678f552 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:24:44.221483 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-5aad9ac6-d2fc-453a-8be9-1417f678f552 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b027e1790214b41a17765106420b0d1', 'request_id': 'req-5aad9ac6-d2fc-453a-8be9-1417f678f552'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:24:44.227989 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-5aad9ac6-d2fc-453a-8be9-1417f678f552 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b027e1790214b41a17765106420b0d1', 'request_id': 'req-5aad9ac6-d2fc-453a-8be9-1417f678f552'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:24:44.233768 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-5aad9ac6-d2fc-453a-8be9-1417f678f552 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b027e1790214b41a17765106420b0d1', 'request_id': 'req-5aad9ac6-d2fc-453a-8be9-1417f678f552'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:24:44.248032 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-5aad9ac6-d2fc-453a-8be9-1417f678f552 admin admin] The token cache is being invalidate because project 0b027e1790214b41a17765106420b0d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80012) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 14:24:44.248309 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-5aad9ac6-d2fc-453a-8be9-1417f678f552 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:24:44.248927 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-5aad9ac6-d2fc-453a-8be9-1417f678f552 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:24:44.250544 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1411/2833] 10.222.0.36 () {58 vars in 1232 bytes} [Tue May 3 14:24:44 2022] DELETE /identity/v3/projects/0b027e1790214b41a17765106420b0d1 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:24:44.255769 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf9bb69-971a-4812-aeb1-75093874e5b4 None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:24:44.256061 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf9bb69-971a-4812-aeb1-75093874e5b4 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:24:44.256336 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf9bb69-971a-4812-aeb1-75093874e5b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:24:44.274806 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-6cf9bb69-971a-4812-aeb1-75093874e5b4 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:24:44.275907 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-6cf9bb69-971a-4812-aeb1-75093874e5b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:24:44.346078 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1423/2834] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:24:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:24:44.356846 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ef8247-7960-4b66-bf1f-cceb26067985 None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:24:44.357134 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ef8247-7960-4b66-bf1f-cceb26067985 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:24:44.357439 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ef8247-7960-4b66-bf1f-cceb26067985 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:24:44.376640 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-45ef8247-7960-4b66-bf1f-cceb26067985 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:24:44.377875 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-45ef8247-7960-4b66-bf1f-cceb26067985 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:24:44.386877 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1412/2835] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:24:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:24:44.391560 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf9bb69-971a-4812-aeb1-75093874e5b4 None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:24:44.401630 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf9bb69-971a-4812-aeb1-75093874e5b4 None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:24:44.406766 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a119e863-38f0-47fb-8d8c-56d2601545cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:24:44.407424 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a119e863-38f0-47fb-8d8c-56d2601545cf admin admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:24:44.407703 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a119e863-38f0-47fb-8d8c-56d2601545cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:24:44.407973 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a119e863-38f0-47fb-8d8c-56d2601545cf admin admin] PATH_INFO: `/v3/domains` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:24:44.408706 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a119e863-38f0-47fb-8d8c-56d2601545cf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:24:44.409037 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a119e863-38f0-47fb-8d8c-56d2601545cf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:24:44.410685 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a119e863-38f0-47fb-8d8c-56d2601545cf admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:24:44.423693 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1424/2836] 10.222.0.36 () {58 vars in 1152 bytes} [Tue May 3 14:24:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:24:44.428663 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ef8247-7960-4b66-bf1f-cceb26067985 None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:24:44.439107 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ef8247-7960-4b66-bf1f-cceb26067985 None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:24:44.445074 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b867516-8c9b-4cab-b71f-92300f089397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:24:44.445756 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b867516-8c9b-4cab-b71f-92300f089397 admin admin] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:24:44.446038 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b867516-8c9b-4cab-b71f-92300f089397 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:24:44.446311 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b867516-8c9b-4cab-b71f-92300f089397 admin admin] PATH_INFO: `/v3/projects` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:24:44.446998 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b867516-8c9b-4cab-b71f-92300f089397 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:24:44.448920 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b867516-8c9b-4cab-b71f-92300f089397 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:24:44.478838 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1413/2837] 10.222.0.36 () {60 vars in 1152 bytes} [Tue May 3 14:24:44 2022] POST /identity/v3/projects => generated 377 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 14:24:44.483716 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a119e863-38f0-47fb-8d8c-56d2601545cf admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:24:44.497091 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a119e863-38f0-47fb-8d8c-56d2601545cf admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:24:44.560156 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a2bbac-f8fb-44e3-aeda-c3255a709c4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:24:44.560793 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a2bbac-f8fb-44e3-aeda-c3255a709c4b admin admin] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:24:44.561066 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a2bbac-f8fb-44e3-aeda-c3255a709c4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:24:44.561315 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a2bbac-f8fb-44e3-aeda-c3255a709c4b admin admin] PATH_INFO: `/v3/users` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:24:44.562069 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a2bbac-f8fb-44e3-aeda-c3255a709c4b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:24:44.564089 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a2bbac-f8fb-44e3-aeda-c3255a709c4b admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:24:44.587713 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1425/2838] 10.222.0.36 () {60 vars in 1143 bytes} [Tue May 3 14:24:44 2022] POST /identity/v3/users => generated 289 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 14:24:44.592451 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b867516-8c9b-4cab-b71f-92300f089397 admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:24:44.603857 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b867516-8c9b-4cab-b71f-92300f089397 admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:24:44.608942 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928a0492-118b-4779-8022-1af26f345e90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:24:44.609631 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928a0492-118b-4779-8022-1af26f345e90 admin admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:24:44.609910 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928a0492-118b-4779-8022-1af26f345e90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:24:44.610184 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928a0492-118b-4779-8022-1af26f345e90 admin admin] PATH_INFO: `/v3/roles` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:24:44.610907 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928a0492-118b-4779-8022-1af26f345e90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:24:44.612509 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928a0492-118b-4779-8022-1af26f345e90 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:24:44.623348 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1414/2839] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 3 14:24:44 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 14:24:44.627394 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a2bbac-f8fb-44e3-aeda-c3255a709c4b admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:24:44.638202 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a2bbac-f8fb-44e3-aeda-c3255a709c4b admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:24:44.643828 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af44244d-ca9b-4534-9bcd-263680a8957e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:24:44.644510 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af44244d-ca9b-4534-9bcd-263680a8957e admin admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:24:44.644772 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af44244d-ca9b-4534-9bcd-263680a8957e admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:24:44.645046 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af44244d-ca9b-4534-9bcd-263680a8957e admin admin] PATH_INFO: `/v3/roles` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:24:44.645830 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af44244d-ca9b-4534-9bcd-263680a8957e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:24:44.647441 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af44244d-ca9b-4534-9bcd-263680a8957e admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:24:44.658781 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1426/2840] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 3 14:24:44 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 14:24:44.663010 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928a0492-118b-4779-8022-1af26f345e90 admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:24:44.673241 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928a0492-118b-4779-8022-1af26f345e90 admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:24:44.678143 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b814e80b-9457-4227-a25b-11a96869494f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:24:44.679024 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b814e80b-9457-4227-a25b-11a96869494f admin admin] REQUEST_METHOD: `PUT` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:24:44.679307 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b814e80b-9457-4227-a25b-11a96869494f admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:24:44.679582 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b814e80b-9457-4227-a25b-11a96869494f admin admin] PATH_INFO: `/v3/projects/5fe1f00d294242de808a751187ba7310/users/5794922e40b14656928c1cc785201e0d/roles/441fdc11e95b47f4813f72610e39018b` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:24:44.694062 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b814e80b-9457-4227-a25b-11a96869494f admin admin] RBAC: Authorizing `identity:create_grant(project_id=5fe1f00d294242de808a751187ba7310, user_id=5794922e40b14656928c1cc785201e0d, role_id=441fdc11e95b47f4813f72610e39018b)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:24:44.696842 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b814e80b-9457-4227-a25b-11a96869494f admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:24:44.715872 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1415/2841] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 3 14:24:44 2022] PUT /identity/v3/projects/5fe1f00d294242de808a751187ba7310/users/5794922e40b14656928c1cc785201e0d/roles/441fdc11e95b47f4813f72610e39018b => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:24:44.730251 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f97137a-41af-4072-bd8f-21abf48912e5 None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:24:44.730541 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f97137a-41af-4072-bd8f-21abf48912e5 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:24:44.730817 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f97137a-41af-4072-bd8f-21abf48912e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:24:44.757578 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-9f97137a-41af-4072-bd8f-21abf48912e5 None None] MFA Rules not processed for user `5794922e40b14656928c1cc785201e0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:24:44.758821 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-9f97137a-41af-4072-bd8f-21abf48912e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:24:44.826061 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1427/2842] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:24:44 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:24:44.838812 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b814e80b-9457-4227-a25b-11a96869494f admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:24:44.841876 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-b814e80b-9457-4227-a25b-11a96869494f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:24:44.904828 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b814e80b-9457-4227-a25b-11a96869494f admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:24:44.909646 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f307629c-0846-4ffc-afb4-ab4c633b42d1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b014f4c7ba1414cb8a597f5bc4033f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:24:44.910297 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f307629c-0846-4ffc-afb4-ab4c633b42d1 service cinder] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:24:44.910609 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f307629c-0846-4ffc-afb4-ab4c633b42d1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:24:44.910898 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f307629c-0846-4ffc-afb4-ab4c633b42d1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:24:44.919915 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f307629c-0846-4ffc-afb4-ab4c633b42d1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:24:44.921442 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f307629c-0846-4ffc-afb4-ab4c633b42d1 service cinder] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:24:44.930505 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1416/2843] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:24:44 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 14:25:02.605931 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f97137a-41af-4072-bd8f-21abf48912e5 None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:25:02.689233 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f97137a-41af-4072-bd8f-21abf48912e5 None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:25:02.696889 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab41c39-f555-44e7-abef-fb104192c6ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:25:02.697812 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab41c39-f555-44e7-abef-fb104192c6ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:25:02.698112 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab41c39-f555-44e7-abef-fb104192c6ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:25:02.698363 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab41c39-f555-44e7-abef-fb104192c6ed admin admin] PATH_INFO: `/v3/users/5794922e40b14656928c1cc785201e0d` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:25:02.699695 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab41c39-f555-44e7-abef-fb104192c6ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=5794922e40b14656928c1cc785201e0d)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:25:02.701687 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab41c39-f555-44e7-abef-fb104192c6ed admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:25:02.758543 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-aab41c39-f555-44e7-abef-fb104192c6ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5794922e40b14656928c1cc785201e0d'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:25:02.766122 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-aab41c39-f555-44e7-abef-fb104192c6ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5794922e40b14656928c1cc785201e0d'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:25:02.766812 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-aab41c39-f555-44e7-abef-fb104192c6ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5794922e40b14656928c1cc785201e0d'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:25:02.776381 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-aab41c39-f555-44e7-abef-fb104192c6ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5794922e40b14656928c1cc785201e0d'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:25:02.777164 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-aab41c39-f555-44e7-abef-fb104192c6ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5794922e40b14656928c1cc785201e0d'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:25:02.794963 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1428/2844] 10.222.0.36 () {58 vars in 1223 bytes} [Tue May 3 14:25:02 2022] DELETE /identity/v3/users/5794922e40b14656928c1cc785201e0d => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:25:02.799743 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab99180-4a92-4077-ab8f-2434f1cf574c None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:25:02.800208 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab99180-4a92-4077-ab8f-2434f1cf574c None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:25:02.800327 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab99180-4a92-4077-ab8f-2434f1cf574c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:25:02.817345 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-6ab99180-4a92-4077-ab8f-2434f1cf574c None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:25:02.818541 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-6ab99180-4a92-4077-ab8f-2434f1cf574c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:25:02.879105 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1417/2845] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:25:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 14:25:02.889265 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab41c39-f555-44e7-abef-fb104192c6ed admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:25:02.891028 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-aab41c39-f555-44e7-abef-fb104192c6ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:25:02.951248 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab41c39-f555-44e7-abef-fb104192c6ed admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:25:02.955073 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46bf90f-2d5a-4df9-bc26-b1d341d12c71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '937bea4f355144b4a7ee11baabc3a4cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:25:02.955747 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46bf90f-2d5a-4df9-bc26-b1d341d12c71 service neutron] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:25:02.956019 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46bf90f-2d5a-4df9-bc26-b1d341d12c71 service neutron] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:25:02.956285 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46bf90f-2d5a-4df9-bc26-b1d341d12c71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:25:02.966025 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46bf90f-2d5a-4df9-bc26-b1d341d12c71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:25:02.967457 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46bf90f-2d5a-4df9-bc26-b1d341d12c71 service neutron] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:25:02.977548 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1429/2846] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:25:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 14:25:03.256277 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab99180-4a92-4077-ab8f-2434f1cf574c None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:25:03.257763 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-6ab99180-4a92-4077-ab8f-2434f1cf574c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:25:03.270715 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab99180-4a92-4077-ab8f-2434f1cf574c None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:25:03.275493 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df559c14-c2f1-4176-a58a-d1d412dca9a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:25:03.276584 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df559c14-c2f1-4176-a58a-d1d412dca9a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:25:03.276861 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df559c14-c2f1-4176-a58a-d1d412dca9a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:25:03.277136 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df559c14-c2f1-4176-a58a-d1d412dca9a7 admin admin] PATH_INFO: `/v3/projects/5fe1f00d294242de808a751187ba7310` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:25:03.279188 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df559c14-c2f1-4176-a58a-d1d412dca9a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5fe1f00d294242de808a751187ba7310)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:25:03.281094 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df559c14-c2f1-4176-a58a-d1d412dca9a7 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:25:03.327718 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-df559c14-c2f1-4176-a58a-d1d412dca9a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5fe1f00d294242de808a751187ba7310', 'request_id': 'req-df559c14-c2f1-4176-a58a-d1d412dca9a7'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:25:03.333667 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-df559c14-c2f1-4176-a58a-d1d412dca9a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5fe1f00d294242de808a751187ba7310', 'request_id': 'req-df559c14-c2f1-4176-a58a-d1d412dca9a7'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:25:03.340046 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-df559c14-c2f1-4176-a58a-d1d412dca9a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5fe1f00d294242de808a751187ba7310', 'request_id': 'req-df559c14-c2f1-4176-a58a-d1d412dca9a7'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:25:03.354005 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-df559c14-c2f1-4176-a58a-d1d412dca9a7 admin admin] The token cache is being invalidate because project 5fe1f00d294242de808a751187ba7310 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80012) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 14:25:03.354289 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-df559c14-c2f1-4176-a58a-d1d412dca9a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:25:03.354909 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-df559c14-c2f1-4176-a58a-d1d412dca9a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:25:03.356507 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1418/2847] 10.222.0.36 () {58 vars in 1232 bytes} [Tue May 3 14:25:03 2022] DELETE /identity/v3/projects/5fe1f00d294242de808a751187ba7310 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:25:03.361638 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab288436-e25c-432b-849b-53a666878dbd None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:25:03.361944 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab288436-e25c-432b-849b-53a666878dbd None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:25:03.362224 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab288436-e25c-432b-849b-53a666878dbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:25:03.381186 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-ab288436-e25c-432b-849b-53a666878dbd None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:25:03.382436 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-ab288436-e25c-432b-849b-53a666878dbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:25:03.443489 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1430/2848] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:25:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:25:03.452488 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e133704-f126-42a9-9fed-d5ac97b0c148 None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:25:03.452777 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e133704-f126-42a9-9fed-d5ac97b0c148 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:25:03.453089 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e133704-f126-42a9-9fed-d5ac97b0c148 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:25:03.475345 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-0e133704-f126-42a9-9fed-d5ac97b0c148 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:25:03.476552 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-0e133704-f126-42a9-9fed-d5ac97b0c148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:25:03.485541 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1419/2849] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:25:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:25:03.489922 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab288436-e25c-432b-849b-53a666878dbd None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:25:03.499818 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab288436-e25c-432b-849b-53a666878dbd None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:25:03.504678 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdea41e9-9f70-4931-b777-9ed42b290abf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:25:03.505347 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdea41e9-9f70-4931-b777-9ed42b290abf admin admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:25:03.505651 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdea41e9-9f70-4931-b777-9ed42b290abf admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:25:03.505924 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdea41e9-9f70-4931-b777-9ed42b290abf admin admin] PATH_INFO: `/v3/domains` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:25:03.506853 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdea41e9-9f70-4931-b777-9ed42b290abf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:25:03.507159 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdea41e9-9f70-4931-b777-9ed42b290abf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:25:03.508818 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdea41e9-9f70-4931-b777-9ed42b290abf admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:25:03.520709 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1431/2850] 10.222.0.36 () {58 vars in 1152 bytes} [Tue May 3 14:25:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:25:03.525239 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e133704-f126-42a9-9fed-d5ac97b0c148 None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:25:03.535047 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e133704-f126-42a9-9fed-d5ac97b0c148 None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:25:03.540605 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2a2ffa-704c-426b-b433-739dc39ad72c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:25:03.541277 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2a2ffa-704c-426b-b433-739dc39ad72c admin admin] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:25:03.541592 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2a2ffa-704c-426b-b433-739dc39ad72c admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:25:03.541862 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2a2ffa-704c-426b-b433-739dc39ad72c admin admin] PATH_INFO: `/v3/projects` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:25:03.542549 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2a2ffa-704c-426b-b433-739dc39ad72c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:25:03.544502 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2a2ffa-704c-426b-b433-739dc39ad72c admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:25:03.573971 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1420/2851] 10.222.0.36 () {60 vars in 1152 bytes} [Tue May 3 14:25:03 2022] POST /identity/v3/projects => generated 389 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 14:25:03.578408 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdea41e9-9f70-4931-b777-9ed42b290abf admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:25:03.588714 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdea41e9-9f70-4931-b777-9ed42b290abf admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:25:03.643902 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3905ea-c94b-48de-9baa-c1325eb672b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:25:03.644580 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3905ea-c94b-48de-9baa-c1325eb672b5 admin admin] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:25:03.644831 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3905ea-c94b-48de-9baa-c1325eb672b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:25:03.645100 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3905ea-c94b-48de-9baa-c1325eb672b5 admin admin] PATH_INFO: `/v3/users` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:25:03.645815 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3905ea-c94b-48de-9baa-c1325eb672b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:25:03.647741 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3905ea-c94b-48de-9baa-c1325eb672b5 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:25:03.669904 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1432/2852] 10.222.0.36 () {60 vars in 1143 bytes} [Tue May 3 14:25:03 2022] POST /identity/v3/users => generated 295 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 14:25:03.674307 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2a2ffa-704c-426b-b433-739dc39ad72c admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:25:03.685102 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2a2ffa-704c-426b-b433-739dc39ad72c admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:25:03.689857 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab11c55e-7567-4133-a8f9-100afad1ec52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:25:03.690535 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab11c55e-7567-4133-a8f9-100afad1ec52 admin admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:25:03.690811 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab11c55e-7567-4133-a8f9-100afad1ec52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:25:03.691086 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab11c55e-7567-4133-a8f9-100afad1ec52 admin admin] PATH_INFO: `/v3/roles` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:25:03.691814 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab11c55e-7567-4133-a8f9-100afad1ec52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:25:03.693469 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab11c55e-7567-4133-a8f9-100afad1ec52 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:25:03.704121 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1421/2853] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 3 14:25:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 14:25:03.708525 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3905ea-c94b-48de-9baa-c1325eb672b5 admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:25:03.720120 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3905ea-c94b-48de-9baa-c1325eb672b5 admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:25:03.726269 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b727b425-3be8-4131-be3a-f00e2a022017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:25:03.727215 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b727b425-3be8-4131-be3a-f00e2a022017 admin admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:25:03.727517 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b727b425-3be8-4131-be3a-f00e2a022017 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:25:03.727796 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b727b425-3be8-4131-be3a-f00e2a022017 admin admin] PATH_INFO: `/v3/roles` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:25:03.728525 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b727b425-3be8-4131-be3a-f00e2a022017 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:25:03.730179 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b727b425-3be8-4131-be3a-f00e2a022017 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:25:03.740641 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1433/2854] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 3 14:25:03 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 14:25:03.745006 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab11c55e-7567-4133-a8f9-100afad1ec52 admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:25:03.755448 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab11c55e-7567-4133-a8f9-100afad1ec52 admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:25:03.764435 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a2bccc-c3a2-436f-9c50-309dc6a3acac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:25:03.765617 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a2bccc-c3a2-436f-9c50-309dc6a3acac admin admin] REQUEST_METHOD: `PUT` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:25:03.765892 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a2bccc-c3a2-436f-9c50-309dc6a3acac admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:25:03.766162 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a2bccc-c3a2-436f-9c50-309dc6a3acac admin admin] PATH_INFO: `/v3/projects/6745b475033a4b0fb1499ba830104c11/users/26351d6563b149b0a11688024d7f6a4b/roles/441fdc11e95b47f4813f72610e39018b` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:25:03.783097 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a2bccc-c3a2-436f-9c50-309dc6a3acac admin admin] RBAC: Authorizing `identity:create_grant(project_id=6745b475033a4b0fb1499ba830104c11, user_id=26351d6563b149b0a11688024d7f6a4b, role_id=441fdc11e95b47f4813f72610e39018b)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:25:03.785850 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a2bccc-c3a2-436f-9c50-309dc6a3acac admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:25:03.801893 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1422/2855] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 3 14:25:03 2022] PUT /identity/v3/projects/6745b475033a4b0fb1499ba830104c11/users/26351d6563b149b0a11688024d7f6a4b/roles/441fdc11e95b47f4813f72610e39018b => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:25:03.812926 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca5b230-698a-4d60-a059-4b8014333ba6 None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:25:03.813223 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca5b230-698a-4d60-a059-4b8014333ba6 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:25:03.813613 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca5b230-698a-4d60-a059-4b8014333ba6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:25:03.841215 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-1ca5b230-698a-4d60-a059-4b8014333ba6 None None] MFA Rules not processed for user `26351d6563b149b0a11688024d7f6a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:25:03.842442 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-1ca5b230-698a-4d60-a059-4b8014333ba6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:25:03.907295 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1434/2856] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:25:03 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:25:03.920383 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a2bccc-c3a2-436f-9c50-309dc6a3acac admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:25:03.922658 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-18a2bccc-c3a2-436f-9c50-309dc6a3acac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:25:03.991444 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a2bccc-c3a2-436f-9c50-309dc6a3acac admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:25:03.996183 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fe3556-d703-4c57-963b-87503809c902 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b014f4c7ba1414cb8a597f5bc4033f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:25:03.996854 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fe3556-d703-4c57-963b-87503809c902 service cinder] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:25:03.997090 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fe3556-d703-4c57-963b-87503809c902 service cinder] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:25:03.997499 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fe3556-d703-4c57-963b-87503809c902 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:25:04.006945 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fe3556-d703-4c57-963b-87503809c902 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:25:04.008437 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fe3556-d703-4c57-963b-87503809c902 service cinder] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:25:04.018290 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1423/2857] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:25:03 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 14:25:20.297484 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca5b230-698a-4d60-a059-4b8014333ba6 None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:25:20.407226 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca5b230-698a-4d60-a059-4b8014333ba6 None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:25:20.412452 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981723ae-40af-4d65-b13c-296c9bcfbff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:25:20.413382 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981723ae-40af-4d65-b13c-296c9bcfbff7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:25:20.413745 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981723ae-40af-4d65-b13c-296c9bcfbff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:25:20.414021 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981723ae-40af-4d65-b13c-296c9bcfbff7 admin admin] PATH_INFO: `/v3/users/26351d6563b149b0a11688024d7f6a4b` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:25:20.415276 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981723ae-40af-4d65-b13c-296c9bcfbff7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=26351d6563b149b0a11688024d7f6a4b)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:25:20.417200 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981723ae-40af-4d65-b13c-296c9bcfbff7 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:25:20.468390 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-981723ae-40af-4d65-b13c-296c9bcfbff7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26351d6563b149b0a11688024d7f6a4b'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:25:20.475084 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-981723ae-40af-4d65-b13c-296c9bcfbff7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26351d6563b149b0a11688024d7f6a4b'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:25:20.475894 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-981723ae-40af-4d65-b13c-296c9bcfbff7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26351d6563b149b0a11688024d7f6a4b'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:25:20.484883 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-981723ae-40af-4d65-b13c-296c9bcfbff7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26351d6563b149b0a11688024d7f6a4b'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:25:20.485689 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-981723ae-40af-4d65-b13c-296c9bcfbff7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26351d6563b149b0a11688024d7f6a4b'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:25:20.503253 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1435/2858] 10.222.0.36 () {58 vars in 1223 bytes} [Tue May 3 14:25:20 2022] DELETE /identity/v3/users/26351d6563b149b0a11688024d7f6a4b => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:25:20.508154 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30473b4b-0297-4711-bc48-682791c83063 None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:25:20.508676 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30473b4b-0297-4711-bc48-682791c83063 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:25:20.508809 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30473b4b-0297-4711-bc48-682791c83063 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:25:20.555461 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-30473b4b-0297-4711-bc48-682791c83063 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:25:20.556664 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-30473b4b-0297-4711-bc48-682791c83063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:25:20.616048 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1424/2859] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:25:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:25:20.629411 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981723ae-40af-4d65-b13c-296c9bcfbff7 admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:25:20.631779 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-981723ae-40af-4d65-b13c-296c9bcfbff7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:25:20.739474 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981723ae-40af-4d65-b13c-296c9bcfbff7 admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:25:20.746270 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb06906b-9174-47cd-92bc-ca0f4787f1a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '937bea4f355144b4a7ee11baabc3a4cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:25:20.747139 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb06906b-9174-47cd-92bc-ca0f4787f1a7 service neutron] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:25:20.747496 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb06906b-9174-47cd-92bc-ca0f4787f1a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:25:20.747834 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb06906b-9174-47cd-92bc-ca0f4787f1a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:25:20.759803 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb06906b-9174-47cd-92bc-ca0f4787f1a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:25:20.761247 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb06906b-9174-47cd-92bc-ca0f4787f1a7 service neutron] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:25:20.771236 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1436/2860] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:25:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 14:25:21.055962 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30473b4b-0297-4711-bc48-682791c83063 None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:25:21.057423 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-30473b4b-0297-4711-bc48-682791c83063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:25:21.072518 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30473b4b-0297-4711-bc48-682791c83063 None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:25:21.078126 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8649331b-c279-4635-9e22-79ddffbe3acd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:25:21.079023 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8649331b-c279-4635-9e22-79ddffbe3acd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:25:21.079300 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8649331b-c279-4635-9e22-79ddffbe3acd admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:25:21.079569 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8649331b-c279-4635-9e22-79ddffbe3acd admin admin] PATH_INFO: `/v3/projects/6745b475033a4b0fb1499ba830104c11` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:25:21.080832 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8649331b-c279-4635-9e22-79ddffbe3acd admin admin] RBAC: Authorizing `identity:delete_project(project_id=6745b475033a4b0fb1499ba830104c11)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:25:21.083010 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8649331b-c279-4635-9e22-79ddffbe3acd admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:25:21.132473 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-8649331b-c279-4635-9e22-79ddffbe3acd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6745b475033a4b0fb1499ba830104c11', 'request_id': 'req-8649331b-c279-4635-9e22-79ddffbe3acd'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:25:21.138697 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-8649331b-c279-4635-9e22-79ddffbe3acd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6745b475033a4b0fb1499ba830104c11', 'request_id': 'req-8649331b-c279-4635-9e22-79ddffbe3acd'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:25:21.144866 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-8649331b-c279-4635-9e22-79ddffbe3acd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6745b475033a4b0fb1499ba830104c11', 'request_id': 'req-8649331b-c279-4635-9e22-79ddffbe3acd'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:25:21.159291 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-8649331b-c279-4635-9e22-79ddffbe3acd admin admin] The token cache is being invalidate because project 6745b475033a4b0fb1499ba830104c11 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80012) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 14:25:21.159578 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-8649331b-c279-4635-9e22-79ddffbe3acd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:25:21.160307 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-8649331b-c279-4635-9e22-79ddffbe3acd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:25:21.161829 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1425/2861] 10.222.0.36 () {58 vars in 1232 bytes} [Tue May 3 14:25:21 2022] DELETE /identity/v3/projects/6745b475033a4b0fb1499ba830104c11 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:25:21.166885 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb751f9-cdea-4e9b-8a8f-5f255fef27e9 None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:25:21.167191 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb751f9-cdea-4e9b-8a8f-5f255fef27e9 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:25:21.167465 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb751f9-cdea-4e9b-8a8f-5f255fef27e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:25:21.205766 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-4bb751f9-cdea-4e9b-8a8f-5f255fef27e9 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:25:21.207107 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-4bb751f9-cdea-4e9b-8a8f-5f255fef27e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:25:21.270228 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1437/2862] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:25:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:25:21.278391 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9c9e57-b437-4056-998c-b6f507cda74d None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:25:21.278715 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9c9e57-b437-4056-998c-b6f507cda74d None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:25:21.278991 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9c9e57-b437-4056-998c-b6f507cda74d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:25:21.298209 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-ea9c9e57-b437-4056-998c-b6f507cda74d None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:25:21.299407 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-ea9c9e57-b437-4056-998c-b6f507cda74d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:25:21.309638 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1426/2863] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:25:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:25:21.316096 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb751f9-cdea-4e9b-8a8f-5f255fef27e9 None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:25:21.327140 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb751f9-cdea-4e9b-8a8f-5f255fef27e9 None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:25:21.333696 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65f10fc-4917-488f-9038-6fa9d7859ea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:25:21.334707 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65f10fc-4917-488f-9038-6fa9d7859ea0 admin admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:25:21.334980 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65f10fc-4917-488f-9038-6fa9d7859ea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:25:21.335378 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65f10fc-4917-488f-9038-6fa9d7859ea0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:25:21.336149 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65f10fc-4917-488f-9038-6fa9d7859ea0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80013) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 14:25:21.336468 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65f10fc-4917-488f-9038-6fa9d7859ea0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:25:21.338131 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65f10fc-4917-488f-9038-6fa9d7859ea0 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:25:21.350526 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1438/2864] 10.222.0.36 () {58 vars in 1152 bytes} [Tue May 3 14:25:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 14:25:21.355154 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9c9e57-b437-4056-998c-b6f507cda74d None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:25:21.366657 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9c9e57-b437-4056-998c-b6f507cda74d None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:25:21.376083 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ca402a-07e2-40bb-9e6b-e6b8cfe0ddbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:25:21.377100 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ca402a-07e2-40bb-9e6b-e6b8cfe0ddbe admin admin] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:25:21.377591 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ca402a-07e2-40bb-9e6b-e6b8cfe0ddbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:25:21.378015 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ca402a-07e2-40bb-9e6b-e6b8cfe0ddbe admin admin] PATH_INFO: `/v3/projects` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:25:21.379014 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ca402a-07e2-40bb-9e6b-e6b8cfe0ddbe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:25:21.380898 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ca402a-07e2-40bb-9e6b-e6b8cfe0ddbe admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:25:21.414554 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1427/2865] 10.222.0.36 () {60 vars in 1152 bytes} [Tue May 3 14:25:21 2022] POST /identity/v3/projects => generated 373 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 14:25:21.416244 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65f10fc-4917-488f-9038-6fa9d7859ea0 admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:25:21.426235 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65f10fc-4917-488f-9038-6fa9d7859ea0 admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:25:21.486555 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a62902-826a-4800-a58d-e6f0c26ca865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:25:21.487233 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a62902-826a-4800-a58d-e6f0c26ca865 admin admin] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:25:21.487492 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a62902-826a-4800-a58d-e6f0c26ca865 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:25:21.487769 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a62902-826a-4800-a58d-e6f0c26ca865 admin admin] PATH_INFO: `/v3/users` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:25:21.488687 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a62902-826a-4800-a58d-e6f0c26ca865 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:25:21.490653 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a62902-826a-4800-a58d-e6f0c26ca865 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:25:21.512625 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1439/2866] 10.222.0.36 () {60 vars in 1143 bytes} [Tue May 3 14:25:21 2022] POST /identity/v3/users => generated 287 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 14:25:21.516995 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ca402a-07e2-40bb-9e6b-e6b8cfe0ddbe admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:25:21.527755 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ca402a-07e2-40bb-9e6b-e6b8cfe0ddbe admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:25:21.532829 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53387ded-9ac7-4f87-b6e6-4389a0a9afd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:25:21.533586 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53387ded-9ac7-4f87-b6e6-4389a0a9afd5 admin admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:25:21.533885 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53387ded-9ac7-4f87-b6e6-4389a0a9afd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:25:21.534147 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53387ded-9ac7-4f87-b6e6-4389a0a9afd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:25:21.534871 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53387ded-9ac7-4f87-b6e6-4389a0a9afd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:25:21.536634 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53387ded-9ac7-4f87-b6e6-4389a0a9afd5 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:25:21.546954 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1428/2867] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 3 14:25:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 14:25:21.551021 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a62902-826a-4800-a58d-e6f0c26ca865 admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:25:21.561720 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a62902-826a-4800-a58d-e6f0c26ca865 admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:25:21.567668 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c4a116-6f47-4529-b152-29dcc20eaac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:25:21.568336 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c4a116-6f47-4529-b152-29dcc20eaac6 admin admin] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:25:21.568617 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c4a116-6f47-4529-b152-29dcc20eaac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:25:21.568891 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c4a116-6f47-4529-b152-29dcc20eaac6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:25:21.569654 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c4a116-6f47-4529-b152-29dcc20eaac6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:25:21.571254 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c4a116-6f47-4529-b152-29dcc20eaac6 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:25:21.581159 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1440/2868] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 3 14:25:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 14:25:21.585846 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53387ded-9ac7-4f87-b6e6-4389a0a9afd5 admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:25:21.596860 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53387ded-9ac7-4f87-b6e6-4389a0a9afd5 admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:25:21.601986 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f495bf2e-b9a1-449b-a9ea-b339603d54af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:25:21.603191 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f495bf2e-b9a1-449b-a9ea-b339603d54af admin admin] REQUEST_METHOD: `PUT` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:25:21.603485 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f495bf2e-b9a1-449b-a9ea-b339603d54af admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:25:21.603730 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f495bf2e-b9a1-449b-a9ea-b339603d54af admin admin] PATH_INFO: `/v3/projects/8ce4d8e3a93d47948c1d76d8c3d75c11/users/1b308bbef4814fad9a51d8c6f2de8e12/roles/441fdc11e95b47f4813f72610e39018b` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:25:21.618512 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f495bf2e-b9a1-449b-a9ea-b339603d54af admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ce4d8e3a93d47948c1d76d8c3d75c11, user_id=1b308bbef4814fad9a51d8c6f2de8e12, role_id=441fdc11e95b47f4813f72610e39018b)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:25:21.621194 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f495bf2e-b9a1-449b-a9ea-b339603d54af admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:25:21.639355 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1429/2869] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 3 14:25:21 2022] PUT /identity/v3/projects/8ce4d8e3a93d47948c1d76d8c3d75c11/users/1b308bbef4814fad9a51d8c6f2de8e12/roles/441fdc11e95b47f4813f72610e39018b => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:25:21.645610 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3012f6-d68c-4cf3-bab0-6b4fe6e3c054 None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:25:21.646052 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3012f6-d68c-4cf3-bab0-6b4fe6e3c054 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:25:21.646420 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3012f6-d68c-4cf3-bab0-6b4fe6e3c054 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:25:21.668741 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-9c3012f6-d68c-4cf3-bab0-6b4fe6e3c054 None None] MFA Rules not processed for user `87a3e2c426774a3eba9534209ef0a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:25:21.669952 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-9c3012f6-d68c-4cf3-bab0-6b4fe6e3c054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:25:21.744197 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1441/2870] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:25:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:25:21.754283 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f495bf2e-b9a1-449b-a9ea-b339603d54af admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:25:21.756284 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-f495bf2e-b9a1-449b-a9ea-b339603d54af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:25:21.813344 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f495bf2e-b9a1-449b-a9ea-b339603d54af admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:25:21.817703 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491f465a-c4dd-4153-984d-7d9cf3fa1c40 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '937bea4f355144b4a7ee11baabc3a4cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:25:21.818343 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491f465a-c4dd-4153-984d-7d9cf3fa1c40 service neutron] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:25:21.818622 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491f465a-c4dd-4153-984d-7d9cf3fa1c40 service neutron] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:25:21.818892 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491f465a-c4dd-4153-984d-7d9cf3fa1c40 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:25:21.828281 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491f465a-c4dd-4153-984d-7d9cf3fa1c40 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:25:21.829851 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491f465a-c4dd-4153-984d-7d9cf3fa1c40 service neutron] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:25:21.840441 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1430/2871] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:25:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 14:25:25.822303 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2174bee-ec95-4faa-ab7f-9062ace839f5 None None] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:25:25.822790 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2174bee-ec95-4faa-ab7f-9062ace839f5 None None] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:25:25.822909 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2174bee-ec95-4faa-ab7f-9062ace839f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:25:25.853661 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.auth.core [None req-e2174bee-ec95-4faa-ab7f-9062ace839f5 None None] MFA Rules not processed for user `1b308bbef4814fad9a51d8c6f2de8e12`. Rule list: `[]` (Enabled: `True`). {{(pid=80013) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:25:25.854916 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-e2174bee-ec95-4faa-ab7f-9062ace839f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:25:25.924720 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1442/2872] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:25:25 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:25:25.930142 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491f465a-c4dd-4153-984d-7d9cf3fa1c40 service neutron] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:25:25.940666 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491f465a-c4dd-4153-984d-7d9cf3fa1c40 service neutron] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:25:25.948513 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff769f9-73eb-4621-8942-9aef69988095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:25:25.949201 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff769f9-73eb-4621-8942-9aef69988095 admin admin] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:25:25.949583 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff769f9-73eb-4621-8942-9aef69988095 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:25:25.949862 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff769f9-73eb-4621-8942-9aef69988095 admin admin] PATH_INFO: `/v3/projects` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:25:25.950942 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff769f9-73eb-4621-8942-9aef69988095 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:25:25.954533 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff769f9-73eb-4621-8942-9aef69988095 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:25:25.997622 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1431/2873] 10.222.0.36 () {60 vars in 1152 bytes} [Tue May 3 14:25:25 2022] POST /identity/v3/projects => generated 371 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 14:25:26.001755 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2174bee-ec95-4faa-ab7f-9062ace839f5 None None] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:25:26.016564 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2174bee-ec95-4faa-ab7f-9062ace839f5 None None] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:25:26.080675 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27a6922-1afc-4d4d-bb55-0748ed446ab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:25:26.081494 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27a6922-1afc-4d4d-bb55-0748ed446ab2 admin admin] REQUEST_METHOD: `POST` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:25:26.081853 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27a6922-1afc-4d4d-bb55-0748ed446ab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:25:26.082228 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27a6922-1afc-4d4d-bb55-0748ed446ab2 admin admin] PATH_INFO: `/v3/users` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:25:26.083298 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27a6922-1afc-4d4d-bb55-0748ed446ab2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:25:26.085641 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27a6922-1afc-4d4d-bb55-0748ed446ab2 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:25:26.106950 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1443/2874] 10.222.0.36 () {60 vars in 1143 bytes} [Tue May 3 14:25:26 2022] POST /identity/v3/users => generated 292 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 14:25:26.111157 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff769f9-73eb-4621-8942-9aef69988095 admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:25:26.124723 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff769f9-73eb-4621-8942-9aef69988095 admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:25:26.131053 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df6174e-f2fb-4cc1-b578-108d6860ebe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:25:26.131742 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df6174e-f2fb-4cc1-b578-108d6860ebe6 admin admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:25:26.132021 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df6174e-f2fb-4cc1-b578-108d6860ebe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:25:26.132295 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df6174e-f2fb-4cc1-b578-108d6860ebe6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:25:26.133058 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df6174e-f2fb-4cc1-b578-108d6860ebe6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:25:26.134713 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df6174e-f2fb-4cc1-b578-108d6860ebe6 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:25:26.147645 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1432/2875] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 3 14:25:26 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 14:25:26.151965 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27a6922-1afc-4d4d-bb55-0748ed446ab2 admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:25:26.162657 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27a6922-1afc-4d4d-bb55-0748ed446ab2 admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:25:26.168442 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbf1aa0-024f-4619-a834-0a4fec094bd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:25:26.169414 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbf1aa0-024f-4619-a834-0a4fec094bd0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:25:26.169695 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbf1aa0-024f-4619-a834-0a4fec094bd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:25:26.169969 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbf1aa0-024f-4619-a834-0a4fec094bd0 admin admin] PATH_INFO: `/v3/projects/a2d6511d9945487d8d3a5d7da11c6164/users/ec9a67eac06745e6beca0823b61f01dd/roles/36abe9b50fd8479c86c4f8f70fd85aa3` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:25:26.187580 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbf1aa0-024f-4619-a834-0a4fec094bd0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2d6511d9945487d8d3a5d7da11c6164, user_id=ec9a67eac06745e6beca0823b61f01dd, role_id=36abe9b50fd8479c86c4f8f70fd85aa3)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:25:26.190407 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbf1aa0-024f-4619-a834-0a4fec094bd0 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:25:26.206032 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1444/2876] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 3 14:25:26 2022] PUT /identity/v3/projects/a2d6511d9945487d8d3a5d7da11c6164/users/ec9a67eac06745e6beca0823b61f01dd/roles/36abe9b50fd8479c86c4f8f70fd85aa3 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:25:26.210427 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df6174e-f2fb-4cc1-b578-108d6860ebe6 admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:25:26.220341 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df6174e-f2fb-4cc1-b578-108d6860ebe6 admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:25:26.281833 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a33446c-a6a2-4646-b5a0-1ceb3a8eb5f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:25:26.282524 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a33446c-a6a2-4646-b5a0-1ceb3a8eb5f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:25:26.282805 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a33446c-a6a2-4646-b5a0-1ceb3a8eb5f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:25:26.283080 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a33446c-a6a2-4646-b5a0-1ceb3a8eb5f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:25:26.283817 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a33446c-a6a2-4646-b5a0-1ceb3a8eb5f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:25:26.285509 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a33446c-a6a2-4646-b5a0-1ceb3a8eb5f0 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:25:26.295843 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1433/2877] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 3 14:25:26 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 14:25:26.300058 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbf1aa0-024f-4619-a834-0a4fec094bd0 admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:25:26.311161 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbf1aa0-024f-4619-a834-0a4fec094bd0 admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:25:26.316451 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1f56c5-6556-4d30-839e-f7c717887e1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:25:26.317605 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1f56c5-6556-4d30-839e-f7c717887e1a admin admin] REQUEST_METHOD: `PUT` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:25:26.317961 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1f56c5-6556-4d30-839e-f7c717887e1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:25:26.318295 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1f56c5-6556-4d30-839e-f7c717887e1a admin admin] PATH_INFO: `/v3/projects/a2d6511d9945487d8d3a5d7da11c6164/users/ec9a67eac06745e6beca0823b61f01dd/roles/36abe9b50fd8479c86c4f8f70fd85aa3` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:25:26.320603 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1f56c5-6556-4d30-839e-f7c717887e1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2d6511d9945487d8d3a5d7da11c6164, user_id=ec9a67eac06745e6beca0823b61f01dd, role_id=36abe9b50fd8479c86c4f8f70fd85aa3)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:25:26.323591 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1f56c5-6556-4d30-839e-f7c717887e1a admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:25:26.335523 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1445/2878] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 3 14:25:26 2022] PUT /identity/v3/projects/a2d6511d9945487d8d3a5d7da11c6164/users/ec9a67eac06745e6beca0823b61f01dd/roles/36abe9b50fd8479c86c4f8f70fd85aa3 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:25:30.781809 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4a107e-69d5-4639-ab3c-eea16e938750 None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:25:30.782306 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4a107e-69d5-4639-ab3c-eea16e938750 None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:25:30.782395 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4a107e-69d5-4639-ab3c-eea16e938750 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:25:30.810938 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-2f4a107e-69d5-4639-ab3c-eea16e938750 None None] MFA Rules not processed for user `ec9a67eac06745e6beca0823b61f01dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:25:30.812524 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-2f4a107e-69d5-4639-ab3c-eea16e938750 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:25:30.891148 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1434/2879] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:25:30 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:25:30.902216 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1f56c5-6556-4d30-839e-f7c717887e1a admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:25:30.904572 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-ea1f56c5-6556-4d30-839e-f7c717887e1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:25:30.979191 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1f56c5-6556-4d30-839e-f7c717887e1a admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:25:30.985054 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713449ee-277e-4a77-a0c7-6b8dc0965416 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63489e658c094a2598a2ac62159d2fda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:25:30.985748 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713449ee-277e-4a77-a0c7-6b8dc0965416 service nova] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:25:30.986032 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713449ee-277e-4a77-a0c7-6b8dc0965416 service nova] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:25:30.986309 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713449ee-277e-4a77-a0c7-6b8dc0965416 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:25:31.044719 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713449ee-277e-4a77-a0c7-6b8dc0965416 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:25:31.046361 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713449ee-277e-4a77-a0c7-6b8dc0965416 service nova] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:25:31.056158 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1446/2880] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:25:30 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 14:25:32.220453 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04de255-351f-46c9-ba9a-23b4191746bd None None] REQUEST_METHOD: `POST` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:25:32.221011 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04de255-351f-46c9-ba9a-23b4191746bd None None] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:25:32.221011 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04de255-351f-46c9-ba9a-23b4191746bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:25:32.240782 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.auth.core [None req-c04de255-351f-46c9-ba9a-23b4191746bd None None] MFA Rules not processed for user `1b308bbef4814fad9a51d8c6f2de8e12`. Rule list: `[]` (Enabled: `True`). {{(pid=80012) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 14:25:32.242351 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-c04de255-351f-46c9-ba9a-23b4191746bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:25:32.251271 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1435/2881] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 3 14:25:32 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 14:26:00.269205 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713449ee-277e-4a77-a0c7-6b8dc0965416 service nova] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:26:00.270817 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-713449ee-277e-4a77-a0c7-6b8dc0965416 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:26:00.324030 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713449ee-277e-4a77-a0c7-6b8dc0965416 service nova] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:26:00.330333 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5706c310-f322-47ab-8726-6d8fde9e0420 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63489e658c094a2598a2ac62159d2fda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:26:00.331020 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5706c310-f322-47ab-8726-6d8fde9e0420 service nova] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:26:00.331294 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5706c310-f322-47ab-8726-6d8fde9e0420 service nova] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:26:00.331567 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5706c310-f322-47ab-8726-6d8fde9e0420 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:26:00.333540 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-5706c310-f322-47ab-8726-6d8fde9e0420 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:26:00.353382 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5706c310-f322-47ab-8726-6d8fde9e0420 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:26:00.355008 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5706c310-f322-47ab-8726-6d8fde9e0420 service nova] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:26:00.366593 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1447/2882] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:26:00 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 14:26:02.991004 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04de255-351f-46c9-ba9a-23b4191746bd None None] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:26:02.992555 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-c04de255-351f-46c9-ba9a-23b4191746bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:26:03.052830 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04de255-351f-46c9-ba9a-23b4191746bd None None] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:26:03.056977 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3193bd5b-ed91-4676-bd9b-85f725c0f2fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '937bea4f355144b4a7ee11baabc3a4cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:26:03.057670 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3193bd5b-ed91-4676-bd9b-85f725c0f2fc service neutron] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:26:03.057952 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3193bd5b-ed91-4676-bd9b-85f725c0f2fc service neutron] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:26:03.058227 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3193bd5b-ed91-4676-bd9b-85f725c0f2fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:26:03.067467 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3193bd5b-ed91-4676-bd9b-85f725c0f2fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:26:03.068905 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3193bd5b-ed91-4676-bd9b-85f725c0f2fc service neutron] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:26:03.079017 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1436/2883] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:26:02 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 14:27:19.782809 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5706c310-f322-47ab-8726-6d8fde9e0420 service nova] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:27:19.784919 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-5706c310-f322-47ab-8726-6d8fde9e0420 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:27:19.884973 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5706c310-f322-47ab-8726-6d8fde9e0420 service nova] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:27:19.890913 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b206b4c7-aae8-4497-a16e-3f8f0620259b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '164c7f36acf644e9bf93f158e876e9e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:27:19.891564 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b206b4c7-aae8-4497-a16e-3f8f0620259b service placement] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:27:19.891839 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b206b4c7-aae8-4497-a16e-3f8f0620259b service placement] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:27:19.892138 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b206b4c7-aae8-4497-a16e-3f8f0620259b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:27:19.894080 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-b206b4c7-aae8-4497-a16e-3f8f0620259b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:27:19.905638 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b206b4c7-aae8-4497-a16e-3f8f0620259b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:27:19.907211 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b206b4c7-aae8-4497-a16e-3f8f0620259b service placement] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:27:19.917121 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1448/2884] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:27:19 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 14:28:06.132454 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3193bd5b-ed91-4676-bd9b-85f725c0f2fc service neutron] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:28:06.145792 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3193bd5b-ed91-4676-bd9b-85f725c0f2fc service neutron] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:28:06.150649 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c639ad0c-fb69-4635-ac3e-39c306718119 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '937bea4f355144b4a7ee11baabc3a4cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:28:06.151298 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c639ad0c-fb69-4635-ac3e-39c306718119 service neutron] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:28:06.151577 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c639ad0c-fb69-4635-ac3e-39c306718119 service neutron] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:28:06.151846 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c639ad0c-fb69-4635-ac3e-39c306718119 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:28:06.153905 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-c639ad0c-fb69-4635-ac3e-39c306718119 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:28:06.168358 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c639ad0c-fb69-4635-ac3e-39c306718119 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:28:06.169946 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c639ad0c-fb69-4635-ac3e-39c306718119 service neutron] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:28:06.182440 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1437/2885] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:28:06 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 14:28:12.140421 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b206b4c7-aae8-4497-a16e-3f8f0620259b service placement] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:28:12.150595 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b206b4c7-aae8-4497-a16e-3f8f0620259b service placement] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:28:12.154889 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02594b9-aba2-4f4a-940a-3ceed88e71c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '937bea4f355144b4a7ee11baabc3a4cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:28:12.155532 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02594b9-aba2-4f4a-940a-3ceed88e71c1 service neutron] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:28:12.155843 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02594b9-aba2-4f4a-940a-3ceed88e71c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:28:12.156168 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02594b9-aba2-4f4a-940a-3ceed88e71c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:28:12.157992 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-b02594b9-aba2-4f4a-940a-3ceed88e71c1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:28:12.172882 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02594b9-aba2-4f4a-940a-3ceed88e71c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:28:12.174380 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02594b9-aba2-4f4a-940a-3ceed88e71c1 service neutron] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:28:12.186068 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1449/2886] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:28:12 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 14:28:12.357554 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c639ad0c-fb69-4635-ac3e-39c306718119 service neutron] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:28:12.366287 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c639ad0c-fb69-4635-ac3e-39c306718119 service neutron] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:28:12.370736 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da82d429-fed4-4ef1-a367-71d63043c3a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '937bea4f355144b4a7ee11baabc3a4cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:28:12.371369 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da82d429-fed4-4ef1-a367-71d63043c3a3 service neutron] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:28:12.371642 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da82d429-fed4-4ef1-a367-71d63043c3a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:28:12.371913 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da82d429-fed4-4ef1-a367-71d63043c3a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:28:12.373731 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-da82d429-fed4-4ef1-a367-71d63043c3a3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:28:12.384023 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da82d429-fed4-4ef1-a367-71d63043c3a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:28:12.385491 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da82d429-fed4-4ef1-a367-71d63043c3a3 service neutron] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:28:12.393627 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1438/2887] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:28:12 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 14:28:12.505489 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02594b9-aba2-4f4a-940a-3ceed88e71c1 service neutron] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:28:12.515006 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02594b9-aba2-4f4a-940a-3ceed88e71c1 service neutron] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:28:12.518938 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1989d4-8066-4287-b6a1-7f1defc95904 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '937bea4f355144b4a7ee11baabc3a4cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:28:12.519614 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1989d4-8066-4287-b6a1-7f1defc95904 service neutron] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:28:12.519883 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1989d4-8066-4287-b6a1-7f1defc95904 service neutron] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:28:12.520158 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1989d4-8066-4287-b6a1-7f1defc95904 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:28:12.522003 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-ad1989d4-8066-4287-b6a1-7f1defc95904 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:28:12.532045 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1989d4-8066-4287-b6a1-7f1defc95904 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:28:12.533506 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1989d4-8066-4287-b6a1-7f1defc95904 service neutron] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:28:12.541733 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1450/2888] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:28:12 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 14:28:12.623408 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da82d429-fed4-4ef1-a367-71d63043c3a3 service neutron] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:28:12.631804 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da82d429-fed4-4ef1-a367-71d63043c3a3 service neutron] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:28:12.636524 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2762b3-caed-4fd0-89ba-12d6b7ea1244 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '937bea4f355144b4a7ee11baabc3a4cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:28:12.637225 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2762b3-caed-4fd0-89ba-12d6b7ea1244 service neutron] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:28:12.637537 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2762b3-caed-4fd0-89ba-12d6b7ea1244 service neutron] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:28:12.637808 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2762b3-caed-4fd0-89ba-12d6b7ea1244 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:28:12.639677 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-7a2762b3-caed-4fd0-89ba-12d6b7ea1244 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:28:12.654240 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2762b3-caed-4fd0-89ba-12d6b7ea1244 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:28:12.655668 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2762b3-caed-4fd0-89ba-12d6b7ea1244 service neutron] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:28:12.666783 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1439/2889] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:28:12 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 14:28:12.729762 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1989d4-8066-4287-b6a1-7f1defc95904 service neutron] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:28:12.742938 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1989d4-8066-4287-b6a1-7f1defc95904 service neutron] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:28:12.748419 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85d2f7f-f68d-4936-82e4-949c2288bb29 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '164c7f36acf644e9bf93f158e876e9e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:28:12.749064 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85d2f7f-f68d-4936-82e4-949c2288bb29 service placement] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:28:12.749335 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85d2f7f-f68d-4936-82e4-949c2288bb29 service placement] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:28:12.749634 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85d2f7f-f68d-4936-82e4-949c2288bb29 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:28:12.751712 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-a85d2f7f-f68d-4936-82e4-949c2288bb29 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:28:12.764681 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85d2f7f-f68d-4936-82e4-949c2288bb29 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:28:12.766283 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85d2f7f-f68d-4936-82e4-949c2288bb29 service placement] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:28:12.776486 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1451/2890] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:28:12 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 14:29:20.513823 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2762b3-caed-4fd0-89ba-12d6b7ea1244 service neutron] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:29:20.523149 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2762b3-caed-4fd0-89ba-12d6b7ea1244 service neutron] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:29:20.527943 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5944974a-4806-463d-a66b-0bee5617c1c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '937bea4f355144b4a7ee11baabc3a4cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:29:20.528586 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5944974a-4806-463d-a66b-0bee5617c1c2 service neutron] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:29:20.528865 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5944974a-4806-463d-a66b-0bee5617c1c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:29:20.529137 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5944974a-4806-463d-a66b-0bee5617c1c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:29:20.531342 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-5944974a-4806-463d-a66b-0bee5617c1c2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:29:20.541822 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5944974a-4806-463d-a66b-0bee5617c1c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:29:20.543246 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5944974a-4806-463d-a66b-0bee5617c1c2 service neutron] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:29:20.551309 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1440/2891] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:29:20 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 14:29:38.761831 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85d2f7f-f68d-4936-82e4-949c2288bb29 service placement] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:29:38.776074 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85d2f7f-f68d-4936-82e4-949c2288bb29 service placement] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:29:38.782325 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f0b1ab-fc50-4cd6-9a7c-79949ed0d80f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63489e658c094a2598a2ac62159d2fda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:29:38.783290 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f0b1ab-fc50-4cd6-9a7c-79949ed0d80f service nova] REQUEST_METHOD: `GET` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:29:38.783635 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f0b1ab-fc50-4cd6-9a7c-79949ed0d80f service nova] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:29:38.784467 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f0b1ab-fc50-4cd6-9a7c-79949ed0d80f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:29:38.786241 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-26f0b1ab-fc50-4cd6-9a7c-79949ed0d80f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:29:38.800112 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f0b1ab-fc50-4cd6-9a7c-79949ed0d80f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:29:38.801843 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f0b1ab-fc50-4cd6-9a7c-79949ed0d80f service nova] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:29:38.812920 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1452/2892] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:29:38 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 14:29:49.201897 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5944974a-4806-463d-a66b-0bee5617c1c2 service neutron] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:29:49.275619 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5944974a-4806-463d-a66b-0bee5617c1c2 service neutron] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:29:49.280420 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc949e9-023c-4dc1-84ff-24d58824a3f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:29:49.281423 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc949e9-023c-4dc1-84ff-24d58824a3f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:29:49.281668 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc949e9-023c-4dc1-84ff-24d58824a3f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:29:49.281939 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc949e9-023c-4dc1-84ff-24d58824a3f2 admin admin] PATH_INFO: `/v3/users/1b308bbef4814fad9a51d8c6f2de8e12` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:29:49.283282 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc949e9-023c-4dc1-84ff-24d58824a3f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b308bbef4814fad9a51d8c6f2de8e12)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:29:49.285223 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc949e9-023c-4dc1-84ff-24d58824a3f2 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:29:49.341707 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-8fc949e9-023c-4dc1-84ff-24d58824a3f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b308bbef4814fad9a51d8c6f2de8e12'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:29:49.349224 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-8fc949e9-023c-4dc1-84ff-24d58824a3f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b308bbef4814fad9a51d8c6f2de8e12'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:29:49.350004 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-8fc949e9-023c-4dc1-84ff-24d58824a3f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b308bbef4814fad9a51d8c6f2de8e12'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:29:49.363117 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-8fc949e9-023c-4dc1-84ff-24d58824a3f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b308bbef4814fad9a51d8c6f2de8e12'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:29:49.363987 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-8fc949e9-023c-4dc1-84ff-24d58824a3f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b308bbef4814fad9a51d8c6f2de8e12'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:29:49.387472 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1441/2893] 10.222.0.36 () {58 vars in 1223 bytes} [Tue May 3 14:29:49 2022] DELETE /identity/v3/users/1b308bbef4814fad9a51d8c6f2de8e12 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 14:29:49.606310 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f0b1ab-fc50-4cd6-9a7c-79949ed0d80f service nova] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:29:49.618917 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f0b1ab-fc50-4cd6-9a7c-79949ed0d80f service nova] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:29:49.686114 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b49296-111b-4004-a86e-ea43b792b43d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:29:49.686901 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b49296-111b-4004-a86e-ea43b792b43d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:29:49.687176 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b49296-111b-4004-a86e-ea43b792b43d admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:29:49.687502 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b49296-111b-4004-a86e-ea43b792b43d admin admin] PATH_INFO: `/v3/projects/8ce4d8e3a93d47948c1d76d8c3d75c11` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:29:49.688855 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b49296-111b-4004-a86e-ea43b792b43d admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ce4d8e3a93d47948c1d76d8c3d75c11)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:29:49.691175 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b49296-111b-4004-a86e-ea43b792b43d admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:29:49.752894 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-65b49296-111b-4004-a86e-ea43b792b43d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ce4d8e3a93d47948c1d76d8c3d75c11', 'request_id': 'req-65b49296-111b-4004-a86e-ea43b792b43d'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:29:49.759164 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-65b49296-111b-4004-a86e-ea43b792b43d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ce4d8e3a93d47948c1d76d8c3d75c11', 'request_id': 'req-65b49296-111b-4004-a86e-ea43b792b43d'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:29:49.773943 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-65b49296-111b-4004-a86e-ea43b792b43d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ce4d8e3a93d47948c1d76d8c3d75c11', 'request_id': 'req-65b49296-111b-4004-a86e-ea43b792b43d'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:29:49.789719 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-65b49296-111b-4004-a86e-ea43b792b43d admin admin] The token cache is being invalidate because project 8ce4d8e3a93d47948c1d76d8c3d75c11 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80013) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 14:29:49.790013 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-65b49296-111b-4004-a86e-ea43b792b43d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:29:49.790773 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-65b49296-111b-4004-a86e-ea43b792b43d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:29:49.793269 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1453/2894] 10.222.0.36 () {58 vars in 1232 bytes} [Tue May 3 14:29:49 2022] DELETE /identity/v3/projects/8ce4d8e3a93d47948c1d76d8c3d75c11 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:29:49.798429 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc949e9-023c-4dc1-84ff-24d58824a3f2 admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:29:49.800857 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-8fc949e9-023c-4dc1-84ff-24d58824a3f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:29:49.819814 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc949e9-023c-4dc1-84ff-24d58824a3f2 admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:29:49.898453 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0501d7e7-44dd-4e08-a7a5-0ebb2a21f940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:29:49.899406 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0501d7e7-44dd-4e08-a7a5-0ebb2a21f940 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:29:49.899681 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0501d7e7-44dd-4e08-a7a5-0ebb2a21f940 admin admin] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:29:49.899980 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0501d7e7-44dd-4e08-a7a5-0ebb2a21f940 admin admin] PATH_INFO: `/v3/users/ec9a67eac06745e6beca0823b61f01dd` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:29:49.901327 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0501d7e7-44dd-4e08-a7a5-0ebb2a21f940 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec9a67eac06745e6beca0823b61f01dd)` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:29:49.903385 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0501d7e7-44dd-4e08-a7a5-0ebb2a21f940 admin admin] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:29:49.972557 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-0501d7e7-44dd-4e08-a7a5-0ebb2a21f940 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec9a67eac06745e6beca0823b61f01dd'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:29:49.979949 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-0501d7e7-44dd-4e08-a7a5-0ebb2a21f940 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec9a67eac06745e6beca0823b61f01dd'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:29:49.980700 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-0501d7e7-44dd-4e08-a7a5-0ebb2a21f940 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec9a67eac06745e6beca0823b61f01dd'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:29:49.997635 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-0501d7e7-44dd-4e08-a7a5-0ebb2a21f940 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec9a67eac06745e6beca0823b61f01dd'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:29:49.998431 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.notifications [None req-0501d7e7-44dd-4e08-a7a5-0ebb2a21f940 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec9a67eac06745e6beca0823b61f01dd'} {{(pid=80012) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:29:50.018691 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1442/2895] 10.222.0.36 () {58 vars in 1223 bytes} [Tue May 3 14:29:49 2022] DELETE /identity/v3/users/ec9a67eac06745e6beca0823b61f01dd => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:29:50.226218 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b49296-111b-4004-a86e-ea43b792b43d admin admin] Authenticating user token {{(pid=80013) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:29:50.227838 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.fernet_utils [None req-65b49296-111b-4004-a86e-ea43b792b43d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80013) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:29:50.244333 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b49296-111b-4004-a86e-ea43b792b43d admin admin] Validating token access rules against request {{(pid=80013) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:29:50.302189 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf79b5d-2ee2-401a-8a80-62eb6c2ca786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a3e2c426774a3eba9534209ef0a44b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71795b2bf1064a2fb47b7b3b4817ce5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80013) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:29:50.303067 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf79b5d-2ee2-401a-8a80-62eb6c2ca786 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:29:50.303343 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf79b5d-2ee2-401a-8a80-62eb6c2ca786 admin admin] SCRIPT_NAME: `/identity` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:29:50.303611 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf79b5d-2ee2-401a-8a80-62eb6c2ca786 admin admin] PATH_INFO: `/v3/projects/a2d6511d9945487d8d3a5d7da11c6164` {{(pid=80013) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:29:50.304840 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf79b5d-2ee2-401a-8a80-62eb6c2ca786 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2d6511d9945487d8d3a5d7da11c6164)` {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:29:50.306829 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf79b5d-2ee2-401a-8a80-62eb6c2ca786 admin admin] RBAC: Authorization granted {{(pid=80013) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:29:50.355843 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-ccf79b5d-2ee2-401a-8a80-62eb6c2ca786 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2d6511d9945487d8d3a5d7da11c6164', 'request_id': 'req-ccf79b5d-2ee2-401a-8a80-62eb6c2ca786'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:29:50.361540 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-ccf79b5d-2ee2-401a-8a80-62eb6c2ca786 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2d6511d9945487d8d3a5d7da11c6164', 'request_id': 'req-ccf79b5d-2ee2-401a-8a80-62eb6c2ca786'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:29:50.372629 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-ccf79b5d-2ee2-401a-8a80-62eb6c2ca786 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2d6511d9945487d8d3a5d7da11c6164', 'request_id': 'req-ccf79b5d-2ee2-401a-8a80-62eb6c2ca786'} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:29:50.383617 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-ccf79b5d-2ee2-401a-8a80-62eb6c2ca786 admin admin] The token cache is being invalidate because project a2d6511d9945487d8d3a5d7da11c6164 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80013) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 14:29:50.383903 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-ccf79b5d-2ee2-401a-8a80-62eb6c2ca786 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:29:50.384533 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: DEBUG keystone.notifications [None req-ccf79b5d-2ee2-401a-8a80-62eb6c2ca786 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80013) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 14:29:50.386154 dv-cinder-839793-5-iscsi devstack@keystone.service[80013]: [pid: 80013|app: 0|req: 1454/2896] 10.222.0.36 () {58 vars in 1232 bytes} [Tue May 3 14:29:50 2022] DELETE /identity/v3/projects/a2d6511d9945487d8d3a5d7da11c6164 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 14:32:25.774575 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0501d7e7-44dd-4e08-a7a5-0ebb2a21f940 admin admin] Authenticating user token {{(pid=80012) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 14:32:25.776917 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-0501d7e7-44dd-4e08-a7a5-0ebb2a21f940 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:32:25.859857 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0501d7e7-44dd-4e08-a7a5-0ebb2a21f940 admin admin] Validating token access rules against request {{(pid=80012) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 14:32:25.926427 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b847347-31f5-4496-986d-22984cb2662e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '164c7f36acf644e9bf93f158e876e9e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de541be478754087934323bdbe41a579', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80012) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 14:32:25.927071 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b847347-31f5-4496-986d-22984cb2662e service placement] REQUEST_METHOD: `GET` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 14:32:25.927346 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b847347-31f5-4496-986d-22984cb2662e service placement] SCRIPT_NAME: `/identity` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 14:32:25.927723 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b847347-31f5-4496-986d-22984cb2662e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80012) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 14:32:25.929771 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.fernet_utils [None req-3b847347-31f5-4496-986d-22984cb2662e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80012) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 14:32:25.941633 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b847347-31f5-4496-986d-22984cb2662e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 14:32:25.943230 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b847347-31f5-4496-986d-22984cb2662e service placement] RBAC: Authorization granted {{(pid=80012) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 14:32:25.953566 dv-cinder-839793-5-iscsi devstack@keystone.service[80012]: [pid: 80012|app: 0|req: 1443/2897] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 3 14:32:25 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)